Virtual Reality for Software Development: Exploring the Meta Quest 3
This article explores the potential of using the Meta Quest 3 for software development, examining various methods and their limitations. While virtual reality offers intriguing possibilities, it's important to consider its current state and practicality for developers.
VR's Niche Appeal
Virtual reality remains a niche market, primarily driven by gamers. While devices like the Meta Quest 3 offer immersive experiences, their utility for professional tasks like software development is still being explored. The author enjoys using the Meta Quest 3 for games like Beat Saber and Red Matter, and also recommends VR for Table 10 and A Fish Man's Tale.
Developing in VR: Challenges and Solutions
Developing directly within the Quest environment presents unique challenges. Unlike traditional computers, there's no native access to terminals or IDEs like VS Code. Therefore, developers must find alternative solutions.
Browser-Based Development with VS Code
One approach is to leverage the browser within the Quest. VS Code can be run directly in the browser using vscode.dev. A more robust solution involves using a GitHub Codespace, which spins up a cloud-based machine for running code. This allows developers to access their settings from any device. A temporary URL grants access to the Codespace after logging in.
Connecting Peripherals
To effectively use the browser-based development environment, connecting a mouse and keyboard is crucial. Bluetooth connectivity allows for seamless integration. The author notes that the mouse appeared unusually large. He uses an Apple Magic Keyboard for typing directly in the browser. Because this is running on a code space, code can be easily run on the cloud with the press of a button.
Limitations of the VR Interface
While functional, the VR interface has its drawbacks. Precise mouse movements can be difficult, making it less ideal for certain tasks.
Multi-Screen Setup within VR
The Quest allows for creating multiple virtual screens. For example, users can open a Discord server and Stack Overflow alongside the code editor. These windows can be repositioned and resized. While the layout isn't perfect, it enables a more comprehensive development workspace.
Distance Viewing Mode
A distance viewing mode is available to improve readability. This can be activated with a single click. This mode positions the windows further away, making them easier to view. Users can still adjust the size of the windows.
Codespaces
Because the development relies on Codespaces, speed relies on the cloud and not on the Quest 3 itself. Using Codespaces requires a paid subscription.
Using the Meta Quest 3 as a Virtual Monitor
Another method is to use the Meta Quest 3 as a virtual monitor for a desktop computer. This can be achieved through applications like Virtual Desktop and Meta Horizons Workrooms.
Virtual Desktop
Virtual Desktop connects to the computer via a small application installed on the desktop. Once connected, the computer's screen is displayed on a large virtual screen within the Quest environment. The controller can be used to resize the screen. Input is limited to peripherals connected to the computer. Virtual Desktop offers various immersive environments, such as a modern house or a game room. The application costs \$20.
To ensure you can see the physical keyboard and mouse, using pass-through mode is recommended.
Meta Horizons Workrooms
Meta Horizons Workrooms, currently in beta, provides a similar experience. Like Virtual Desktop, it requires a desktop application for connectivity. Workrooms offers different environments, including a lake setting.
Desk Passthrough
One advantage of Workrooms is the ability to overlay a virtual desk on top of the real-world view. This allows users to see their physical keyboard and mouse, improving usability.
Workrooms Shortcomings
Workrooms has its drawbacks, including occasional bugs and crashes. The author notes a lack of easy options for resizing and repositioning the screen.
Final Thoughts and Considerations
The author summarizes the three options: 1. VS Code in the Browser with GitHub Codespaces: Least preferred due to cumbersome interactions with the mouse and keyboard. 2. Virtual Desktop: Works reasonably well, with minimal lag. 3. Meta Horizons Workrooms: Promising, but buggy and lacking screen customization options.
The experience of designing software on the Meta Quest 3 is not great. It can be more successful when using Virtual Desktop or MetaHorizon's Workroom.
While using Virtual Desktop or MetaHorizon's Workroom has promise, the current state of VR software development isn't quite ready for prime time. The applications need more refinement, and wearing a VR headset for extended periods can be uncomfortable.
The author is curious about others' opinions on VR software development.