VoidCode VR — Spatial VR for AI Coding Sessions

00

The Problem

Context switching between multiple AI coding sessions is cognitively expensive. Tabs and split panes don't scale — by the fourth session, you've lost track of what's where.

VoidCode VR makes it spatial. Each session is a floating terminal panel in 3D space. Walk toward one to focus it. Step back to see everything. Speak your commands via push-to-talk voice input. No keyboard required in VR.

This isn't a gimmick. It's a developer tool that happens to exist in VR.

01

Features

Push-to-Talk Voice Input

Hold a controller button, speak, release. Local Whisper STT transcribes your speech and injects it into the focused terminal. Fully offline, sub-second latency. Works for any terminal input — commands, responses, slash commands.

BUILT

Live Terminal Panels

Full ANSI terminal rendering via xterm.js — colors, cursor positioning, scrollback, alternate screen buffers. The same rendering approach VS Code uses. Each panel runs in its own browser process for stability.

BUILT

Multi-Session Management

Spawn, kill, and label sessions from within VR. Each gets its own floating panel in world space. Wrist menu shows all active sessions with one-tap teleport. Proximity-based focus with color-coded activity borders.

BUILT

Project-Aware Sessions

Each session can target a specific working directory. Project picker scans configured roots and detects project markers (.git, package.json). Sessions auto-name from the directory. Recent dirs remembered.

BUILT

Themes & Customization

6 terminal themes (Dark, Monokai, Dracula, Nord, Solarized, Gruvbox) with live switching. Panel size presets (S/M/L). Drag-to-resize with aspect ratio lock. All settings persist across sessions.

BUILT

Panel Grouping

Group related panels together — they move as a unit when you grab any member. Create and disband groups from the wrist menu. Organize your workspace by project or task.

BUILT

Spatial Audio Notifications

Completion chimes from the panel's 3D position. Know which session needs attention without looking. "Waiting for input" detection highlights panels with urgent prompts.

Save your entire spatial layout — positions, sizes, groups, working directories. Restore it later and pick up exactly where you left off.

Architecture

  Claude Code                  AI coding agent (runs in PTY)
       ↕
  node-pty                      Pseudo-terminal (full TUI support)
       ↕
  Node.js Sidecar               Session lifecycle, WebSocket server
       ↕
  WebSocket                     Terminal bytes + JSON control messages
       ↕
  xterm.js                      Terminal renderer (in browser surface)
       ↕
  Unity Web Browser            CEF browser → Texture2D on 3D quad
       ↕
  VR Panel                      Floating in world space (Unity + SteamVR)
       ↕
  whisper.unity                 Local Whisper STT for push-to-talk

Why this stack? Claude Code is a rich TUI app with colors, spinners, alternate screen buffers. xterm.js handles all of that out of the box — the same way VS Code's integrated terminal does. node-pty gives it a real terminal. A WebView renders it onto a 3D surface. Every layer does a job that would be harder to build from scratch. Voice input stays fully local via whisper.cpp — no cloud STT, no latency, no cost.

03

Tech Stack

VR Runtime

Unity 6 LTS + SteamVR

OpenXR, XR Interaction Toolkit, Index controller bindings

BSD-3 / UNITY COMPANION

Terminal

xterm.js

Full ANSI terminal emulator, battle-tested

MIT

Browser Surface

Unity Web Browser

CEF-based, separate process, renders to Texture2D

MIT

Session Manager

Node.js + node-pty

PTY process management, WebSocket streaming

MIT

Voice Input

whisper.unity

Local Whisper STT via whisper.cpp, fully offline

MIT

IPC

WebSocket

Bidirectional, low-latency, C# + Node native

—

04

Progress

01

Complete

VR Foundation

SteamVR scene, teleport + smooth locomotion, controller interaction, dark void environment with grid floor.

02

Complete

Live Terminal Pipeline

Node.js sidecar with PTY, xterm.js rendering, WebView on 3D panel, keyboard input, SteamVR overlay keyboard, VR button bar.

03

Complete

Multi-Session Management

Spawn/kill sessions in VR, wrist menu with teleport, proximity focus, color-coded activity states, grab-to-reposition panels.

04

Complete

Voice Input

Push-to-talk with local Whisper STT. Hold button, speak, release — transcribed text injected into terminal. Fully offline, sub-second.

05

Complete

Session Setup & Panel UX

Working directories, project picker, 6 themes, settings persistence, drag-to-resize, panel grouping, size presets.

06

Workspace save/load, spatial audio notifications, completion chimes, input-waiting detection, ambient soundscape.

05

On the Roadmap

Spatial Audio

Notification sounds from the panel's 3D position. Know which session needs you without looking.

Workspace Persistence

Save and restore your entire multi-session spatial layout.

Completion Detection

Audio chime + panel flash when a session finishes. Never miss a Y/N prompt.

Ambient Soundscape

Background audio for immersion. Custom generated tracks.

Panel Pinning

Pin a panel to follow you HUD-style instead of staying fixed in space.

Alternative CLIs

The terminal pipeline is generic. OpenClaw, OpenCode, Codex CLI — just a different spawn command.

06

Requirements

Unity 6 LTS

VR application runtime and editor

FREE (PERSONAL)

Steam + SteamVR

VR runtime for headset

FREE

Node.js 20+

Sidecar runtime

FREE

Claude Code

The AI sessions themselves

SUBSCRIPTION

SteamVR Headset

Valve Index recommended

HARDWARE

Windows 10/11

Host OS for VR + sessions

—

$0

VoidCode is free. Free on Steam, with an optional ~$5 Supporter DLC (cosmetic themes + badge) if you want to chip in. You bring the VR headset and a Claude Code subscription — everything else is included.

07

Coming to Steam

VoidCode VR is coming to Steam

Free to download, with an optional Supporter DLC for cosmetic extras. The Steam store page is being set up — wishlist will be available soon. In the meantime, you can build from source on GitHub.