A web-based 3D world creation engine and editor — like Unity, but in the browser. Create worlds by arranging objects, then play them as interactive games or record animations as videos. All runs locally in your browser.
v1 Status: Design complete ✅ — Ready to start building tomorrow.
An intelligent agent will work alongside you (Ollama-compatible API default, OpenAI Chat Completions swappable). Agent integration is post-v1; v1 focuses on the manual editor.
# Clone the repo
git clone https://github.com/Varun-Patkar/WorldChat.git
cd WorldChat
# Create a new project and start the editor
./start.shSee docs/Spec1.md for the full specification and roadmap.
- Single monolithic app — Vite + React + TypeScript, no monorepo
- Create projects in any local folder (like VSCode workspaces)
- Auto-save last opened project
- Simple
start.sh/start.batto launch dev server
| Panel | Location | Purpose |
|---|---|---|
| Hierarchy | Left | Tree of all scene objects, parent-child relationships |
| Scene View | Center | 3D viewport with orbit/pan/zoom |
| Agent Panel | Right (collapsible) | Reserved for future agent integration |
| Properties | Bottom | Contextual — editable properties when object selected |
- Right-click primitives: Box, Sphere, Cylinder, Cone, Plane, Torus, Capsule
- Drag-and-drop import:
.glb,.gltffiles with pre-processing pipeline (normalizes materials, scales, metadata)
| Tool | Hotkey | What it does |
|---|---|---|
| Move | W |
Translate on X/Y/Z axes |
| Rotate | E |
Rotate around axes |
| Scale | R |
Scale uniformly or per-axis |
- Press "Play" to walk around your created world in FPS-style controls
- Configurable WASD + mouse look before play
- Press Esc to return to edit mode
- Define camera keyframes (position, target, duration)
- Play back animations in real time
- Frame capture for video export — all browser-based, no server
| Layer | Technology |
|---|---|
| Frontend | React + TypeScript (Vite) |
| 3D Engine | React Three Fiber + drei |
| State | Zustand |
| Styling | Tailwind CSS |
| Dev Server | Vite |
| Project Format | JSON + code files |
- Default: Ollama-compatible
http://127.0.0.1:47831 - Swappable: OpenAI Chat Completions API
- Tools → Declarative R3F calls with raw Three.js code fallback
WorldChat/
├── docs/
│ └── Spec1.md # Full specification + roadmap
├── src/
│ ├── components/
│ │ ├── editor/ # Hierarchy, SceneViewport, Properties panels
│ │ ├── scene/ # Primitives, TransformGizmo, CameraControls
│ │ └── ui/ # Shared UI components
│ ├── hooks/ # useProject, useSelection, useTransform
│ ├── stores/ # Zustand stores (scene, selection, project)
│ ├── utils/ # Serializer, model importer, file drop handler
│ ├── types/ # TypeScript type definitions
│ └── App.tsx # Main layout
├── LICENSE
├── README.md
├── start.sh # Dev server starter script
├── package.json
├── vite.config.ts
└── tsconfig.json
- Project scaffold and git setup
- Specification document (this design)
- Editor with basic R3F scene rendering
- Hierarchy panel + object selection
- Primitive shape creation via right-click
- Transform gizmos (W/E/R) using drei
- Scene serialization (JSON + code files)
- Last-opened project tracking
- Drag-and-drop glb/gltf import pipeline
- Asset management in
assets/folder
- Game mode (WASD FPS controls, Esc to return)
- Camera keyframe editor
- Animation playback and frame capture
- Ollama/OpenAI Chat Completions API integration
- Tool system for scene manipulation
- Raw Three.js code hot-loading fallback
- Agent UI panel
MIT License — see LICENSE file.
© 2026 Varun Anand Patkar. All rights reserved.