Stop writing environments from scratch and ship faster.
Get started in 30 seconds:
curl -fsSL https://worldql.com/install.sh | shSupports macOS, Linux, and Windows via WSL.
Build and ship RL environments faster
Multiple people and agents can edit the same environment at once, like Google Docs
Built on web technologies, Dreamlab is easy to deploy and works for all types of applications
Build, test, and deploy environments in hours instead of weeks
Analyze session replays to discover issues early in training runs
Robotic Arm Manipulation Task
“It looks like the model is making high speed random movements in an attempt to achieve the goal by chance. To address this, I'll add a cost per movement to the reward function…”
Simulated CRM / Salesforce Clone
“Viewing this session replay, it appears the model is clicking the submit button rapidly to count the same customer update action multiple times. Fixing this race condition in the UI…”
Track every change, branch experiments, and collaborate easily. Version control built for iterating on complex environments.
See how changes in your environment impacted results
Start collaborating instantly. No software downloads or Git setup required
Resolve merge conflicts visually without leaving your browser
“One of the best version control UIs I've seen in a browser”
WorldQL is built on web technologies and supports anything that can run in a browser. In addition, the engine includes the Rapier physics engine, a key-value database, and multiplayer support for multi-agent environments
Environments can be exported in one click to OpenEnv-compatible Docker containers.
We specialize in environments for training domain specific computer use models. We also can provide RL environments for generic coding models focused on game development, one of the most accuracy sensitive domains of software.
We help labs and vendors build custom environments and human behavior datasets. We'd love to chat!
Send us an email and we'll get back to you quickly.
You can also book a call.
