Skip to content

Use theprototype from claude.ai and voice

Add theprototype as a connector in claude.ai, press Connect Claude in your open theprototype tab, and talk Claude through building — in a chat on the web or desktop, in the Claude phone app, or out loud in voice mode. Claude works in your own tab, with your own access: everything it does shows up for everyone in your session and can be undone, exactly like your own edits.

New

The Claude connector needs a theprototype account and works on theprototype.app (the hosted app). Running the open-source app yourself? Use the agent bridge instead — it gives Claude Code or Claude Desktop the same tools over a session link.

What you need

  • A theprototype account, signed in on theprototype.app.
  • A Claude plan that lets you add custom connectors in claude.ai.
  • A theprototype tab that stays open while Claude works (a computer is easiest; your phone can be the one you talk to).

Set it up (once)

  1. In claude.ai open Settings ▸ Connectors ▸ Add custom connector and enter https://theprototype.app/mcp.
  2. claude.ai sends you to theprototype to approve it. The page names the app asking and where it will return (claude.ai). Leave Allow changes ticked to let Claude build, or untick it for a look-only connection that can only read the scene and take pictures. Press Allow. Not signed in? Use Sign in on theprototype.app, then I signed in — retry.
  3. Back in claude.ai, switch the connector on for your chat (the tools menu under the message box).

Connect your tab (each time you build)

  1. Open theprototype.app, sign in, and open or join the scene you want to work on.
  2. Open the AI assistant and press Connect Claude (also in Settings ▸ Connected apps). A chip reads Claude connected · this tab.
  3. Ask Claude something: "Build a campfire with five logs and a warm light", "Make the flame flicker", "What can you do here?"

One tab at a time: pressing Connect Claude in a second tab asks first, then moves the connection there. If your network blips, the tab reconnects by itself.

Keep the tab open — and in front

Claude's tools run in that tab. If you close it, Claude answers "No theprototype tab is connected — open theprototype.app, sign in and press Connect Claude". A tab left in the background is slowed down by the browser and cannot take pictures; after a few minutes the tab warns you. On a phone, talk to Claude in the Claude app and keep theprototype open on a computer or tablet beside you.

Voice mode

In voice mode Claude keeps its answers short and says what changed in plain words ("Added three trees by the fire") — it never reads out ids or numbers. Good things to say:

  • "What can you do here?" — a short spoken summary of what it can build in this tab.
  • "Put a table in the middle and four chairs around it."
  • "Make the box spin slowly", "Open the door when I click it."
  • "Make it bigger", "Paint the walls light blue", "Undo that" (or press Ctrl+Z yourself).

What Claude can and cannot do

Claude can Claude cannot
Add shapes, lights and groups; move, resize, recolour, rename, hide and delete them Save or open files, or change your settings
Make things move and react with flow nodes (spin, bounce, follow a path, open on click) and look up how each node wires Install modules, approve people who knock, or answer the app's questions for you
Add physics and run the simulation See anything outside the theprototype tab, or move your camera
Write small code behaviours, and generate 3D models with your mesh provider when you have one Do more than you can: a viewer's Claude can look but not build, and locked objects stay locked
Take a picture of the scene to check its work Keep working after you close the tab

See and undo what it did

Every step Claude takes is a line labelled Claude (connector) in Agent activity, with its own Undo. Anyone in the session sees the changes as they happen, and anyone with edit access can undo them from their own screen.

Stop it

  • Disconnect (next to the chip, or in Settings ▸ Connected apps) stops Claude at once, including a step it is in the middle of. Press Connect Claude again to continue.
  • Revoke in Settings ▸ Connected apps removes the connector's access to your account completely; claude.ai has to be approved again before it can work in any tab. You can also remove the connector in claude.ai's settings.

Privacy and limits

  • Nothing runs on our servers except a relay: Claude's request goes to your tab, your tab does the work, and the answer goes back. Your scene is never stored by the connector, and we do not log what Claude asks or what your tab answers — only counts (how many calls, how long they took).
  • Pictures come from the theprototype canvas only, downscaled, and never while the tab is hidden.
  • There is a fair-use limit on calls per minute. If Claude goes too fast it is told to wait a few seconds; ask again and it continues.

See also: Build with an AI agent · Assistant · Security