01What XR Blocks Is and How It Works

XR Blocks is a free, open-source tool from Google that turns a simple sentence into a fully interactive 3D world you can walk around in. It uses a custom version of Google's Gemini AI called an XR Blocks gem. This gem is trained to be an expert in spatial computing.

It knows the rules of physical space—how objects scale, how far apart things should be, and how to make an XR experience feel real.

When you type a prompt, the AI doesn't just generate code. It generates spatial design. It thinks about where you'd stand, what you'd reach for, and how the experience would feel when you're inside it.

The result is a working extended reality environment that you can interact with in under 60 seconds. Google's own team said a senior XR engineer would need a full day to build what this tool does in a minute.

02Main Features of XR Blocks

  • Text-to-3D generation: Type a sentence like "a dandelion that blows away when you pick it up" and get a working interactive scene.
  • 95.5% success rate: In a formal benchmark with 60 prompts from 20 people, the tool delivered a working experience on the first try 95.5% of the time.
  • Shareable web links: Every creation becomes a link that opens in a browser. No app download or headset required.
  • Built on WebXR: It runs in Chrome on desktop and mobile, works across devices, and is not locked into Apple or Meta ecosystems.
  • Open source: The code is free and open source, built by a team that includes Riccardo Cabello (Mr. Doob), creator of three.js.
  • Desktop simulator: You can test experiences without a headset using the built-in simulator in Chrome.

03How to Set Up and Get Started with XR Blocks

  1. Go to the Google research block website where XR Blocks is hosted. No installation or sign-up is needed—the tool runs in your browser.
  2. Open Chrome on your desktop. XR Blocks uses WebXR, so Chrome is the recommended browser.
  3. Enable the built-in desktop simulator. This lets you move around and interact with 3D worlds using your keyboard and mouse instead of a headset.
  4. Type a prompt into the text box. Be descriptive—for example, "a physics lab with a lever and weights where you learn balance by actually lifting things."
  5. Press enter and wait. The AI generates the XR experience in under 60 seconds, often in less than 20 seconds.
  6. Use your keyboard or mouse to walk around the 3D world. Pick up objects, open doors, or trigger interactions as the scene responds to your actions.
  7. Copy the shareable web link to send your creation to anyone. They don't need a headset—it opens in their browser.

04How to Use XR Blocks: Examples and Walkthrough

Google built eight working demos for the announcement. One visualizes real NASA exoplanet data. Another teaches quantum physics using Schrödinger's cat.

Another is a chemistry lab where students can safely do experiments. You can pick up virtual bottles and watch reactions happen around you.

For a marketing agency, you can build an interactive 3D product demo for a client in an afternoon. Type a prompt like "a volleyball court where the ball responds to your real hands." The AI creates a scene where the ball reacts to your movements. You can then send the client a link—no download, no install.

The experience runs in their browser on any device.

You can also create training materials. For example, an interactive solar system where you can click on planets to learn facts. Or a physics lab with a lever and weights that teaches balance by actually lifting things.

The tool handles the technical setup so you can focus on the idea.

05Results and Comparisons from the Episode

Google ran a formal benchmark using 60 different prompts from 20 separate people across four workshops. The success rate was 95.5% on the first try with no tweaks or back-and-forth. Six months earlier, the accuracy was only 70%.

The tool went through 11 major releases to reach the 95.5% mark, and the company published the failure story alongside the success story.

Google's own team said a senior XR engineer would spend a full day building what this tool does in a minute. That means one day of work is compressed into 60 seconds. The outputs are standards-compliant and built on WebXR, which runs in Chrome and across devices.

This is unlike many AI demos that look good but fail in real use—Google stress-tested this system with a diverse set of prompts and showed their work.

06Tips, Limits, and Mistakes to Avoid

  • Don't expect perfect output for every prompt. The tool has a 95.5% success rate, so about 5 out of 100 prompts may need adjustment. If your first try fails, tweak the wording and try again.
  • Use descriptive prompts. Vague prompts like "make a room" will give generic results. Instead, say "a chemistry lab where students can safely do experiments." The more detail you give, the better the output.
  • The tool is not a production engine. Google is working on a cross-compiler that would translate XR Blocks into native code for Unity or Unreal, but that feature is not available yet. For now, use it for prototypes and demos.
  • You don't need a headset. Many people think they need VR hardware to use XR Blocks. You can try all the demos on a desktop browser with the built-in simulator. Don't let lack of hardware stop you from exploring.
  • Don't wait for the mainstream. Samsung just launched the Galaxy XR headset, and Google IO is in May. The hardware is coming soon. If you learn the tool now, you'll be ahead when demand arrives.

07Who XR Blocks Is For and Why It Matters

XR Blocks is for anyone who creates content or sells products online. That includes marketing agencies, freelancers, educators, and product sellers. A marketing agency can now build interactive 3D product demos for clients in an afternoon—a service that used to be very expensive and time-consuming.

Freelancers can add XR creation to their service offerings and charge premium rates when demand grows.

This tool matters because it removes the last major technical barrier to extended reality. Before XR Blocks, you needed to know Unity or Unreal Engine, 3D modeling, and spatial computing. Now the barrier is imagination, not engineering.

The people who learn the new tool first capture the market. The people who wait lose the clients. Extended reality is becoming as accessible as web design and video editing, and the gap between early movers and everyone else is opening right now.