01What Is Hermes Jarvis and How It Works

Hermes Jarvis is a voice-activated AI agent that listens in the background and responds to your commands. It can open websites, build simple apps, check your notes, and pull memories from your Obsidian vault. Julian Goldie built this tool by combining Claude Desktop, 11 Labs, and the Hermes Agent operating system.

When you speak to it, it processes your request and takes action. For example, you can say "Build me a snake game" and it will create one on the spot. It shows you a live preview of what it builds, so you can see the result right away.

02Main Features of Hermes Jarvis

Hermes Jarvis comes with several powerful features that make it a useful daily assistant:

  • Voice activation: A wake word lets you call it without clicking anything.
  • Build by voice: Say "Build me..." and it creates simple apps like games or tools.
  • Open websites: It can open any URL you tell it to.
  • Obsidian integration: It reads your Obsidian vault to pull memories or give summaries.
  • Conversation history: All your chats are saved and searchable.
  • Warm mode: A full-screen conversation interface for longer talks.
  • Gallery of past builds: Ask "Show me everything I've built" and it displays a preview.
  • Team dashboard: See all your agents in one place.

03How to Set Up Hermes Jarvis

To set up your own Hermes Jarvis, you need to link a few tools together. Here are the steps Julian showed in the episode:

  1. Install Claude Desktop: This runs in the background and handles the heavy building.
  2. Sign up for 11 Labs: Use it for the voice and speech synthesis.
  3. Get Hermes Agent OS: This is the operating system that connects everything.
  4. Create a wake word: Configure a trigger word so the agent listens without a button press.
  5. Link your Obsidian vault: Give the agent access to your notes so it can pull memories.
  6. Set up a bookmark or dashboard: Save the agent in one place so you can return to it easily.

Once these pieces are in place, you can speak commands and the agent will respond.

04How to Use Hermes Jarvis: Real Examples

In the episode, Julian showed several ways to use Hermes Jarvis. First, he asked it to "Check my Obsidian log." The agent pulled up his recent notes from the vault and gave him a spoken summary.

Then he said "Build me a snake game." Within seconds, the agent built the game and showed a live preview. Julian could then click to play it. He also used the command "Show me everything I've built" and the agent displayed a gallery of all previous builds with previews.

Other commands include "Open juliangoldie.com" to launch a webpage, "Catch me up" to get a day summary, and "Show me my team" to see all active agents in the system. The agent also cracks jokes and speaks multiple languages.

05Results and Comparisons Shown

Julian noted that Hermes Jarvis does not always reply perfectly the first time. He said "Does it always reply perfectly first time round? No, absolutely not." But despite rough edges, it is still useful for building simple things quickly.

Compared to other voice agents, Julian said this setup is unique. He mentioned that most voice agents require opening 11 Labs, logging in again, and doing extra steps. With Hermes Jarvis, everything is saved in one place: no repeated logins, no switching tabs.

He also pointed out that you can attach a phone number to call the agent, but he removed that feature because it could be a security risk.

06Tips, Limits and Mistakes to Avoid

Here are the key warnings and advice Julian shared:

  • Do not attach a phone number: If someone else gets access to that number, they could control your agent. Only use it if you limit what the phone can do.
  • Expect delays on builds: When building an app, the agent takes a little time to reply. It is not instant.
  • Keep your agent in one place: Bookmark it or keep it in a dashboard so you can come back quickly without reconfiguring.
  • Use the full system: Hermes Jarvis is most powerful when connected to Obsidian, Claude, and the idea factory. A standalone voice agent is less useful.

07Who Should Use Hermes Jarvis and Why It Matters

Hermes Jarvis is for anyone who wants to automate repetitive computer tasks by voice. Julian built it for himself to save time opening websites, checking notes, and prototyping ideas. It is especially useful for content creators who manage many tools and need quick access to their digital brain.

Because it ties into a larger system (the AI Profitable Boardroom), users can also orchestrate teams of agents, generate SEO content, run a video agent, and manage a Kanban board. This makes it more than a simple voice assistant — it becomes the command center for your AI workflow.