01What Hermes AI Agent Is and How It Works

Hermes AI Agent is a local AI agent that can be supercharged with memory and context using two free tools: Omi and Obsidian. In this episode, Julian Goldie shows how to connect these tools so Hermes automatically remembers everything about you.

Omi records your conversations and activities using microphone and screen recording. It then writes memories and organizes them into a brain map. Obsidian is a free note-taking app that stores these memories in a vault.

Hermes reads this vault to get context about you.

The setup means you don't need to manually train your AI agent on memory anymore. It happens automatically. The connection is fast, easy, and free.

You can also use the same memory vault for other AI agents like OpenClaw or Pi.

02Key Features of the Omi and Obsidian Setup

Omi and Obsidian together give Hermes a powerful memory system. Here are the main features Julian highlights:

  • Automatic memory writing: Omi records everything you do and writes memories each day.
  • Brain map visualization: Memory section shows a chart of your memories and conversations.
  • Screen and microphone access: Enabling these lets Omi capture your full daily context.
  • Export to Obsidian: One click writes a memories file to your Obsidian vault.
  • Local sync: Hermes reads the Obsidian vault directly from your computer, so it stays private.
  • Cross-agent compatibility: Use the same vault with OpenClaw, Pi, Core Code, and more.

Omi also offers extra features like syncing to wearables and a command-O shortcut to ask questions about your screen. Julian has over 650 memories in just a few weeks of use.

03How to Set Up Omi and Obsidian for Hermes

Setting up this memory system is straightforward. Julian walks through the steps in the episode:

  1. Install Omi on your device and create an account if needed.
  2. Install Obsidian, which is free, and create a new vault for your memories.
  3. In Omi, enable microphone access and screen recording so it can capture your activities.
  4. Connect Omi to your Obsidian vault by selecting the export option.
  5. Click export to write a memories file into your Obsidian vault. Omi does this automatically each day.
  6. Get the file path of your Obsidian folder: open the folder in Finder, get info, and copy the path.
  7. In Hermes, give the command to use that file path for memory and context.

That's it. Hermes will now read your memories from Obsidian automatically.

04How to Use the Memory-Powered Hermes

Once connected, Hermes uses your Obsidian vault as its long-term memory. Julian shows how it reads the memories folder and uses that file path to find your personal data.

For example, Hermes knows what time you sleep because that detail is in your Omi memories. It also understands your music preferences and other personal facts. You can ask it questions like 'What could you help me automate?' and it will use your memories to give tailored answers.

The same setup works in OpenClaw. Just give OpenClaw the same file path command, and it will pull the same memories. This works for any local AI agent that can read files.

You can also use Omi directly by pressing command-O to pull up a screen overlay. It sees your current screen and context, and you can ask questions. Note that this uses premium messages, so Julian recommends using it only when needed.

05Results and Comparisons from the Episode

Julian shares his experience from testing this setup for a couple of weeks. He has over 650 memories stored in Obsidian, all collected automatically.

He compares the memory quality to other methods, saying it understands him better than almost anyone else. The level of detail is 'insane' in his words, including personal routines and preferences.

He also highlights that this is free, unlike training your own memory systems. The only premium part is Omi's message limit, but you don't need messages for this use case.

Julian mentions that you can export to many other apps too, like Notion, calendar, emails, and local files. He also notes a plugin for OpenClaw exists, but he doesn't go into detail.

06Tips, Limits, and Mistakes to Avoid

Julian offers practical tips for getting the most out of this system:

  • Enable both screen recording and microphone for maximum context.
  • Use Obsidian because it's free and works locally with Hermes.
  • Export memories daily to keep the vault up to date.
  • Copy the exact file path from Finder to avoid errors.
  • Don't rely on Omi's chat messages, as they are limited to 33 per month on the free tier.
  • Remember that this works with any local AI agent, not just Hermes.

A common mistake is not enabling screen recording, which limits context. Another is not exporting regularly, so memories go stale. Also, avoid using Omi's messaging features if you want to stay free, since the premium messages are not needed for the Obsidian sync.

07Who Should Use This Memory Setup

This memory setup is ideal for anyone using Hermes or other local AI agents and wanting them to have deep personal context. It's perfect for power users who want their AI to understand their daily life.

It matters because it removes the need to manually train memory. The AI automatically learns from your activities, making it more useful for automation, planning, and personal assistance.

Julian also mentions that you can connect Omi to wearables if you use them, adding even more data. This system is free and fast, making it accessible to anyone willing to set it up.