01What Is Hermes Computer Use and How It Works

Hermes computer use is a feature of Hermes Agent that lets an AI agent control your computer. It can open apps, type notes, and browse websites by clicking and typing in the background. Your own cursor stays put, and your windows don't jump to the front.

The system uses what Julian calls the Hermes takeover engine. It reads the screen, decides what to click or type, and then does it quietly. This means you can work on one thing while the agent does another on the same machine.

It's now available on Windows and Linux, with improvements on Mac OS. Previously, this kind of background control was mostly limited to Mac, but now all three operating systems work through one Hermes setup.

02Key Features of Hermes Computer Use

Hermes computer use comes with several standout features that make it different from older tools.

  • Background operation: The agent works with its own cursor, so your mouse doesn't move and your windows don't change.
  • Cross-platform support: Works on Mac OS, Windows, and now Linux.
  • Model-agnostic: You can use Claude, GPT, Gemini, or any free API with vision. It doesn't lock you into one model.
  • Two modes: Auto mode is ultra-fast and real-time, while agent mode is more powerful for complex background tasks.
  • Voice interaction: You can talk to the agent and it can respond, as shown in the demo where Julian asked how it was doing.
  • Approval system: The agent asks before doing anything potentially destructive, like deleting or editing files.

These features mean you stay in control while the agent does the heavy lifting.

03How to Set Up Hermes Computer Use

Setting up Hermes computer use is surprisingly simple, even for non-technical users. Julian, who says he's not technical, tested it successfully. The process uses just a few commands in your terminal.

  1. Open your terminal on your computer.
  2. Run the command: Hermes computer use install. This installs the necessary components.
  3. Follow any on-screen prompts to complete the setup.
  4. Optionally, integrate it with Hermes Jarvis or an agent operating system for added features like voice activation.
  5. Once installed, you can start giving it commands in plain English.

Julian notes that members of his community have set up the full agent OS with Hermes Jarvis within 30 minutes. So the process is quick and beginner-friendly.

04How to Use Hermes Computer Use: Examples from the Episode

Using Hermes computer use is as simple as giving a command. In the episode, Julian shows several real-time examples.

First, he turns on real-time mode and says, "Can you open up Obsidian for me?" The agent instantly opens the app. Then he asks it to open juliangoldy.com, and it does so immediately.

Next, he switches to agent mode. He asks the agent to open notes and write a quick note saying "hello." The agent does it in the background without interfering with his screen.

He also demonstrates voice interaction. With real-time mode and sound on, he asks, "Are you there? How's it going?" The agent responds, "Quite well, sir.

Ever ready to assist you." Then he asks it to open Google, and it does.

The key is that during all these tasks, Julian's own cursor doesn't move. The agent uses its own hidden cursor to click and type, so you can keep doing your own work simultaneously.

05Results and Comparisons Shown in the Episode

Julian compares Hermes computer use to other tools like Core computer use. He points out that most computer use tools take over your screen, which freezes you out until they finish. They also tend to be slow and make mistakes.

With Hermes, the demos show smooth, real-time execution. The agent opens apps, types notes, and answers questions without any lag. It also works in the background, so you're not locked out.

Another comparison is that most tools only work with one specific model. Hermes, however, works with any AI that has vision, including free local models. This means you don't have to pay for a premium model to use it.

In terms of results, the agent successfully completed every task Julian tried in the episode, from opening websites to writing notes.

06Tips, Limits, and Mistakes to Avoid with Hermes Computer Use

Based on the episode, there are a few things to keep in mind when using Hermes computer use.

  • Use the stop button: You can click the stop button to halt the agent at any time. This gives you control.
  • Refresh pages when needed: If the agent gets stuck, you can refresh the page it's working on.
  • Start with auto mode: For simple tasks, auto mode is fast and real-time. Use agent mode for more complex background work.
  • Don't worry about destructive actions: The agent asks before deleting or editing files, so you have the final say.
  • You don't need to be technical: Despite what some might think, setup is only three commands, as Julian emphasizes.

One common mistake is assuming it will be like old tools that take over your screen. Hermes works differently—it's a quiet takeover.

07Who Should Use Hermes Computer Use and Why

Hermes computer use is for anyone who wants to automate repetitive tasks on their computer. This includes non-technical users, since setup is simple. Julian himself is not technical and was able to use it successfully.

If you've tried other computer use tools and found them useless, this might be different. Old tools take over your screen and are slow. Hermes works in the background and is smooth.

You can use it with any AI model you already have, even free ones. This makes it accessible to people who don't want to pay for Claude or GPT.

By learning it now, you get a head start. Julian advises not to wait for the tech to mature because early adopters move ahead.

08How Hermes Computer Use Integrates with Hermes Jarvis

Hermes computer use can be wired into Hermes Jarvis, a customized version of the agent that's part of Julian's agent operating system. This adds voice activation and real-time interaction.

Inside Hermes Jarvis, you get a live chat, a studio for generating images and videos, a workspace, and a memory system. The memory is visualized in a galaxy, and it can recall past conversations.

The agent operating system also includes goal mode and a loop engine for agent loops. You get four coaching calls per week, daily tutorials, and access to a community with 187 pages of testimonials.

If you want the full setup, you can join the AR Profitable Boredom community or visit AIProfitBoarding.com. The integration means the agent driving your screen already understands you.