AI News Today
← All episodes
Episode 47 · June 24, 2026 · 10:39

New FREE Hermes Computer Use Agents!

Hermes Agent Computer Use Update: Background Desktop Control Now on Windows, Linux & macOS

Hermes Agent’s “computer use” feature has a new update adding Windows and Linux support and improving macOS, allowing Hermes Jarvis to control a computer by reading the screen and clicking/typing in the background without moving your real cursor or interrupting your work. The script demos opening Obsidian, websites, Google, and writing a note via real-time mode and a more powerful agent mode that can run tasks in the background. It explains the “Hermes Takeover Engine” workflow, emphasizes cross-OS support, and notes you can use different AI “brains” (including local/free options) rather than being locked to one model. Safety is highlighted through approval prompts before potentially destructive actions, plus a stop button. The episode contrasts this with slower, screen-taking tools like Claude Computer Use and promotes the AI Profit Boardroom/Agent OS for setup, training, and support.

00:00 Update Overview
00:16 Live Demo Basics
00:37 Agent Mode Tasks
01:18 Voice Interaction Demo
01:43 Takeover Engine Explained
02:57 Five Step Quiet Control
03:43 Models Setup Commands
05:45 Agent OS Pitch
06:20 Safety Approvals
06:52 Why Hermes Beats Others
08:40 Key Takeaways
09:07 Join And Wrap Up

Full transcript

So there's a brand new update from Hermes Agent, which is computer use. And you can now use computer use on Windows and Linux as well. And also there's been improvements on the Mac OS. So if you're not sure what this is, basically this means the Hermes Agent can now control your computer.

Let me show you an example. So we've got Hermes Jarvis over here inside our agent operating system. And for example, if we switch on real time and we'll say, hey, can you open up Obsidian for me? Boom, look at that.

It literally opens up Obsidian. Hey, can you open up juliangoldy.com? Boom, shakalaka, it opens up juliangoldy.com. And then we're gonna switch that off.

And what we can also do is switch over here to agent mode. Now, agent mode is pretty powerful because now we can actually have it improving and building stuff directly inside our computer. So not only can we get Hermes Jarvis to, for example, open websites, control a computer, open up Obsidian, whatever, we can also have this working in the background, working on tasks with agent mode inside Hermes Jarvis as well. So if we say, hey, can you open up notes and just write a quick note saying hello?

Look at that. It just opens it up instantly. Pretty crazy stuff. Also, this can speak to us as well.

And it's pretty powerful. So let me explain exactly how it works in a second. And then just to show you as well that it can like talk back and that sort of thing. If we switch on real time here and we've got the sound on now.

Hey, are you there? How's it going? Quite well, sir. Ever ready to assist you.

How may I be of service today? Can you open up Google for me? Google is now open, sir. So we can see how that works basically.

And if you're wondering, okay, how does this whole system loop around? How do you get Hermes agent to control your computer like this? Let me walk you through the whole system. And this is using something I call the Hermes takeover engine.

Essentially what you can do is you can get Hermes now to click and type on your computer in the background with its own cursor. Yours doesn't move. So for example, when we created that note before that says hello, it doesn't interfere with what you're doing on screen. So you can work on something at the same time and it will just work in the background.

And this just landed on Windows and Linux too, which is pretty awesome. So you can say, okay, you ask, you can say, do this for me. It reads the screen, it clicks and types, it does it in the background, everything gets done. And then you can keep typing or doing whatever you're doing whilst it's working on all that other stuff.

Now, you might be worried here like, wow, it can take over my screen. These AI agents can take over my screen. Like won't this lock me out or something like that? Well, that's really the whole point of this one is it doesn't.

It works in the background. So your real mouse doesn't actually move. Your windows don't jump to the front. Your desktops don't switch.

Your agent is just working in the background with this system. This really changes everything. So the way this works is in five steps with the Hermes takeover engine. So it's a quiet takeover, right?

It's driving your desktop in the background. Your cursor stays where it is. Your windows stay put. Nothing pops up in the front.

You and the agent just work on the same machine at the same time. You can hand it any OS. So Mac, Windows, and now Linux, whatever you run, Hermes can click and type on it. Same simple commands, same background magic.

And we have two options. So you can have ultra fast inside Hermes Javis, or you can have agent mode. Agent mode can do a lot more. It's a lot more powerful in the background.

Auto is just like super fast, like literally real time as you saw before. And then it can do basic things as well with this. So it depends what you're automating with computer use and how powerful you want it to be. Now you can do this with any brain you want, which means for example, you could plug in.

We've got local models. We've got free APIs. We have OAuth, like for example, Grok working with Hermes Javis. Whatever you want to work with this, you can have it working.

And there's also a stop button whenever we want as well. So we can click this on and off if we want to, or we can refresh a page. And it's pretty powerful stuff. And so how this works is you've got like two people operating the same machine.

You, whatever you're doing, and also Hermes that's working in the background. Both are happening at once. And it's hands-free when you use something like this. So this is now available on Windows and Linux as well.

So Mac OS, Windows, Linux, they all work through one Hermes and they can all click and work in the background, which is pretty amazing. So, you know, some people say, oh, you only can do this on Mac. No, you can do it on everything now because of this new update that's just dropped today. And the cool thing about this is like any AI can drive this.

So most computer use tools only work with one model, but Hermes doesn't care which AI you bring. So it could be Claude, it could be GPT, it could be Gemini, it could be a free API as long as it's got vision. You can use the one you already have set up or you could use a free API. So you don't need to pay for like Claude or something like that to do this.

And then there's one command to switch it on, which you can see here. So you just use Hermes computer use install and then you can go from there. Other people say, well, I'm not technical. Is this going to be a nightmare to set up?

So it's literally like three commands inside your terminal or inside Hermes directly. It's pretty chill to use. Bear in mind like our actual agent operating system where we've built in Hermes Jarvis, which is kind of like a customized version of this, which, you know, is voice activated and everything else. Like people have joined our AR Profitable Boredom community and got the agent OS set up and set this up within like 30 minutes.

So if they can do it and I'm non-technical and I can do it, then you can do it too. So if you want Hermes computer use wired into a full agent operating system where you have Hermes, you can have a live chat with it here. You can jump inside the studio, generate images, videos, voice. You can have a workspace.

We even got goal mode and all sorts of crazy stuff here. Like for example, we have a loop engine system for agent loops with Hermes. And we also have a memory system here where basically all of our memories are visualized inside the galaxy. Plus you get four coaching calls a week and I do daily tutorials and answer your questions daily as well inside there.

You can get that all inside the AR Profitable Boredom with the agent operating system. Now you might be wondering, okay, what if this tries to do something crazy on my computer as well? You know, what about that? Well, basically it will actually ask before it touches anything.

So handing your computer to an AI sounds pretty scary, but actually isn't because every click or keystroke stops at one, your yes. And you know, anything that might be destructive, for example, like deleting or editing a file, the agent will wait for your approval and then it will act, which is pretty good. So if you look at the old way, you got hours of clicking, repetitive clicking, renaming, copying and pasting. Sometimes you would let a tool grab your mouse, you know, like an AI computer use tool, but it will freeze you out until it's finished.

Core computer use does that, it's quite annoying. And you kind of watch your mouse move around the screen whilst you have to wait for it to finish. And sometimes like computer use is super slow. So it's not that powerful when you're using Chord.

So if you're using, for example, Chord computer use, well, number one, you can't operate your screen at the same time. And number two, it gets a lot of stuff wrong. Whereas with this setup, it actually works as you've seen, and it's super smooth as you've seen today as well. So you can just tell Hermes to task once in plain words, it clicks and types in the background, your mouse never moves, your windows don't jump, and it runs on Mac, Windows, Linux, and any model can drive it, even a free local one as well.

Some people say, well, I tried a computer use tool before and it was useless. Same, most of them are. The thing that made them useless was usually because it just takes over your screen. And also it was super slow.

Whereas as you've seen today, like it works smoothly on all the demos and it's pretty powerful stuff. So some people say, well, let in an AI control, my computer, it sounds a bit crazy, but it asks before it does anything that could be slightly destructive, like deleting a file, that sort of thing. Other people say, well, I'll wait until this stuff is more mature, but honestly, if you're early, you won't move ahead. So you should start learning it right now whilst you've got the headstart on everyone else.

A lot of people say, well, this is only for coders and techies. Actually, no, you can set it up in three words from the terminals I've mentioned before. And also the great thing about this is that I'm non-technical, I've tested it and it works. So if I can do it, anyone can do it.

So what have you learned today? You learned how to stop clicking. You learned how to keep working whilst computer use runs in the background. You learned how to use this even if you're not on a Mac because it works on Windows and Linux.

You stopped being locked into one single model. You stayed in control because it asks before it acts and you stopped having to pay for models because you can just use a free local model, right? And the agent finally has hands and it's working in the background. So if you want to test this out, if you want Hermes computer use actually doing things for you, not just another tool that you test once, you can grab Hermes Jarvis with the agent operating system inside the Air Profit Boarding.

It turns Hermes Clawed OpenClaw into one system with shared memory. So the agent driving your screen already understands you as well. I mean, Hermes Jarvis is pretty powerful. Like we can see everything that was spoken with it about before.

It's got previews of everything that was built. It's got a workspace where we can actually see everything that we've created previously. And we can also jump inside the studio and this is all voice activated and it works in real time, which is crazy stuff. So if you want to get that, it's inside the AI Profit Boarding.

Link in the comments description or go to the AIProfitBoarding.com. Inside the community, you can ask questions, get help and support. If you want the stuff that I've shown you today, that's inside the agent OS system, as you can see. And we update this daily with a new video tutorial, a zip file and everything else.

You also get new updates as things come out, which is super useful as well. And if you're a complete beginner at this stuff, you can go from beginner to expert inside this training in the classroom. You also get four weekly coaching calls. So if you need to jump on a Zoom call, ask questions, share your screen, speak to someone, you can do that on four coaching calls per week.

Inside the map, you can meet people locally in your area who are building with AI agents like you. And we've already got 187 pages of testimonials and wins from people getting awesome results with this stuff. So if you want to join us, link in the comments subscription or just go to the AIProfitBoarding.com. Thanks for watching.

More episodes

Browse all episodes →