AI News Today
← All episodes
Episode 23 · June 6, 2026 · 07:16

NEW Hermes Jarvis is INSANE!

Hermes Jarvis: Voice-Control Your AI Agent to Run Your Computer & Automate Work

The script introduces “Hermes Jarvis,” a voice interface that connects a microphone to the Hermes AI agent so spoken commands can trigger real actions on a computer, not just conversation. The narrator demonstrates voice-controlling apps by asking it to create a new note with automation ideas, and scheduling a daily 3:00 PM cron job to research AI automation news and save results to logs and dated JSON files. They explain how it differs from typical voice assistants by being a “doer” that can use tools like web search, file read/write, browser and screen control (opt-in with permissions), and can speak results back aloud. The system uses Minimax M3 voice commands and an NVIDIA Nemotron model, and is available via an Agent OS setup or buildable directly with the right APIs.

00:00 Voice Controlled AI Demo
01:36 Scheduling Tasks by Voice
02:26 Why Most Voice AI Fails
02:48 Goldie Jarvis Mode Explained
03:49 Build Apps Hands Free
04:02 Safety Setup and Models
05:31 Recap and Agent OS Tour
06:25 Get the Full Setup
07:14 Final Thanks

Full transcript

Hermes Jarvis is absolutely insane. So this is a way that I can control my AI agent with my voice to, for example, control my laptop or to control browser use. Let me show you an example right here. So if we just speak to it, like, so, Hey, can you type in a new note inside my notes and just give me a list of automations I could create so you can see it's creating a new note now, and now it's actually written the notes inside the project as well.

So we've got all the notes created inside the app. I've created a new note in your notes app with a comprehensive list of automation ideas across nine categories, content, social, video, audio, SEO, business, AI, dev, productivity, smart home, plus tools to build with. The note is saved and ready to use. So you get the point.

You can speak to your AI agent. Now it can control your computer. You can get it to do whatever you want, basically fully automated, and you don't even need to type to it anymore. You can just voice activate it.

And from there, it can actually go off and do things. And this is what I call Hermes Jarvis. And this basically connects your voice to your AI agent. And then what it would do afterwards is read it out loud.

And we've built this into our agent operating system. So you've probably seen, you know, voice AI systems to just chat back, but this is different because Hermes Jarvis has actually wired a microphone to the real Hermes agent, the one that can actually do stuff. So you speak a job out loud, for example, like, I don't know, research my top competitors, write me a brief, build me a landing page, find the top three AI news stories, it goes and does the actual work, then it talks the results back to you. And today I'm going to show you how it works.

Let me show you another example here. Schedule researching the latest AI automation news daily at 3 PM. I've created a daily cron job that runs at 3 PM to research the latest AI automation news. The script saves results to AI automation news, daily, research, log, and individual JSON files by date.

So you can see how it works. You can basically schedule tasks. You can get it to use your computer. You could get it to use browser, use whatever you want, use this AI agent.

It's super powerful. Also just a lot of fun to play with. Now, the difference here is that normally a chat would just add to you. If you were just like, for example, going back and forth with chat chibity inside the voice assistant, it can't really go off and do things for you.

Right? Jarvis with Hermes agent is really the moment where agents and voice come together and you speak and the work gets done now, most AI voice only talks. So here's the gap nobody talks about. So voice assistants, you know, can answer questions, but they can't actually do anything.

You can ask one to like be on your page or go research this, et cetera. And it just describes how you might do it. You still have to do the work. This is an AI that can actually go off and do stuff for you.

And it's an assistant wired to the agent with hands, right? So we've basically got this tab here with multiple different voice options. So you can see, we can switch between these agents. This is actually using the voice commands from minimax M3, and then these are plugged straight into our actual Hermes agent, the one with all the tools, which means whatever Hermes can do, you can now trigger with your voice.

So that could be like searching the web, reading and writing files, building work in pages and apps, running it skills. And so I call this Goldie Jarvis mode, which is you say it, you do it, you hear it. So the whole thing is three simple moves. You can tap the mic and speak what job you want done in plain English, just like talking to a capable assistant.

No special wording. You don't need to type or anything. It's going to go to work and start researching or building or writing files, even using a browser if you want to. So it's a, it's a natural doer, not a describer and then hear it.

So once it's done, it actually talks the result back to you in a natural voice. So you can keep your eyes and hands on something else, right? And so you could ask something out loud, go take a walk, come back to the finished file. Right?

For example, we could say, build out a to-do list app that's just simple HTML and then open it up for me. And so that'll just go out. You can see here that we've given it the voice command and then it'll just go to work in the background. Now, the honest part here is that you just got to use it wisely, wisely, because you know, it can do real things.

So you want to treat it like a keen new assistant, literally takes you literally. Okay. So it acts on what you say, screen control and that sort of thing. It's opt-in here.

And also it's not going to be like instant. So you can see, for example, here, we've said, go out and build a to-do list app. It might take a couple of minutes to just code that out for us, but it's working in the background whilst we go off and do something else, which is pretty cool as well. So if you want Hermes set up and ready to go, we've got it inside the agent OS.

Otherwise you can actually just build this with Hermes directly. You just have to make sure you have the right API set up and everything else. We've set up, for example, minimax M3 with Hermes agent, and that's how this whole thing is running together. And then on the actual model of Hermes, we've actually used something called Nemetron that just came out today.

And so, you know, some people want to say voice AI is a gimmick. It just answers trivia, but this one is actually wired to real agents. So you can research, you can build, you can save files from a spoken sentence, and it actually does work. A lot of people say, well, talking to AI is slower than doing it myself.

The thing is you can speak a sentence and then walk away, right? So you can do all the multi-step work or the research or the scheduled tasks in the background whilst you're doing something else. Other people say, well, an AI that controls my computer sounds scary. So for example, like computer use or anything like that is opt-in.

So usually when you're using Hermes agent to do stuff like this, you actually ask you for permissions first before you approve it, and that's basically it. So just to recap there, Hermes, Jarvis, most voice AI only talks. Hermes Jarvis actually wires your voice to the real Hermes agent. Pretty powerful stuff.

Spoken command can just go off and do things. So this is working on that in the background. And by the way, there's so much more you can do with Hermes as well. So for example, we've actually got a live chat with it as well, where we can actually just have a live conversation and go back and forth.

We have the Jarvis section here. We also have this studio where we can generate images and videos and voice. And we have the sessions where we can manage everything and see the status. You can see here we've got Nvidia Nemetron 3 Ultra plugged in.

We've got the goal mode section set up. We've got all of this different stuff that we've created and we can just come back to our workspace, see what we've built, et cetera, and you can plug in MCPs. So, I mean, Hermes is by far the most powerful AI agent I've ever used. Super fun, lots of cool stuff that it does.

And you can easily set something up like this. If you want the full setup for me, you can get it inside the AI Profitable Audium, link in the description or go to the AI Profitable Audium.com. Inside the community, you can ask questions, get help and support in real time. I actually personally answer these questions as well.

So you can personally connect with me too. Inside the classroom, you get access to all of my new training. So you can see that we had new daily updates here and you can get the agent operating system. We actually do daily updates on this.

So you can see we just updated it today. You get a video tutorial, a 30 day roadmap on how to implement it. Plus we've got the zip file right here if you just want to go off and install it. Plus we have loads of different trainings on Hermes agent and AI agents in general.

Inside the calendar, you can get weekly coaching calls. You can drop a life coaching calls, get help and support in real time. And inside the map, you can meet people in your local area who are using AI agents just like you. So feel free to get that link in the description or go to the AI Profitable Audium.com.

Thanks for watching.

More episodes

Browse all episodes →