The video explains how to expand a single Hermes agent into a coordinated team by plugging Hermes into an Agent Operating System, including voice control via “Hermes Jarvis,” and using Obsidian as a local, markdown-based memory vault. It answers community questions on setting up the Obsidian “Memory Galaxy” view (now built into the latest Agent OS with a markdown setup guide), when to use Hermes’ native Kanban versus Paperclip (more complex dashboards and org charts, especially for orchestrating multiple tools), and whether Hermes profile agents can collaborate via group chat, Telegram, WhatsApp, or within the Agent OS. It also covers migrating notes from OneNote to Obsidian using MCP bridges, organizing multiple clients to avoid data conflation with separate folders and Kanban boards, customizing Agent OS UI toggles, and editing each agent’s soulmd instructions to improve response quality.
00:00 Build a Team of Agents
00:43 Community Q&A Setup
01:08 Obsidian Memory Galaxy
03:34 Hermes Kanban vs Paperclip
05:50 Voice Jarvis Inspiration
07:37 Agents Chat Together
08:52 Move Notes to Obsidian
10:07 Agents in GoHighLevel
10:36 Avoid Client Data Mixups
11:26 Customize Agent OS UI
11:54 Improve Memory Responses
12:56 Wrap Up and Join Boardroom
Full transcript
Today I'm going to show you how to turn one Hermes agent into a whole team. The secret is plugging it into your own agent operating system so that instead of one agent doing one little job at a time you have a crew of them working together day and night whilst you sleep. One can plan, one can build, one can do all the work all on their own. I'll even show you how to talk to them and how to control them out loud like your own personal Jarvis.
So stick with me to the end and I promise you'll walk away knowing exactly how to set this up along with Obsidian and a powerful memory system for your AI agents and the benefits of using something like Paperclip for AI agents versus having your own Kanban board as well. We'll be covering lots of different angles when it comes to Hermes agent and exactly how to use it. Let's get into it. So today we're going to answer some of the most interesting questions about Hermes agent and the agent OS and how to use it etc and what some of the best ways to get out of it and this is based on some community questions we get inside the AI Profitable Boarding because I know if people have these questions then a lot of people who watch these tutorials will have these questions too.
So let's just get straight into it. So the first question is from Jason which is how do I get my Obsidian to look like the memory galaxy inside the mission control? So this is something we actually updated recently and you can see it right here. Basically what this is is a new feature inside the agent OS system where we can basically see a galaxy of our memories plugged in together right and so the stars that shine the brightest are the most recent memories.
Now this is really powerful because you can see visually what your Obsidian looks like from the perspective of your agents. You can click on any of these and actually see the memories and it just kind of interlinks everything together in a beautiful sort of visual way and it just looks cool and fun to look at right. So how do you set this up? So the way that I did it there's two ways.
So there's two ways here. Number one you could ask Claude to just build this memory galaxy for you and give it some ideas but what we've actually done recently is build this inside the agent OS inside the latest version and you can get the latest version here and we update it daily with new updates. Now one thing I'm just gonna double check with the agent that built it. Other instructions inside here for the memory galaxy as well for Obsidian.
Just double checking it gets built out when people install this. So what we actually have here is the full markdown file on how to set it up and we'll add that inside the memory galaxy section as well and so we've added that inside the agent OS. Now for anyone watching you might be wondering okay what memory system do we use here? So we actually use Obsidian.
Obsidian is a free app that you can download and use locally. What it does these are all basically markdown files and folders that organize all of our memories and all the people that we work with all the brands etc. And everything is color-coded and it all revolves around me right and so this is kind of like a universe of memories and ideas and everything that we've done recently. Our AI agents create the markdown files and update them and also read them and then that gets plugged into a memory galaxy like you can see.
I've got a question here which is you have a tutorial to build this agent? Yes number one I did build it with Claude so we've actually got a Claude desktop that builds it in the background and then if you want the full setup it's inside the classroom just go to the agent OS section inside the AI Profit Board. Link in the comments description if you want to get that. So this is a great question as well from David and David by the way I answer these questions really fast like David only asked this 46 minutes ago and he was asking you know paperclip and Hermes Kanban can they be used together?
So if you were using paperclip before Hermes and then Hermes added Kanban but now it's native with Hermes does it make sense to have paperclip and Kanban both assigning tasks? So here's the way that I would look at it. So number one Hermes with Kanban is just designed for Hermes so it's great if you're just coordinating teams of Hermes agents. Now it's not as visual as paperclip and you can't have an org chart like paperclip but if you just have separate profiles working as a team together with Hermes then you only need the Kanban.
So for example here you can see that inside this Kanban board we have one for AI Profit Boardroom SEO we can assign a task it gets triaged and then inside the done list you can see all the stuff that was done by different AI agents different profiles. So for example here you got the SEO writer if we go over here we've got the SEO link builder and so it's a team of Hermes agents working together on a separate Kanban board and then we can assign tasks and those tasks get done across here and so really powerful system. Now I would use paperclip if you prefer to have an organization of agents and also if you prefer like an org chart and a more professional dashboard that's more complex than Hermes Kanban. Also if you have Claude and Hermes and OvenClaude working together being orchestrated then it's better to use paperclip.
So for example if we look at our org chart here you can't build this in Hermes Kanban maybe it'll come one day but I do feel like they probably won't do that because they like to simplify stuff and then you can track everything right how many tokens you've used your dashboard your org chart what's been done what's currently active any sort of issues and what you've actually built with it we've set that up inside the agent OS system so that we can preview and see all the stuff that we've created with it. So I would say paperclip is a lot more complex if you want something complex go with that. This is pretty cool so John was sharing how he was inspired by the group he's basically used Claude to build out some cool games like you can see here we've Claude Fable 5 so it's super inspiring to see you build stuff like this well done John. So this is pretty interesting as well right if you're building out an agent operating system which I recommend you do just to get the most out of your AI agents right you can see here that Ben, Benjamin he created an oracle right like a sort of way of using Tolkien theme inside his agent OS.
So basically what it can do here is it can learn from major philosophical works of numerous philosophers and it links into his obsidian database and then it will continuously learn and store conversations and also it can reply with an 11 laps voice. We've kind of built out something similar with Hermes Jarvis right so if you go over here Hermes Jarvis you can see that we can speak to Hermes Jarvis we can voice command it and we can get stuff done with it. So you know voice assistants I think they become way more powerful and way more useful inside a system like this because you can interact back and forth with them you can navigate them you can organize them exactly what you want right so for example if you look at Benjamin if he really likes using voice agents and he likes philosophy he can merge the two together and I think that's a fantastic way to showcase what you can do on a personal level with a dashboard like this so congrats and also it's amazing to see you linking the power of 11 labs with one of your hobbies right if you're interested in for example philosophy and then you create a voice agent together that's a really really creative way of using it. So I hope this serves as inspiration as well to see what's possible when you're using Hermes agent when you create now agent operating systems and that sort of thing.
So here's another question from David he says can the Hermes profile agents chat with each other and so for example there was a new update recently with Hermes agent where you can have multiple different profiles and you can manage them easily inside your dashboard so you can see an example here so if you go to the profile section we have like a game developer we have Hermes Jarvis we have an SEO keyword agent profile we created one for n2 which the free API that just came out recently so that just gives you an idea of what you can do and how you can use it. So I think what you could do is you could actually add them inside the group chat and you can ask Claude to add them inside the group chat of your agent OS or the other option is that you could add them all inside a telegram group as different profiles and organize them that way. So we have a AI agent mastermind here where we've got Hermes but we could actually decide if we want to add multiple different Hermes profiles inside that chat so they can talk and organize with each other too which is a really cool idea. We've actually got a tutorial on this over here so I'm just going to share that but yeah two different options there so you could have a telegram group chat or a whatsapp group chat between your agents or inside your agent operating system you could have them going back and forth inside a AI agent operating system like that.
This is a great question so if you're using for example Obsidian as a memory vault for your AI agents you can see here that Leon is asking about how to move from OneNote over to Obsidian. So number one is he's got Hermes set up on a VPS but he wants to use the Obsidian vault and question number two is for his personal notes is the best option to sync them up or set them up locally and that sort of thing. So here's how I would do it. Number one for using Obsidian on VPS you can use an MCP so you can actually set up an MCP and link Hermes with that MCP bridge between Obsidian.
There's a lot of them on github that you can use that are open source. For actually exporting your notes from OneNote to Obsidian I would actually ask for example one of your AI agents like Claude or Hermes to take those notes and then plug them into Obsidian and organize them better. That's the way that I would approach it first of all and then for your Obsidian notes is it best to sync it up locally. I prefer to do that so I have them stored locally inside my app and then I go from there and I think that's the best way to do it because if you've got them stored locally then you can always sync them up to another device using the MCP.
This is a great question so Jemayel was asking you know does anyone know how to use AI agents with Go high-level? They will actually have a system inside there which is if anyone's not aware Go high-level is a CRM so you can use the AI agent features inside Go high-level directly to start using them. If you don't want to build them directly inside high-level then you can actually ask Claude with your Go high-level API to start building them out from there. So you got two good options for that.
This is another great question from David so he was asking like you know if you had multiple SEO clients inside Hermes you didn't want to get client data conflated. The way that I would approach that I would organize separate clients into separate folders inside your Obsidian and that way your agents can pull the data for one client inside a separate folder so it doesn't get mixed up with other clients and then you can have a separate Kanban board for each client. So for example we've got a Kanban board for the AI profit boardroom we have one for the game studio and so we can switch between these different Kanban boards here which makes it easier to manage teams. So you can set up separate Kanban boards and then switch between them depending on the team and the agents you want working on each one.
That way you avoid things getting complicated or conflated. This is pretty cool as well so Josio was saying he made a few modifications on his own agent OS based on our setup so what he did to see he took the system that we gave him and then he added a toggle at the end of the left bar for light and dark themes so you can actually switch between them which is pretty nice like you can switch between light and dark mode right there love that idea and then also an option at the bottom where you can just scroll automatically to the top which is another good idea as well. Another question we got was like how to get the most out of memory bases when you've got a second brain so it isn't actually giving bad responses so that really I would say like you want to train your agents to learn how to respond to you properly and organize your notes so one thing that we edit for example inside our Hermes agents is the setup for the files right so for each Hermes agent profile you can actually change the sole MD file and you can do this in open core too so that when you're getting it to respond to you you can edit the sole MD inside your manage section and just make it respond better so for example if it's like you know too biased towards liking your ideas then you can change the sole MD to say like critique or be critical about my ideas so that you don't just listen to everything I do right and that way when you are using AI agents with Obsidian or just in general you can make them a lot more neutral in the way they respond. So that's it we've covered how to use Obsidian, how to customize an agent OS, the best skills you can use, how to set up agent profiles, how to use Hermes Kanban inside agent OS and how to build a great agent operating system that helps you navigate and get the most out of your Hermes agents.
Now if you want the full system for me you can build your own but if you want the full system you can get it inside the AI Profitable Boardroom, link in the comments description or go to the AI Profitable Boardroom.com and if you go to the agent OS system section here you can see that we just updated it today you've got a video tutorial on how to set up a full installation guide and then we have the resources with the zip file to install as well and every single time there's something new and interesting that's actually useful that comes out we create a video tutorial and a step-by-step guide right here. Inside the community you can ask questions to get help and support just like we did today so for example if someone asks a question I'll personally answer it and so will the rest of the community there's always people online you can see for example there's a hundred and two people online right now so there's always people online you can learn from and ask questions with. Inside the classroom you can get all of our best trainings including the agent OS system you also get four weekly coaching calls where you get help and support in real time which is super useful and then there's actually a map where you can meet people in your local city and area who are using AI agents just like you so this is a great place to learn and a great place to connect with people as well and it's just a positive community of people winning learning and growing I mean you can see all the testimonials here we have over a hundred and pages of testimonials and people winning with AI automation so I know if like everyone inside here is getting amazing results you can too even if you've never used AI so don't let anything stop you it's awesome to use this stuff and it's a great time to be building with it as well bear in mind like we're all super early to this as well which is you know it's a great time to move so hope to see you inside there and I'll see you on the next one cheers Baba
More episodes