I Built A Real JARVIS With Claude

So we have built out an agent operating system with Hermes it is crazy powerful and we have for example this real-time version of Hermes Jarvis where we can chat with it, we can put it in war mode, it's voice activated, it works in real time, we can speak to it and also has previews down here. Now we also for example have Hermes Oracle. Hermes Oracle basically can consult the web, find the latest news information each day, link to the actual Twitter post that it's related to, draft content and find me an idea for that content as well. And then on top of that of course we have Claude built in, we have Hermes built in, we have a memory galaxy where we have all of our memories connected inside one powerful context system as a second brain and we can basically build and automate anything to the point where for example we've got a video agent right there that can generate AI avatar videos on the spot, edit them, script them, research them, write them and create beautiful b-roll for them in one single prompt.

That is a game that we are playing right now of the agent operating system. It's mind-blowing stuff and this is all inside the airport for boarding but what I want to do today is answer some of the latest questions I've had recently about all these systems that I can help you as much as I can because I know like if people here have questions like this you probably have questions as well so let's just get straight into it and start answering all of the latest questions that we've had about the agent operating system, how we build it, how we use it etc. So the first question we have here is are you running this all locally on your computer and giving full access to your computer or is it a VPS that you run the agent operating system on that you can just access from a local host dashboard? Pretty impressive stuff.

Well number one thank you Jimmy for that. Number two when it comes to the setup I run it locally I like to have it sandboxed just on a max studio so that you know I don't think it's very good to have that connected to the whole internet and I think that you know if you look at all the problems that OpenClaw had all of OpenClaw's problems came from people on VPS's because like people are actively scraping VPS's and you know sometimes getting login details and stuff like that so you need to be super careful about how you connect this stuff. So I have it running locally I don't use a VPS you can use a VPS there's actually a training inside the airport for boarding on how to use a VPS if you prefer that but for me personally yes just run it locally. Having said that the models that we run with this are mostly APIs and CLIs and OAuths so for example we look at Hermes Oracle that is set up with grok OAuth on Hermes if we look for example at Hermes Jarvis that is basically 11 no sorry chat GPT real-time API and it's plugged into the Hermes agent that we have running and so I've run all the models with cloud models mostly I just don't think local is that good unless you've got an RTX or something like that another question we've got here where do you host all of this stuff inside the agent OS right so you know when we're looking for example at the agent OS where do you host it well I have a local setup for hosting then we use cloud files and then for actually storing database which I know you've asked about here blank could name for storing the database we have they're all stored locally so we have an obsidian vault there are a agent I've never touched any of this never edited my agents just run this and organize it automatically for me so it looks beautiful and then it's plugged in here and if you actually have a look at our obsidian database this is a free app you can run locally you can install it into your agent operating system that means your agents have context on you and they can also update the obsidian vault every time you use it so for example if we look at the vault here these are our latest memories you can see for example me and Hermes Jarvis speaking this is a full transcript from the conversation between me and Hermes Jarvis and so when you're building this out the whole database here is stored with obsidian and I store it locally but we have a login so that we can log into our account from anywhere as obsidian and then restore the details so we've answered Jimmy and we've answered blank let's have a look at the next one 25 gigabyte dual rtx 590 yeah or 9090 well yeah see you could run that with local models that's probably the best way to get the most out of local models from what I've seen with members inside their platform like the guys who are creating like for example avatar videos and ai avatar videos and ai images locally they're running rtx 5090s minimum so yeah if you have that set up you can run local models but you I don't run local models I have a Mac studio I use free apis use or use CLI stuff already got you know running in the background that I've already paid for so for example like Claude it's just plugged in here with CLI like you don't need to use api or anything like that it's pretty cool what else we got here rav I'll be following along I am hopefully building a space weather for heliobiology news plate service starting from social media posts and turning into mind-blowing published articles and magazines for live updates and I think I might just use Hermes to give me the tools to start making it easier to build it that's pretty cool that sounds like an interesting project now one thing that we do is we actually have Hermes posting content for us inside the agent operating system so if you go over here to the seo tab you can see that we can research from our existing google search console so I know you're talking about using a website and building automatic social media posts as well as websites so we can basically generate content in one click with a keyword in your case study and what that would do is deploy it to our website so if we look at the history of deployment here we created this article and five others to five different websites automatically with one keyword and one case study beautifully formatted I can't log into this website but this whole website is fully automated with ai right and so it's unique to me it's not like spammer and flyer it's actually got useful case studies and it's actually interesting but the point to note is like yes you can do that and it's the same with for example social media content so we have a video generator over there that we can use to generate that and we also have Hermes Oracle where you can look at the latest news as you can see right here we can open it up and then we can actually quote the news and create some content around it so you can see here it says draft this and we can look at the latest news quote that content create social media content around it automatically in one button and then we don't need to find what's trending we don't need to find new topic ideas we don't even need to think about what type of content we're going to create it's all automated inside this beautiful system with Hermes Oracle so that's pretty cool as well now this is an interesting one so control alt pete says i think i am at ai development level five which i'm not even sure what that is to be honest with you like i mean i think we're all just learning this technology is so new that nobody fully truly understands the power of it and i say that somebody's built like incredible systems around it like you can see with Hermes Oracle right here and and the whole agent operating system i'm not a coder and even coders that i know personally feel like they're behind with ai so like if you feel like oh you know getting a value out of something like the agent operating system is too technical for you i would say that you are missing out because you know the sooner you start cracking into this the sooner you'll start learning it everyone learns from beginner because it's so new there's no courses on this there's no i mean it's my course but but i mean like what i mean is like there's no courses at university there's no formal education for this everyone's learning together this is brand new everything changes day to day all right and so you don't need to be at a certain level and i'll give you an example of this i'll give you several examples of this so if we look at some testimonials from the ai profit boarding here of people who have set up our agent operating system and we've got 187 pages to this stuff right rick just joined the school and he set it up within 30 minutes i'm not technical i create the whole thing and you can see for example jose set it up in one single day like less than a day loads of people are creating these ai agent operating systems and dashboards and they've never used ai or never been technical before so my point is that if you can click a few buttons and if you can use claude that's all you need and you'll learn from there and we all learn and we grow from the same point because this is so new no no other generation in human history has ever had access to this sort of technology right and so this is brand new to us all and we can all learn we don't need to be technical it just just take one step at a time enjoy it enjoy the journey you're early this is interesting opus 4.8 front end design and good prompting blows fugu from sakana ai slot website away i don't sometimes i see these comments and i'm like i can't number one i don't understand them but number two it's like i don't look at which model is the best or which model you should be using i look at what is the best system based on what comes out so for example sakana and fugu just got dropped yesterday fantastic ai created some absolutely insane stuff we already tested it on um goldie bench and the benchmarks are insane for this stuff right and if we show you some examples of what we built with sakana inside our workspace here some of the stuff that we created here is just absolutely outrageous um it's really really interesting powerful stuff like this was just something we created yesterday for fun you see another example right here um and it it's absolutely wild now i don't care like which models are best i don't really you know care what comes out and what comes in what i care about is like how do i automate my work and get the best possible output so that's the way that i look at it it's like i wouldn't even care about the models i'd care about the systems you build and that's why we built the agent os system to get the most out of stuff like this and you know i think for anyone watching if you're wondering okay like should you be using sakana fugu or should you be using fusion or should you be using glm 5.2 or should you just wait until fable 5 comes out i would say don't worry about any of that build the system to automate your work just do that and focus on that every week that's what we did with the video automation here is what we did with the music section the loop engineering the seo section here the thumbnail generator notebook lamb that can generate podcasts and infographics in one single click everything that we've built here including the memory is set up to be a new system that makes all the tools i use all the models and whatever comes out tomorrow and whatever gets taken down tomorrow whatever happens we are anti fragile and we can bend and be flexible to whatever comes out next and i think that's the best way to look at it it's like don't even worry about the models focus on the systems and i've always thought about that like even for example when i'm hiring people it's like to be honest i try and make my system so simple in my business my agency in the airport for boarding but it doesn't matter who the people are that are operating it we mcdonald's it to the point that anyone can operate it anyone can get the most out of this stuff and i think that's the best way that i've seen to really win with this stuff and just final one mark phillips says thank you for the real julian i'm not sure but i no longer watch the ai ones even though they're probably good we don't know i don't think that's weird i think like if you just like human content that is totally fine and you know some people see my other channel and they see the ai content that we generate and some people love it some people hate it but that's why we have this daily human only channel right here so that you get daily tutorials from me i try and connect with you as much as i can i do create human videos daily and you know whether it's ai whether it's human whatever you prefer no judgment but i'm always going to be here and i'm always going to be creating human content as well um it's not just like because we can automate everything we do i think there's there's value in creating human content as well because you can connect with people in a way you probably can't with ai content right and there's still that authenticity that people crave so that is it for me now if you want to get the whole system i've answered all the comments from yesterday i'll keep doing videos like this if it does well if it doesn't do well then i'll just be like you know maybe maybe we stop because people don't want to see that type of content if you want to get my agent operating system you get that inside the ai profit boardroom it comes ready made straight out the box you can get it from this section right here inside the new daily updates so you get a video tutorial you can see the last update date you can get a zip file for installing it and then we have daily new tutorials to help you get the most out of this stuff so whatever drops so for example like we created a new hermes email agent today we got a full tutorial on how to set up we looked at sakana versus fable 5 versus fusion these are brand new technologies that are basically alternatives to fable 5 and we've already tested it out put it on goldie bench and create a full video tutorial i answer the questions inside the community personally every single day with video tutorial and you can also get help from the communities always people online inside the calendar in jumbo week coaching calls inside the ai profit boardroom map you can actually connect with people locally near you who are building awesome stuff like you've seen today and i hope to connect with you inside the air profitable see you on the next one cheers bye bye