The video compares Grok 4.5 and Claude Opus 4.8 side by side using Goldiebench, emphasizing real-world performance over benchmarks across multiple game and creative tasks. Grok 4.5 generally produces more playable, smooth 3D games and wins many rounds where Opus 4.8 fails to generate or is too buggy, though Opus performs better in some cases like a driving game, an edited Remotion video, and a flight simulator, and also wins a few specific games. The creator notes Grok can be slow and less agentic in chat and wouldn’t use it for agent workflows unless generating images/videos, while preferring Opus 4.8 for building systems, workflows, and an Agent OS. The video ends by promoting the AI Profit Boardroom for access to Agent OS, agents, tutorials, and community support.
00:00 Grok vs Opus Setup
00:38 Why Real Tests Matter
00:57 Crypt Game Showdown
01:34 Dragon Realm Faceoff
02:15 Racing and Skyrim Tests
03:41 Twilight and VoxelCraft
04:43 Runner and Driving Results
05:26 Video Edit and Flight Sims
06:36 Agentic Use in Hermes
07:04 More Games and Scoreboard
09:24 Final Verdict and Picks
10:39 Boardroom Offer and Outro
Full transcript
So we've been testing out Grok 4.5 versus Opus 4.8. I want to show you what we've seen today and how it performs and whether Grok 4.5 actually beats Claude Opus 4.8. I've actually been very impressed by Grok 4.5 so far. It's performing very well.
It's created some really interesting things. So let's see how it performs side by side. We've actually got the Compare section over here. We can compare both of them.
We've tested 48 different models side by side and tasks. So let's see how they perform. We've got Grok 4.5 on the left-hand side, Opus 4.8 on the right-hand side. On the benchmarks, it actually looks like Grok 4.5 is on a similar level.
But what does it look like in reality? Because I don't like to pay too much attention to benchmarks. I think we've all been in the situation where things don't feel or look the same as the benchmarks that we see, and that's why I actually created GoldieBench. So first thing that we're going to test is the Crypt game.
So this is Grok 4.5, as you can see. Pretty nice, easy to play, nice graphics, 3D. Works smoothly. Gameplay is good.
And it's created like this kind of maze game. As you can see, it's fun and interesting to play. Now, if we actually have a look at the version from Opus 4.8, it didn't generate. It totally failed at the task.
It created the entry page here. But nothing else. So, so far, Grok 4.8 won. Grok 4.5, sorry.
It gets confusing between the numbers, to be honest with you. Next up, we have Dragon Realm. So I'm going to play these side by side. This is Grok 4.5.
Not too bad, pretty smooth to play. Looks quite nice. And then let's compare this versus Opus 4.8. Now, one of the things that I've noticed straight away with Opus 4.8 is that the controls are kind of reversed.
But I would actually say like the 3D landscape is probably better with Opus 4.8. So I'm going to put that as a tie because the controls are easier with Grok 4.5. Opus 4.8 wins on the gameplay. So it's a tie on that one.
So, so far, Grok 4.5 has won one and Claude hasn't won any. Next up, we have the racing game. So this is Grok 4.5 and this is Opus 4.8. Opus 4.8 totally failed on the racing games.
You can see it's like super buggy. Let's compare it versus Grok 4.5. Pretty nice, smooth, fun to play, difficult to play, but it's actually like a playable and useful game. You know, the graphics are even nice as well.
So that's pretty cool. So two to Opus 4.5, two to Grok 4.5 and zero to Opus 4.8. Let's compare the next one, which is the Skyrim style game. So I think we're gonna have to go full screen to play this properly.
There we go. It's smooth, it's fun. The graphics are a little bit basic, but overall it's pretty smooth and fun to play. Actually playable, actually useful.
Very open world, like it seems like a massive game when you actually walk around in it. Now, if we compare that to Opus 4.8, I would say the graphics have more detail just on a slightly better level, but there's nothing really going on here, right? There's no, for example, enemies, there's no characters. It's just you first person walking around.
So there's not that much interesting stuff going on. So yeah, I would say the Grok 4.5 won. And by the way, like, don't listen to me. Don't trust anyone else.
Just test this stuff out yourself. And if you want to see what I've built, you can check out GoldieBench, but I always think it's better to check this stuff out yourself, see what you think, go from there. Now this is Twilight Vale with Grok 4.5. Camera angle is a little bit hard to control.
It does feel like a little bit small, but maybe that's just because we need to walk around more. Let's compare that versus Opus 4.8. Opus 4.8 doesn't get past the beginner's page here. So you can see we're clicking to begin, but it doesn't work.
So four to Grok 4.5 and zero to Opus 4.8. Now let's have a look at VoxelCraft. So this is kind of like a Minecraft style games. You can see we can walk around, we can build stuff.
It actually has a functionality to build as you can see right here. And then we can select the blocks that we want as well. So we can switch between them, which is nice and useful too. I think it's a little bit buggy over here.
Oh, we've got all these crazy characters running after us now. Difficult, difficult. All right, that was pretty nice. Let's have a look at Opus 4.8.
Pretty bad, pretty bad. This is super basic. So five to Grok 4.5 and zero to Opus 4.8 so far. Now we've got this one here as well, which is like a virtual runner.
It doesn't work on Opus 4.8 as you can see here. And it doesn't work really on Grok 4.5. I wouldn't say either of them actually create anything decent here. This is super laggy and buggy and you just can't play it.
This one, you can't play at all either. So I would say they drew on that one too. Then we have the driving game. So this is Grok 4.5.
It's a bit buggy in places. For example, like we can't drive through there sometimes. And then there's not much detail. You see how it's just buggy, it's like driving into nothing.
Whereas for example, if we look at the Opus 4.8 version here, it's pretty nice. It's a little bit laggy in gameplay, but overall pretty nice. So I would say that Claude won that one. Then we have the edited video, right?
So this is the video generated using ReMotion and this is Opus 4.8 versus Grok 4.5. I would say Opus 4.8 won by a long way here. It just looks nicer, smoother, it's more interesting, it's faster, it keeps your attention more and the colors look nicer too. So if I had to pick between them, I'm gonna go with this one.
Then we have the parachute game. So this is Grok 4.5. Opus 4.8 didn't work at all on this one, as you can see. Grok 4.5 works a little bit.
I don't really like the detail. I wouldn't play this at all, but if you want to use it, you can. And you can see like it actually does count down the altitude and everything else, which is pretty nice. Next up, we have the flight simulator.
Now, this one I actually found really difficult to play. Like you see how it's just a bit buggy, you can't really move forward or backwards right here. Like it doesn't make any sense. Let's have a look at the Opus 4.8 version.
I would say that's a lot nicer. Yeah, a lot more interesting, cool colors, bit buggy in places, but at least you can actually play it and do something interesting with it. So it looks like Claude is making a comeback here. One thing that I did actually personally test as well is using Grok 4.5 inside Hermes Agent.
If you're using it directly in the chat, it is very, very slow from what I saw. It can take like 10 seconds just to reply on a basic chat message. And then it doesn't feel very agentic is what I'm saying. So I probably wouldn't use it with Hermes unless you're, for example, using it for generating video or images and that sort of thing, then Hermes is pretty useful with it.
So we have Opus 4.8 with the neon arcade game over here. And then we have over here Grok 4.5, which is like a 3D fun game to use, looks super nice, nice UI, et cetera, more interesting. I would say again, Grok won that round. So it's currently seven to three.
Grok is crushing it so far. Let's see what we get next. So we've got another flying game. It's pretty nice.
I'm not really sure how to use this or play this properly, to be honest with you. It's not very obvious to me, but actually, no, you kind of get the hang of it. It's all right, not bad at all. Let's have a look at the version from Opus 4.8.
See, like there's not much going on here in terms of Opus 4.8. Like there's no characters. There's nothing going on. There's nothing flying towards me.
This one has a lot more interesting and entertaining elements. Then we have Dragon Flight. It's super hard to control this. I don't really know what it's supposed to be doing.
It's just like flying back and forth. It's a bit confusing. If we have a look at the Opus 4.8 one, I would say it's a lot more linear, but it actually works and it's kind of interesting. More fun to play.
Yeah, I would say Opus 4.8 won that one. So it's now four to eight. This one for sure, like Grok 4.5 just generates 3D things by default. If we compare that versus Opus 4.8, nowhere near the same, right?
Nowhere near as interesting. So this is some other stuff it's created. Let's have a look what we got next. Next up we have OutRun.
So this is Grok 4.5. Again, really cool, really fun to use. This is Opus 4.8. Pretty buggy, not that great.
And then we have the Pool game. The angle of this is really weird. This game, if you look, it's pretty hard to play that. Let's have a look at the version from Opus 4.8.
It's a bit more 2D, but it's easier to use, easier to control. So I'm going to go with Opus 4.8 for that. Then we have this Maze style game. Pretty cool on Grok build.
Sorry, Grok 4.5. Looks pretty nice. Yeah, actually works. Fun 3D game, it's cool.
Let's try out now Opus 4.8. It's not bad, but you can't control it in the same way. The camera angle is really difficult to control as well. So, I mean, overall, on the actual builds that we've tested, I would go with Grok 4.5.
However, what I will say here is just in general, when I've tested them both out, like if I was, for example, building out an agent operating system, I would still go with Claude Opus 4.8. And maybe that's just me being biased. Maybe that's my brain trained to using something like Claude, but I honestly prefer to use Claude for building stuff like this out. So actually for building systems, for building workflows, you know, for work-related stuff, then I would go with Claude Opus 4.8.
For agentic stuff, you don't really get a choice because, for example, if you're using Hermes Agent, you can't plug OAuth with Claude anymore into Hermes Agent. And then when it comes to like building out fun projects, like we were talking about before, you know, the games that we created, Grok 4.5 is very, very good, like holds its own. So what I'd recommend for you is that you test out. I probably wouldn't use Grok 4.5 for agentic stuff unless you're using the images and videos.
And when it comes to Claude, Claude is still really powerful for using inside Claude desktop and building stuff. So everything that you're seeing inside the AgentOS, we built with Claude, and it's a really powerful system that we literally built from zero. So thanks so much for watching. If you want to get a full AgentOS with Grok and all the Claude systems that we've put in there, for example, like the Video Agent, the SEO Agent, the Grok 4.5 Hermes Oracle system that we've got inside here, you can get it all inside the AR Profitable Room.
Link in the comments description or just go to thearprofitableroom.com. Inside the community, you can ask questions, get help and support in real time. I personally answer all the questions inside there. Inside the calendar, you can jump on weekly coaching calls and share your screen, meet other members.
Inside the classroom, you can get access to all of our best trainings and you can get the new daily updates with the AgentOS system. You see when it was last updated, the video tutorial and a full step-by-step guide and a zip file to install it. And then we have new daily tutorials like you can see right here, based on what's actually working. Inside the map, you can meet people in your local area who are building with agents like you.
You can get that all inside the AI Profitable Room. Link in the comments description or just go to thearprofitableroom.com.
More episodes