Fugu vs Fusion: The Fable 5 Test

versus Fusion, who wins? So we have two different APIs that just got dropped and both of them are claiming that they're beating Fable 5 on the benchmarks. And I'm actually testing them out side by side. If you don't understand what these APIs are, basically Sakana just dropped, it's a new model called Fugo and Fugo Ultra, and that is from Japan.

And then we have another model called OpenRouter Fusion from OpenRouter, obviously. And that is an API you can use in the same way. And what happens is essentially you do one prompt and with Fusion, you have five models or a few models who work together. They will come up with an answer, the judge critiques and analyzes them, and then you get one single answer.

Similar to Sakana, where you ask one thing, you get multiple models to answer, and then that gets synthesized into this setup here and you get one answer. So it's like a panel engine. And these panel APIs both claim to have better performance on benchmarks than Fable 5. Now, obviously you can't access Fable 5.

It's been taken down, it's gone. But you can access OpenRouter Fusion on API and you can get access to Sakana. So how do they perform on the benchmarks? Let's take a look.

So I've been testing it out and bear in mind it's quite limited with Fugo. And also it takes a long time to get a panel of AIs to give you an answer. But if we compare these side by side, we've got Fugo Ultra, we've got Fusion, and we have Fugo Mini, which is the other option. So let's open up, for example, these three websites all creating the same landing page.

And this is Fugo Ultra, pretty nice, looks super nice. I mean, the design is really, really good there. Nice UI, et cetera. If we compare that to Fusion, we've got Fusion's answer.

It's still pretty nice, but I wouldn't say it's quite as nicely designed. And then we have Fugo Mini, which is, it looks pretty cool to be fair. I'd still say it's probably better than the design from OpenRouter and Fusion. So overall, I would say Fugo wins.

Fugo is kind of going to win anyway because it gets two votes, right? Because it's got two models, Fugo Ultra and Fugo Mini, Fusion just has one. Now let's check the next test, which is an Orbit Galaxy test. And there are pros and cons to both, which I'll come on to in a second as well.

So we've got the Raycaster maze test over here. This is Fugo Ultra, looks pretty nice, pretty cool to use. Super smooth when you use it as well, it looks really cool. And then if we test it out versus, we've got Fusion over here, I would say both good outputs.

Marginally, I would say that Fugo wins on that test as well. So Fugo is winning on both tests so far, both the Raycaster and the landing page. Now we have a Galaxy simulation here. So this is the Living Spiral Galaxy test where you can drag the camera, you can zoom in, you can zoom out.

And look how beautiful that looks by the way, like how insane is that? It looks absolutely amazing. You can also double click to recenter, zoom in, zoom out, but it does, that's probably the best Living Spiral Galaxy simulation that I've ever seen, to be honest, from AIs, it's unreal. Now let's compare that to Fusion, which is over here.

It's kind of, it just doesn't feel quite as smooth, if that makes sense. Like look at that and the quality of that compared with the quality of this. This is way more beautiful, way nicer. So Fugo Ultra is winning on three different tests right there.

Now let's have a look at the inner solar system test as well. So this is Fugo Ultra, and then we have OpenRouter here as well. And this is, again, like a big difference in quality. Like Fugo's version here just looks so much nicer.

It's so obvious that it's nicer than this version right here So it's absolutely crushing Fusion on tests. It's beating Fable 5 on benchmarks, but so is Fusion. There are some downsides to this. So, I mean, number one, you'll see, for example, that we haven't generated all of the tests that we normally do.

And the reason for that is because it was actually token limited. Even when I upgraded the plan for Sakana, it's only just dropped today. It's only just dropped a few hours ago. So I will test it more once it's available to test more on the API plan.

But just one thing to note here is like, Fugo is pretty limited in the amount of generations you can do, both by the time that it takes to get generation and then also by how many generations you could do per day. So I hit like a five hour limit pretty quickly, and then obviously I have to wait five hours to use it again. With Fusion, that's not so much an issue because as long as you've got the API, which you can get from Open Router, you can then plug it into something like this. We've actually created kind of like a nice looking chat box where we can ask Fusion any questions.

And then everything we build with this goes directly into our workspace right here. And we actually did the same with Sakana and its API as well. But again, Sakana is a little bit limited. I'm sure they'll improve that in the future because it's just dropped today.

But considering how powerful it is, I also get it as well. So you can see we've got Sakana and the same sort of setup here where we've got the outputs in our side, our workspace, and then we can ask it questions inside the chat as well. And that's the other good thing about both of these. You can get the API and then you can plug it into the agent operating system.

And if Fusion goes down, no problem. You've got a system, not a model problem. And so you can just switch the models and change the APIs depending on what's available and what's not. Also something to note here is the Fugu is actually a lot cheaper on the API to use and it has a flat plan.

So you can subscribe to the plan and then you don't pay per API or token. You just get the flat plan and then you can use it based on that and the tokens that come with it. Now, Fusion actually generates some super nice stuff as well. So this was like a open world simulation that we created, kind of like Skyrim style.

And the graphics are super nice. As you can see, pretty awesome to just scroll through and pretty crazy that you can create this stuff. Bear in mind, whenever you're using like Fugu or whether you're using Fusion as well, they are both one prompt systems. So it's not like, for example, when you go inside Claude and you go back and forth with Claude, you can ask him questions real time.

This is like, you get one shot, you wait five or 10 minutes, sometimes longer with Fugu Ultra, and then you get the answer later. So it's not like you can go back and forth and tweak it. And the issue with that is like you can build something and if it doesn't work properly, like for example, the reply is truncated because it takes up too many tokens, well then you don't get another go at it. And so when you're building, even with, for example, like Opus 4.8, the good thing is even if it's not how you want it to be, well, no problem because you can try again.

Now you might also be saying, okay, how is Fugu Ultra, Fugu Mini, right? How does that perform? So we tested that a lot as well, as you can see right here. It generated some cool stuff.

So you can see, for example, this is kind of like a cyberpunk racer game. Looks pretty nice, quite fun to play, pretty easy to use, et cetera. Created like quite a cool matrix rain as you can see here as well. And we can click the screen and actually like glows up a bit more.

So it generates some interesting stuff and it's a lot faster. Some of the things were a little bit buggy. So you can see, for example, this generation here, I just don't think it's anywhere near as good as Fugu Ultra when I've tested out. So Fugu Mini can create some good stuff but not quite as good as Fugu Ultra.

So if I had to rate them, I would say Fugu Ultra, then Fusion, then Fugu Mini. I mean, here's something that was actually really cool. So this is a liquid in a bowl simulation. We can do like a color burst, we can change the viscosity.

Difficult one to pronounce there, we can clear it. That looks really awesome. Now compare that to, for example, something like the generation that we got back from Opus 4.8. So this is liquid in a bowl from Opus 4.8 and you can see the difference in quality instantly.

That's why it's so good to compare on these visual tests because instantly, you know, okay, right. The outputs from this are absolutely insane and look way, way nicer than something you're gonna get from Opus 4.8. Here's the actual galaxy simulation as well. So you can see like it still looks better than most of the generations we've done with other models, but again, it's not quite at the same level as Fugu Ultra, which absolutely crushed this test and looks way nicer.

So overall, Fugu Ultra beats Fusion. Fusion beats Fugu Mini. All of them can achieve Fable 5 level intelligence on benchmarks. The real issues are that OpenRouter is on an API.

So you have to pay by token. Sakana and Fugu are basically limited in terms of the amount you can use them. And then also, whether you're using either of them, the other disadvantage, and I'm just being honest with you, is that you have to wait five or 10 minutes for it to actually reply to you. But pretty cool stuff and I'll continue to test it as we get more tokens to test.

If you wanna get both of these systems, we've wired them in to the agent operating system already. So you can see Fusion is ready to go here and we have Sakana, Fugu ready to go over here. And this is inside our agent operating system. They basically connect, select Claude, you got Hermes, whatever new models come out, we can use them.

You can see, for example, Hermes Jarvis, which is a voice activated Hermes. We've got a full studio for Hermes over here. We have goal mode so we can run autonomous loops with Hermes and we can also talk to it on a live call. And then for example, we have these loop engines where we can have our agents going round, iteratively quality controlling their own work.

And building 24 seven, the same with paperclip as well. So if you wanna get this whole system, along with my AI automation community that helps you learn, grow and scale with AI automation, you can get that inside the AI Profitable Boardroom. Link in the comments description or go to theaiprofitableboardroom.com. Inside the community, I personally answer these questions every single day and so does everyone else inside the community.

There's always people online, as you can see. Inside the classroom, you get access to all my best trainings, including my new daily updates. And we've already added a full tutorial on Sakana, on how to use loop engineering, how to use fusion and we add new daily updates to the agent operating system so that it improves every single day and gets better and better. So we've actually got a new version that just dropped today, 22nd of June.

And if you wanna get this plus four weekly coaching calls where you can ask questions, get on support, you can DM me or connect with me personally as well. Inside the map, you can meet people in your local area using stuff like Fusion, Sakana and other AI agents plus the agent operating system. And that is all inside the AI Profit Boardroom. Link in the comments description or go to the AIProfitBoardroom.com to get access.

Thanks for watching. Cheers, bye bye.