Claude 3.5 Sonnet vs Sakana Fugu Ultra

Pick Sakana Fugu Ultra if you want the stronger benchmark profile. Claude 3.5 Sonnet only becomes the better choice if you want the cheaper token bill or you would rather avoid the extra latency and token burn of a reasoning model.

Sakana Fugu Ultra is clearly ahead on the provisional aggregate, 100 to 40. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.

Sakana Fugu Ultra's sharpest advantage is in knowledge, where it averages 95.5 against 59.4. The single biggest benchmark swing on the page is GPQA, 59.4% to 95.5%.

Sakana Fugu Ultra is also the more expensive model on tokens at $5.00 input / $30.00 output per 1M tokens, versus $3.00 input / $15.00 output per 1M tokens for Claude 3.5 Sonnet. That is roughly 2.0x on output cost alone. Sakana Fugu Ultra is the reasoning model in the pair, while Claude 3.5 Sonnet is not. That usually helps on harder chain-of-thought-heavy tests, but it can also mean more latency and more token spend in real use. Sakana Fugu Ultra gives you the larger context window at 1M, compared with 200K for Claude 3.5 Sonnet.