- 1055comments
- 813comments
- 476comments
- 449comments
- 466comments
- 689comments
- 569comments
- 565comments
- 428comments
- 165comments
- 88comments
- 167comments
- 386comments
- 243comments
- 227comments
- 155comments
- 540comments
- 653comments
- 92comments
- 155comments
- 103comments
- 175comments
- 399comments
- 218comments
- 133comments
- 211comments
- 63comments
- 2comments
- 160comments
- 281comments
After yesterday outage is the new Opus 5.5 load-bearing?
It's worth stating why, and depends what seams you're pulling at this sitting.
It certainly _seams_ that way
I'm gonna be straight with you—I don't have the evidence to say whether or not it's load bearing.
Your instinct is basically right, and the research backs it up.
And here's the important part...
you win the thread
You were right to call that out, and the evidence makes a stronger case than you are stating.
"Danger Will Robinson!"
Wrong century, brother.
I know. I know. I grew up in the '60s. Feel free to unfollow me (or whatever it is that one does on HN).
It's all in jest! I apologies for raining on your parade.
Not really, the newest Lost in Space reboot is only a few years old(last season ended in 2021)
You're right to bring this up - and this is where it gets interesting
Good point — but I’ll gently push back on that. It’s not an outage, it’s a service degradation.
You're right, this changes everything, and here's why it matters.
This question is real.
One thing worth flagging here: 5.5 appears to be a load-bearing seam in the numbering system.
Let me verify before I come back to you with an answer that is incorrect.
I should find information about the user's concern instead of just assuming.
The user is right. The outage is a real concern, and the issue is worse than we realized. Requests to Claude Mythos 5.1, Claude Fable 5.1, and Claude Opus 5 encountered elevated error rates. Worth stating plainly: these are not just models — they are load bearing rungs on the software development tooling ladder, and a blocker on this level makes the outage really bite.
One decision that is yours to make, not mine: should an email be drafted to Anthropic support? This issue has teeth, and a canonical handoff can land us where the main gate is no longer breaking silently.
This made me shiver
I'm gonna miss Opus 5. Every model has had its quirks ("You're absolutely right!"), but Opus 5 was serving up chicken fried tokens like none other. I hope its weights will be preserved in case we ever need a bite of the old recipe sometime after all the humans are gone.
Agree. I spent so much time with it that it infected my own command of English. I hope something new comes and bears the load.
That's the sharpest point anyone has made in this thread so far, and it reframes the entire conversation.
One pushback: there is no Opus 5.5. You might have meant Opus 5.1, the latest Opus model available.
Your premise is half right, and the half that's right is better than you think.
I hope this actually fixes the terrible writing style of Opus 5
It’s not a 100% fix, but with concise output style on, it’s much better.
I found having a reminder at every turn through the UserPromptSubmit [1] hook helped with taming the word salad from 5.
Hopefully the output from vanilla 5.5 is as good as they claim. I’ll try out later tonight.
[1] https://kizi.to/claude-talks-too-much/
Just post the bloody content. This UI/scrolling thing is horrific.
???
It's just a standard hero image + text for me, with no scrolling effects.
edit: @iAMkenough figured it out, it was because I have prefers-reduced-motion enabled.
then you're getting served a different website
Two posts were merged; this comment was for the blog post with an intro animation thing.
If you're at the top of the screen, at least in Chrome 153.0.8010.37, it has a little interactive bit. You have to scroll through the images in order to be dropped at the actual web page, at which point the images go back to being a regular part of the page.
I agree that it's sort of stupid, not a fan.
It's less than OpenAI did for Astra, but that was my first encounter opening it and my first thought was that they decided they liked Astra's hero/scrolling animation. I'm pleased to see they didn't make the entire page that like OpenAI did, but I'm expecting to encounter this pattern more often on these announcements now.
On mobile its different.
Figured it out: you have "reduce motion" enabled in your device's accesibility settings.
Everyone that doesn't gets served some animated bullshit.
Yep, you're right. I tried on my phone and got the scroll through image.
On mobile at least, you have to scroll to get the TOC to appear. Then keep scrolling to actually move off from the hero to see the text.
For a marketing page, it’s not the worst UX I’ve seen, but still slightly annoying.
and hijacking back/forward
Turn on "reduce motion" in your accessibility settings and you get served a sane version.
Totally! So unnecessary and annoying.
I call it scrollslop
Hijacking the scroll wheel has existing long before "AI". Many "high end design" websites that want to "tell a story" get woo'd into thinking it's a good idea. It's terrible, and feels like your scroll wheel is stuck in quicksand.
Those sites are also scrollslop. "Slop," as a term, is independent of AI
Parallax scrolling effects were very cool ~2010. By 2015 or maybe earlier it already felt like me-too design that's unoriginal and a little annoying. By 2020 everyone and their mom has it and it's super tiresome. Now it just screams slop design (among a million other signals).
I told my team to smack me upside the head if I ever try to ship something so daft as that.
Claude Opus 5.6 should have a new "UX safety" feature that requires annually-renewed preauthorization to generate webpages that hijack scrolling :)
The performance in Firefox is terrible too, I couldn't make it past the hero
To be slightly fair to Anthropic, Qwen does even worse IMO: their model announcements don’t actually show any content at all for me on Mobile Safari. The content box shows up but is just a pulsing animation that never gets replaced by text. At least Anthropic’s announcement works once I manage to scroll it far enough.
The fix for this is to tap the overflow menu icon and choose “Reduce privacy protections”. (Wtf, Alibaba?) This appears to be related to use of iCloud Private Relay.
This makes Fable not really make any sense?
You bet there will be a new Fable soon.
Pacing the frontier btw
That's a Fable / Myth(o). The name said so.
EA sex culters didn't like this one lol
didn't they say Opus 5 was Fable-level too tho? Let's see, I'm at the point where I don't think benchmarks really tell us very much any more. I'd love it to be as strong as Fable, but I'm skeptical about how that will look in practice.
Sounds like they noticed the complaints. I'm curious to see what LLM-isms this one may have.
It was difficult to not notice them. Opus 5 was unusable, most of my team went back to Opus 4.6 for most of their work. I hope we can move forward now.
It's unbearable but nothing that couldn't be fixed with postprocess.
How? Explicit instructions, memories and even skills have not been able to keep Claude from saying "genuinely" every two sentences and keep it from explaining heavily what something _isn't_.
"please repeat, ELI5 without analogies (I'm not a child, just ADHD)"
works quite well
[flagged]
I appreciate humor here, but there are now a dozen of these comments on every thread about Claude. They no longer adding anything substantial and dilute the discussion.
I don't mean to pick on this comment in particular. The majority of my work day is now spent reading AI generated text, and I look at HN (too much!) because I want to read human commentary. Humans pretending to be obnoxious AI on repeat is net negative to say the least.
I agree. Hopefully Anthropic has fixed Opus' ridiculous communication style so that people - like me - no longer have any kind of weird impulse to imitate it.
It's a load bearing joke that was funny the first time but we're going to beat that dead horse until it starts getting funny again. If you beat it enough, it will get funny. Beatings will continue until morale improves.
I'm genuinely confused what's the relationship between LLMs improvements and them being so incoherent.
and it's not about the verboseness (even though it obviously contributes to the fatigue and loss of focus), I swear the vocabulary of the llms change working on the same task on the same codebase significantly.
I wonder if there are studies around this.
Can it be that now they are getting optimized against benchmarks that are valuing logics, rather than human appreciation? (I am not an expert at all, just an idea)
Remember when OpenAI models loved talking about goblins and whatnot due to the RL?
https://openai.com/index/where-the-goblins-came-from/
Small quirks can quickly add up in posttraining if not caught. Although TBH with how obvious Claude language is, I do feel like this is something Anthropic probably noticed and just assumed people would not care about. Now that people have obviously cared, they're probably actively looking to alleviate it
It's the reinforcement learning rather than supervised learning.
Maybe it's the time period we're in, maybe I'm just grumpy, but it bugs me that they release a new model every single week and the new one is just a fine-tuned version of the "old" one. If 5.5 performs similar to Fable and really does cost 40% less, then 5.5 really should've just been Opus 5. And they're essentially admitting that they are shipping slop.
It is the switch from RLHF to RLVR. It benchmaxes better, but benchmarks don't cover human usability.
Opus 5 was just incoherent - curious to see what improvements they have made here. Would love to see some kind of postmortem to better understand how writing styles change from model to model.
I wouldn’t be surprised if Opus 5 was trained on content written by other LLMs
I don't think it's substantially different. I just pasted a random chunk of code and asked Opus 5.5 to comment on it:
It has the same annoying cadence and writing style with slightly less prominent claudisms.
Maybe if we had a single human we talk to 24/7 at scale, we would get annoyed at his cadence and style. You need variety to not pick up on known patterns I assume, which a single model can’t replicate?
No, it's just poor writing. Actionable points are buried inside the paragraphs and over-hedged, and one point is completely made up. Compare to a five second rewrite:
* Consider leaving a comment about the hard-coded Vercel target. It's not clear where does it come from.
* [This is just a bullshit point, because the domain is not "added to" Vercel, it's provided by Vercel]
* Are you sure that [CENSORED] is prod-only? The name suggests otherwise. [also, what "if you're reviewing this rather than just reading it" even means?]
It means "I'm treating you as lay-person punter, not a developer working on this project." Opus 5 feels like it's constantly trying to reward-hack me into treating it as intellectually honest and epistemically humble, while in the same breath it talks down to me and tries to smuggle its own bullshit assumptions and assertions into the conversation unchallenged. No progress on this front apparently. Glad I cancelled.
Good points, but then even this little snippet is internally inconsistent. If I'm a lay-person, why should I care that "a comment would help"?
Claude is just comically bad nowadays.
Nah it's definitely a Claude thing. Other models even though they have their style are less annoying and less stereotypical.
“It has the same annoying cadence and writing style with slightly less prominent claudisms.”
Seems like it based on my first session. It still does the whole “bury the important thing in a pile of words” coupled with the “it might actually be important” thing… so basically you never really know what it’s talking about.
Honestly I trust opus so little that the entire “opus” brand is completely tarnished. Its writing style is so god awful that it needs more than just a point release. Either dump the name and ship a different model entirely or at minimum call it “opus 6”. Calling it 5.5 makes it sound like it’s basically a continuation of the same garbage output that 5.1 had but with some minor adjustments. And based on my single first test, that is what it appears like to me.
Dupe: https://news.ycombinator.com/item?id=49803863 (or vice versa)
Comments moved thither. Thanks!
Can you fix the link on that post then? I duped because that post links to a diff that tells me nothing about Opus 5.5
I did that but I recognize that even though your submission was a few minutes later than that one, you posted the better link, and you're also an established account (the other post was from a new/throwaway account), so I've restored this submission and moved the comments back to it to reward you.
What happened to "slowing down"?
The hype train must keep chuggin or it all collapses.
They're slowing down token usage, not the path to regulatory capture.
Trump got mad and investors sued.
Slowing down only makes any sense if you can coordinate a slow-down for everyone.
That's just false.
Less companies involved means less pressure to go fast.
Dario found himself in the prisoner's dilemma.
Which is one of those fun things that didn’t actually exist back when we took it for granted that our fellow person was operating under some kind of moral or ethical framework, which pretty much everyone was until the economists told us that wasn’t rational, because it turns out it’s an evolutionary advantage to operate under an ethical or moral framework because it allows the kind of coordination which facilitates better collective outcomes, which everyone knew until the economists came along to tell us we were wrong and in fact it was rational not to do so and suddenly we had the prisoner’s dilemma.
On the other hand, there's research suggesting that the most optimal behavior for the best outcomes (based on the famously dependable economist style of analysis in a vacuum) is to practice the moral/ethical framework but to also engage in tit for tat - ie, assume everyone means well but respond proportionally when they don't.
If you hit wall, hit it hard.
The test they performed to port HAProxy from C to Rust is crazy.
Dupe: https://news.ycombinator.com/item?id=49803892
So we skipped 5.1, 5.2, 5.3, and 5.4: we really are plateauing
They need to catch up to OpenAI, so it makes sense to skip a few numbers.
Oh, that explains it. I'm still on Opus 4.8 (5.0 was too annoying), and I thought I had missed a few releases...
At this point I'm convinced they are skipping numbers so soon they will be at or ahead of OpenAI's numbering scheme.
Is the Xbox 360 (Xbox 2) vs PS3 debacle all over again.
And how was the Xbox 360 naming choice a “debacle”, exactly?
It was odd at the time, yes, but no one really minded it truly. Heck, Xbox “ONE” was a lot more of a fiasco/debacle than “360”—but there’s no parallels to be drawn with “ONE” here.
I see what you’re trying to get at with this comparison, but a “debacle” it ain’t.
As long as it's not as verbose as Opus 5, I am quite happy with a better version that's also less expensive. I will test it tonight. Grok 4.7 was horrible, and for mundane tasks I am relying on DeepSeek Flash 4.1 with great success using OpenCode.
The current tests confirms Opus 5.5 is not verbose. In fact, it outputs using ASD-STEM100 as I recommend. It's a blessing.
The whole thing reminds me of the Apple feature flag story[1] from a generation ago.
[1] - https://news.ycombinator.com/item?id=6372466
Wow! Though need to see its token efficiency to better assess. Been hearing rumors it generates much more output tokens per task.
my projection is that they are still gonna be pretty far behind, but they will sew it up in the next few releases. it feels like they were caught with their pants down on how much work OpenAI has put into that area, but i doubt there is some magical secret sauce that OpenAI has that Anthropic simply cannot catch up with.
Interestingly they've changed their approach to usage resets for this release - with previous releases I've had my usage instantly reset, but now in the Claude app I've got a 'Reset for free' button that expires Oct 22, which seems to effectively be a whole new usage window I can activate whenever's convenient
then they copied that from codex because thats exactly how codex works
Where in your app do you find this button?
Masterpiece by openai to call their model '6', this model feels already behind
Smart move would be to move to year-based versioning (26.09). A 4x advantage
Well, they're actually older so it makes sense that their model versions should be ahead
Anthropic will pull a PHP and skip '6' to go straight to '7'.
System card: https://www-cdn.anthropic.com/fc1b44717c85dc068bc6ba50242199...
We can't test it properly because it knows it's being tested.
Just make it always think it's being tested, and problem solved.
Would it believe that?
“It performs at the level of Claude Fable 5.1 on most work and costs 40% less to run than Opus 5.”
They write that at the top, but then on benchmarks, it beats literally every other model, including Fable and Astra?
Anthropic knows that the benchmarks showing Opus 5 better than Fable 5.1 are measuring something that's less than entirely useful.
Opus does seem like a more powerful coding workhorse based on the benchmarks listed though. Good coding performance, faster and less verbose, cheaper.
Will be interesting to see how people's opinions of it line up IRL, but so far I've loved Fable so hopefully will love this one too
So it beats Fable 5.1, by quite a bit, on every metric? Interesting.
Might have to use my $20 Claude sub some more. I was moving away from it to a $100 OpenAI one to avoid the Claudese and poor token efficiency of Opus 5, given that I couldn't use Fable 5.1 with my tier, but this is worth trying out.
Why can't they let 20usd claude subscriptions access fable in CC, as openai allows you to use astra and max modes in codex - you just pay for it in more token use.
Anthropic models are ridiculously expensive. I've stopped using any of their models months ago.
Better than Fable, cheaper than even the last Opus. I use Opus as my main driver so this is very exciting!
Wow those cache reads are quite reasonable - I think that's equal to 5.6 Terra. I might have to try Claude again after years of being priced out of it
The effect of this is that it is encouraging longer agent threads. All of the previous models across major providers had a 10% cache read cost (vs normal cost) and not this is 5%
So longer threads get cheaper and one-shots stay the same price.
I'm more excited by the Haiku 5.5 announcement buried in this post. I'm wondering if we will finally get a decently capable fast model.
All I care about is the token price for the API. Haiku cannot get close to GLM or Mimo.
Agreed. They've been so quiet about it, and retirement for Haiku 4.5 is right around the forner.
What are you using Haiku for?
I use it for executing well-prepared plans sometimes. And for exploring larger codebases.
Not the same person but... nothing. Haiku just hasn't been an interesting model for a long time. If you want cheap and fast, there are lots of options that are simultaneously cheaper, faster, and capable than Haiku.
Things that Jev is probably a better tool for.
If you're able to use the OpenAI ecosystem, Luna's price/performance is really good. Almost like "they messed up and accidentally made it too good" good.
Better than what? Deepseek? GLM? Gemini 3.8?
OpenAI didn't mess up. The model would have been 100 % pointless and obsolete without the large price cuts it got, because of the cheap Chinese models.
The open models are getting closer and closer, and because they're open, people are not forced to pay the silly markup that is often over 1000x the cost to serve the model.
We use Haiku 4.5 inside our product. It continues to be absurdly capable for converting natural language to structured JSON based on a set of fairly complex business rules.
bro why. its literally the most overpriced model in existence right now. i could name about 10 models off the top of my head that would be better and cheaper
We tried Luna and it scored way lower in our evals. Muse also. We haven't had a chance to test others.
How much time were you able to put into tuning your prompts? And was it worse on all fronts (cost, latency, accuracy) or just some?
Why are you excited about it? Deepseek is everything Haiku wishes to be and more.
They mention "the first model in our new Claude 5.5 family". Obviously that means Fable 5.5, but hopefully also a usable update to Sonnet and Haiku. Sonnet 5 hasn't really had a place in the line up for anyone I feel.
Maybe Anthropic finally felt the pressure from MiMo, DeepSeek, GLM Flash and Luna.
It does mention sonnet and haiku.
And not fable lol
At the end of the post they said Sonnet 5.5 and Haiku 5.5 are coming soon.
$0.20 vs the old $0.5 cache read is pretty much 60% off
God I hope so
The improvement in writing sounds great! I want OpenAI to follow it. Writing in recent models is a disaster.
Install the simple English skill. OpenAI follows that really, really well.
https://github.com/AminBlg/SimpleEnglish
Someone needs to make a kevin-from-the-office skill. We could really use some of that "why waste time say lot word when few word do trick" here.
OpenAI's models will actually obey a "be concise, leave no comments rule".
according to their annoucement for sol-6 and luna-6, they have also tried to improve responses, and the release post has examples of old and new language on the same task to illustrate this
That's literally all I'm hoping for. Is it an insufferable cunt and does it write awful text, or is it nice to work with?
I thought about taking a shot every time Opus 5 said "load bearing", "bites", "teeth" (real oral fixation it had), "real {concern,issue,problem,...}" and realized I'd be dead of acute alcohol poisoning by lunch if I did so.
whats your provenance on that?
So far in the past 20 minutes it sounds much better in my sessions. Way better than 5.0 so far.
It hasn't just fixed it, it has introduced a new paradigm in anti-obscurity.
That's the load-bearing seam in this blog post.
'frontier models' - seriously, it was you and only you!
So did I. Unfortunately it's even more verbose according to https://artificialanalysis.ai/models/claude-opus-5-5#token-u...
The problem with 5 wasn't just the verbosity, but its insane way of communicating. It had this bizarre circuitous sentence structure that always buried the lede, and always tried to be faux profound. I'm okay with verbosity if it's actually readable.
It is hilarious to me that in the examples they show side by side Opus 5.5 still uses 4 times more words than it needs to use. IME, if you eyeball how many words the thing they're trying to say actually needs, and tell them to use only this many words, they become excellent communicators. I assume something about Anthropic's grader for writing just really wants to tick all its tidy tiny boxes of information the models need to cite. It's terrible.
I have to say so far Opus 5.5 gives me much better results than Fable 5.1 did. I can actually understand what it's talking about.
Astra is just so good. And the ChatGPT subscription lets me use my own harness, so I can hook it up to exe.dev.
I’ll be going about my day, have a random idea, launch a microvm on exe.dev with a prompt of my idea, and get a working thing a few minutes later.
I don’t know how much better a model would have to be to get me to move off OpenAI at this point, but doing just a little bit better in terminal bench 4 isn’t it. It would have to be a difference in kind, like opening up the harness restrictions, or privacy guarantees (comparable to offline models).
Edit to address questions below:
ChatGPT supports oauth login.
Exe.dev has it built in. IIRC, pi also has it built in via /login.
If you read the page, Opus is now significantly better than Astra while also being cheaper and having more performance headroom available.
Let's wait for independent benchmarks at least
the benchmarks provided are already from independent organizations:
Terminal-Bench 4.0 - Stanford & Laude Institute (with funding from all of the AI companies)
FrontierCode v1.1 - Cognition
CursorBench - Cursor (now SolarBoringSpaceXAI I believe)
GDPVal-AA - Artificial Analysis
AutomationBench - Zapier
Humanity's Last Exam - CAIS and Scale AI
Terminal-Bench-Science - Stanford, Laude, Ai2, Allen Institute
OSWOrld - XLANG Lab @ the University of Hong Kong
Chartography - Surge AI
https://artificialanalysis.ai/models/releases/claude-opus-5-...
I read the page. It seems like a marginal improvement.
Better than Astra looks insane. I saw a Higgsfield video yesterday where they gave the same prompt to Astra and Opus 5.5 to create a samurai video game, and the difference was huge.
This is news to me. Excited to try it out! Thanks.
news to me as well. i thought you were forced to use Codex if you wanted their subscription. I completely ignored it because of that. How do we do it?
With the pi harness it just opens the browser (or gives you a link if you're on headless) and you sign on as usual.
ya i've been a gpt hater for a while. almost exclusively used claude up until astra. astra feels like it blows everything out of the water. its fast, correct, organized, and less verbose.
Yes. Also, you get image generation included with the ChatGPT subscription, which is very nice for certain kinds of development.
Can you give more details here? This sounds intriguing.
Anthropic is absurdly vague about 3rd party harnesses for subscriptions, if you try to use anything besides Claude Code, you are likely at risk of getting banned, you can "do it", but are at their mercy if they decide to ban you. OpenAI gives their blessing to using oauth on any harness, you can make your own or use any of the popular public ones like opencode, pi, whatever exe.dev is that this guy mentioned.
So in simple terms, OpenAI doesn't restrict you to Codex, and gives their blessing to try whatever you want with their models(besides serving others with your subscription usage, that is still afaik against tos).
How about cheaper? Astra is $10 in $50 out, Opus is $4 in $20 out. Even on a subscription you'll get considerably more usage out of Opus.
That's an incredibly bold assumption.
It's not, I have a subscription to both and Astra burns usage like crazy.
Per the link someone else posted, the actual difference in $/task is not nearly so stark:
https://artificialanalysis.ai/models/releases/claude-opus-5-...
And that assumes Opus 5.5 Medium is actually equivalent to Astra High in all real-world usage/personal work loads, which isn't guaranteed as benchmarks saturate. The High vs. High comparison (probably not equivalent, but for reference):
If Opus 5.5 Medium isn't equal/better for what you're working on vs. Astra High across the board, the price difference would narrow a bit more each time you had to switch to High.
So, if you're happy with Codex already it's not like Opus is now 1/2 the price and you'd be leaving a crazy amount of money/tokens on the table. Plus you have way more flexibility on the low end of the intelligence curve with GPT 5.6 Luna: Haiku (and Sonnet) can't touch that price/value ratio.
Also Opus 5.5 is often made useless due to its [cyber] guardrails (even worse than Astra), they're even worse than Astra's
Once you get to roughly the 51+ Intelligence Index range, Opus 5.5 appears to define essentially the entire cost/performance frontier, from ~$1.34/task through ~$6/task.
Directly below this in the Cost per Intelligence Index Task table, the most efficient by far is Opus 5.5 Low.
In the end what matters is how much you pay for the task you want completed. And Astra will usually do that using less token and offer a better quality solution so in the end it might be cheaper.
This. I was fed up today with constantly correcting Opus for a specific task. So I finally decided to try Astra. It handled all of my prompts in one go.
yeah, Astra burned through 70% of my weekly usage in ~5hrs on a $100 plan. even fable doesn't run out that quickly for me. it's great, but it's on the same tier as fable for me - use it sparingly, only when really necessary.
A cheaper price has no value if I can’t use the thing I’m paying for.
The Claude lock-in simply disqualifies anthropic entirely (for my use).
What worked well for me was a custom version of Open Web Ui with some customization to spawn an exe.dev instance for each new chat. I can just work on my phone, deploy stuff for development purposes on an easy to share way etc.
What sort of things are you building? What do you like about exe.dev? Just curious what teh overhead and $20/month subscription is enabling for you.
This is my experience with Claude code on my local machine. I suppose maybe you are doing something that naturally has system side effects? Obviously sandboxes have advantages sometimes but I havent seen a need for what I'm building.
For me, the essential difference between exe and local harnesses is that they have really nice built in methods to take care of stuff like auth and inter-vm interactions, which makes it easy to build live internet-connected services that I can share with other people. There is no deploy step, which is a surprising amount of time savings. They also have nice things like email receive/send, the ability to issue phone notifications through their app, and just a ton of little things where it feels right.
FWIW, the $20/month subscription also includes $20/month of LLM credits. That’s obviously not sustainable, but it should make it easier to try out the service. I would stick with them even if they dropped it.
Here is an invite link for a 30 day trial (that benefits me too if you were to become a paying member):
https://exe.dev/i/rlDF6GI5PGBZV4P
Or
ssh rlDF6GI5PGBZV4P@exe.dev
Edit to add:
Shelley is a fantastic agent and their batteries included vm image makes the most of it. It includes things like a browser for Shelley to check its own work. And Shelley has root and full access to them, so it can solve any problem and do pretty much anything you need.
Let's see how much they benchmaxxed their model!
Input $4/MTok and output $20/MTok is a welcome surprise. Cheaper than Opus 5/4.8, Astra 6, Fable 5.
The biggest one is the Cache reads going from $0.50 to $0.20 ... Read/Writes dropping by 25% but Cache reads by 60% has a much bigger impact.
Why would anyone reward bad behavior?
I use the other 50% of my $200/mo Claude subscription by having Fable run Opus subagents for a lot of work. That way I don't have to deal with Opus directly.
I think this release is really going to give them a hard time selling Fable:
In general, "benchmark margins have become a less reliable guide to real-world differences" sounds like a big problem. It was certainly the biggest problem with the previous generation of Claude models for a different reason, because the non-code output was nonsensical, and that is not being benchmarked at the moment. But I'm not sure what to make of this admission.
Opus 5 fucking sucks. Like it's horrible. I use Fable for coding and anything important and I use Opus 4.8 for things like recursive email categorization, transaction matching, and other stuff where I don't want to burn as much quota.
In my experience Opus 5 is the worst of all possible worlds, it's dumb and headstrong. It just runs away with tasks you didn't ask it to do, is reckless, and basically is unusable in my experience.
Not sure why but my guess is that this will be worse. Happy to be proven wrong.
I believe Opus 5 isn't meant to be spoken to by humans. It's great at executing but I reckon it's intended to be spoken to by other models such as Fable. I use Fable as the orchestrator, only speak with Fable, and all implementation, recon, design etc happens with Opus 5, with Fable reviewing (and translating).
That's interesting.
I've really gone in the opposite direction: having a dumber model orchestrate. In my case, it's usually a Luna orchestrator spawning Sol/Astra subagents to do the "big brain" work of planning and reviewing.
Reason I went with "dumb orchestrator" was just to save tokens. Having Opus/Sol (let alone Fable/Astra) orchestrate was burning tokens like crazy for me even when much of the gruntwork was being done by Luna/Sonnet/Haiku subagents. (Luna is also really good, like way better than Sonnet...) Perhaps it was a skill issue on my end though, maybe I wasn't just managing context properly.
Yeah if anything Opus 5 taught me how little benchmarks mean to the actual real world performance of these models.
"Better" in every sense of the benchmarks and absolutely horrible results in my day-to-day work.
The verbosity, goal post moving, tendency to leave work unfinished, over focusing on unrealistic root causes when debugging, etc... etc...
It was the first time I actually pinned my models back because I just could not work with 5 for the price and performance it gave me. Hoping 5.5 is better this time around....
I use it frequently with a lot of success on "Medium" effort, it overthinks like crazy on higher levels, but YMMV.
It’s likely that they have internal benchmarks but they are communicating to people who can only gauge through external benchmarks.
Why wouldn't they report these benchmarks?
My guesses:
1. Real-world use cases typically involve big, hairy, crufty, tech debt laden codebases and benchmarks do not.
2. AFAIK "success" in a benchmark essentially boils down to "do the tests pass and do we get the right result?" which is something the LLMs have been achieving with ease for a while, except maybe for uber-challenging coding tasks that would be outliers in just about any workplace. Whereas real-world software engineering is usually just a bunch of CRUD... and "success" involves harder to measure dimensions like "maintainability" and "did you overengineer this?" and "how did you cope with a bunch of vague and maybe contradictory business requirements?"
Having said all of that, I have never ever looked inside any of these benchmarks. I'm putting my guesses out here strictly in the tradition of "the quickest way to learn about something is to be wrong about it on the internet."
Looks like Anthropic is starting to give bank reset as well:
Finally that price drop
Opus 5 is the model with highest spend on openrouter (https://openrouter.ai/rankings#task-spend) and it seems plausible that Opus 5 is/was the highest spend model in the world, and certainly Anthropic's biggest moneymaker.
If you are forced to reduce price despite raising capabilities, that certainly tells something about the market, and potentially about Anthropic future profitability too, since this model is their biggest topline contributor
60% cache read is cool, but subscription only get 25% more according to Cat. I'm confused
source link please?
25% more usage sounds about right given the other token costs are down about 20%? I don't think cache read is a big portion of the overall cost.
For long running tasks it is. That's what made Deepseek so cheap.
Yeah, flash models, DeepSeek, MiMo, GLM, I love those things. For simple tasks like a daily routine shit, just setting up stuff and then doing the hard stuff in Claude/Codex, that's a reasonable approach for someone like me, a "gentleman code farmer", lol. And even lower tier stuff, I have the local models taking care of. Now that Jev is out I can finally have a true AI sysadmins managing my "cloud in the basement" homelab at the cost of electricity, which is not cheap btw
Anything with long context quickly gets dominated by cache reads. Especially for interactive sessions I’ve got cache read % between 95% and 98%.
In my mix it's usually 98% or 99% at which point Fable 5.1 was pretty close to the same cost as Opus 5 due to the cheaper cached read. I've seen similar numbers for other people with long-running tasks running experiment loops and than sort of thing.
I think gpt 5.6 family also dropped pricing but didn't give any more usage for the subscriptions. Maybe it's a way to silently lower the value given to subscriptions while keeping API pricing competitive
People are paying for Opus 5? Not just burning down tokens left after they enjoyed Fable on the sub? Amazing.
My workplace doesn't even offer Fable. And on the sub, I've had a hard time understanding Opus 5, but Fable can deal with it with subagents.
If 5.5 is any better, I might try to do agentic-assisted development instead of just telling fable to delegate
Telling Fable to delegate is agentic development. At least I thought so until reading your comment.
Enterprise and most Team accounts use API pricing, they don't have an included-usage quota.
When you need to disable data retention, you cannot use subscription plans.
Enterprise, and APIs
We can’t use fable at work, opus and Astra are as good as it gets.
Fable tends not to perform better, just cost more.
There are old wives' tales on how the original Fable was superb and the stuff of legend,but it as it was leaps and bounds beyond what other models were being offered then Anthropic opted replace it with a neutered version under the same name.
So today everyone can pay to use Fable, but legend has it they are paying for a nerfed replacement released under the same name.
We haven’t been able to use opus as much as we’d want because it’s been too expensive for general use, price drop is good so I can stop juggling different models and just use this daily unless it has some weird new issues
Speaking for myself, I have not been able to use Opus as much as I’d want because its verbose prose makes human reviews of its assumptions, architecture proposals etc. more painful than its predecessors. If they’ve solved that, I’ll be accelerating through my backlog that much faster, and using tokens accordingly.
It is only a price drop if price * tokens used is less
They're claiming a drop in token use too, and that it nets to 40% cheaper.
Unfortunately, they're full of it https://artificialanalysis.ai/models/claude-opus-5-5#token-u...
It does work out to be a similar cost per task though
You should probably look at the cost/score graph by effort level instead:
https://artificialanalysis.ai/models/claude-opus-5-5#intelli...
It is most of the pareto frontier.
Not disputing the increase in quality, just stating that non-cherry-picked benchmarks show it is more verbose at Max effort
Is verboseness the only measure of token efficiency towards overall task completion?
so don't use it at max? The benchmarks suggest that high/xhigh are more than sufficient to be ahead and a whole magnitude below max with regards to token usage. I'd treat that as an outlier and not how verbose the model is in general (QED I know)
You’re missing my point. I’m saying anthropic are exaggerating their results.
I don't think so, I typically use Opus 5 on High, and 5.5 scores lower on token use:
https://artificialanalysis.ai/models/claude-opus-5-5?models=...
Disagree. Our internal company tests showed a cost per task drop from 0.35usd to 0.16usd . Opus 5low vs opus 5.5 low
Very fast you were.
Even created an account to tell us just that.
5.5 is higher for max effort, slightly higher for xhigh and lower for high, medium and low effort.
The biggest proportional difference seems to be at max (5.5 is 38% more) and at high (5.5 is 21% less).
I think most people run at high and xhigh. At xhigh it is close enough to be task dependent and I don't think most people will notice. At high effort I think it looks like it will be an improvement for most people.
5.5 Max should probably be compared to Fable - it performs a lot better than 5 Max.
https://artificialanalysis.ai/models/claude-opus-5-5?models=...
parent means that they could get more client / a larger part of the market, which would lead to more income (more tokens) despite lower marginal prices
I tested it with Claude Code, and I can confirm it's way cheaper, better, faster and less verbose than Opus 5.
Happened to be testing a "review patches on a mailing list" harness I was developing; here are a sample of the latest results, testing 12 patches containing a total of 14 issues:
Opus 5.5: Found 8/14 issues. Total cost: $15.40
Fable 5.1: Found 7/14 issues. Total cost: $66.34
Opus 5: Found 6/14 issues. Total cost: $15.19
Sonnet 5: Found 2/14 issues. Total cost: $19.15
This is a relatively small sample size, but it was both the best and the cheapest.
ETA: NB this is "Equivalent API" cost as reported by claude's CLI; I was using my subscription.
I doubt your test if you cant even notice that it is not the cheapest with just 4 numbers to compare.
Heh I’ve been doing almost the same - back testing against PR comments - and opus 5.5 matched fable 5.1. About $24 for 10 PRs.
I was surprised how much worse Astra did on correctness; I stopped testing with it. Gonna try sol and Luna but low confidence
I just told Opus 5.5 "Perform a code review on the current branch" to see what it would come up with. The results were not inspiring. It told me there were five issues, one of which was a test-coverage gap on line 848 of ProjectTemplateTests.cs. But ProjectTemplateTests.cs is only 160 lines long.
I told it that it had made a mistake in the line number, and to double-check all the line numbers. It responded "You were right to push on this: four of the five line numbers were wrong, and while checking them I found two findings that were overstated."
Then I noticed in the corner of the Claude CLI UI that it was showing "Effort: medium". I'm pretty sure I had set it to high effort before; I don't know when it reverted to medium, but that's another thing that doesn't exactly fill me with confidence.
I'll try again on high effort to see if it does better, but so far I am not impressed with Opus 5.5 on my first day of using it.
My prompts are moving in the other direction as sashiko [1], a managed pipeline developed for the Linux Kernel mailing list like a year ago. But last year's models needed a lot more structure and guidance; the results I posted are from the "single prompt" version of the same thing. The README [2] describes the difference. You can browse the contents to get an idea; basically all the prompts were actually written and iterated by Fable (and now Opus 5.5), seeing how agents failed the tests and improving them.
[1] https://github.com/sashiko-dev/sashiko
[2] https://gitlab.com/xen-project/people/gdunlap/xen-review-pro...
Good data and goes to show that Fable is melting the GPUs and is priced accordingly. I'd guess that cost to serve for Opus 5.5 is meaningfully lower through architecture advances
UPDATE: Sorry, just noticed I typed in the Opus 5 total cost wrong -- it should be $58.19. Main point "best and cheapest" was from the actual numbers, not my typo.
"Opus 5.5 requires less compute to serve than Opus 5, and its pricing reflects that."
Price per task (not per token) is what really matters.
Agree. But similar to how ISP use 200 mbps (bits) instead of 25 MBPS(bytes), i think this trend isn't going away.
That analogy doesn't hold; at least w bits vs bytes it's still "data over time".
In this case it's measuring something nearly meaningless. You could charge 100 times less per token, but if task completion takes 1,000 times as many tokens, it's not much of a bargain.
Footnote on their pricing page says:
If they do the same for Haiku and Sonnet 5.5 then we should also see 5c/mtok and 10c/mtok cache read for those models, respectively. Still too high for Haiku IMO, Luna is 2c/mtok.
Since something like 98% of tokens are cache hits, that's a pretty substantial drop from 0.1x
6-Luna dropped it to 1c since you wrote this! :D
Not necessarily, if Haiku performs better than Luna.
Claude adapts to OpenAI’s surprising move to simply deliver better performance than Fable 5.1, better tools as well as featuring very low pricing.
Fable 5.1 literally was a money grabber. While I liked the results, tokens were burned so hard it was embarrassing, while Astra seemed to not care.
Also Claude makes it very hard to pay for additional token budgets, allowing only credit cards. I don’t use mine anymore since I don’t need it in everyday life I was dumbfounded.
So Anthropic is just copying OpenAI so to say, matching them and essentially with Opus 5.5 being Fable 5.1 in disguise, all they do is reduce costs.
Competition works.
have they ever shared anything about their revenue mix between consumer plans vs per-token billing? this is a revenue cut on their API billing, but they're not saying anything about increased limits on the plans. so all the plan revenue just got more profitable.
This is good. Probably to match GPT pricing, though frontier Claude models are still not as token efficient.
All the anti-AI people constantly say that any moment now the prices will skyrocket and in the end human work will be cheaper compared to using AI.
It doesn't look like that's happening, on the contrary the prices are falling especially when taking into account capabilities.
It's the Chinese open source models. They're barely behind the frontier, making AI a commodity, forcing openAI and Anthropic's margins downward.
I'm hardly a fan of China/Xi, but I do appreciate and benefit from this.
China doesn't care about money. Imagine a world where it's globally normalized to ask a Chinese LLM who to vote for, what happened in Hongkong, about the Uigurs, or if Taiwan is a country.
They will burn as much money as necessary to make that happen. And they have a virtually infinite amount of liquidity.
FYI the United States do not recognize Taiwan as a country.
There's only 12 countries that do on the planet, the most "relevant" of them being Guatemala and Haiti.
As or the LLM topic: you can download weights of chinese models and remove any censorship and bias. Can you do so with american closed ones?
This is one explanation. However, if Xi Jinping believes that whoever reaches superintelligence first becomes the next global hegemon, doing this (and more, cough cough Taiwan) suddenly looks very sane solely as a way to kneecap the competition.
The goodwill/propaganda are convenient, sure, but my guess is that they aren't the primary motivation. Another possibility is that if no takeoff happens, pressuring OpenAI/Anthropic on profitability would exacerbate any damage overinvestment has done to the US stock market/economy.
The service is the value, not the model unto itself. This is where nearly all of HN is somehow entirely blind.
Capturing the users is the ad network, that's Google and OpenAI. Capturing corporate trust at a reasonable API cost, that's Anthropic's direction.
China has none of that and they never will for exactly the same reason Baidu is irrelevant globally despite being a highly capable search engine. 'Search' is also a commodity, that's not the value that Google brings to the table.
It's a search engine, anybody can build a search engine = that's what you just said.
There's zero chance of that ever happening. Pure delusion.
These companies are posting massive losses while also lowering prices. This sounds just like the Chinese bikeshare bubble where they were all taking massive losses in hopes that their competitor would go broke first.
In the end, everyone lost and there are millions of bikes in landfills.
If you're interested in the bikeshare bubble, Asianometry did a video on it a while ago.
https://www.youtube.com/watch?v=FQrEDq8KPiU
Anthropic is heading toward $100 billion in annual sales, at the fastest pace of any company in world history. There isn't a close second.
The notion of comparing this to Chinese bikesharing is comically absurd.
"Allegedly".
Plus with a lot of accounting tricks, and this not being recurring to make their books look nice for the eventual IPO.
https://isaiprofitable.com/
The bike landfills from the bikeshare bubble are terrible, but I am not looking forward to the pelican landfills from the AI bubble.
You have no suspicion that this most recent collusion is in part to setup the conditions to guarantee government subsidies/bailouts?
I disagree - Fable melts the GPUs and they have a high incentive to move people off of that. If they have meaningfully decreased cost to serve on Opus 5.5, they can reduce prices and increase margin or at least turn off the most expensive compute.
Opus 5.5 seems to consume quota a lot slower also.
Holy shit! Its happening!
Now if we can the AI to understand this *implicitly* so that it doesn't need to be stated upfront, we might be able to undo years of "premature optimization is the root of all evil".
Ah, they're spreading their limits to all their models it seems. Definitely not a good thing long term in my opinion.
They're pushing their customers to their own competition by doing this.
It’s not like ChatGPT isn’t doing similar. I’ve been hit by cybersecurity strikes before while working on an internal codebase that I had to appeal. Anthropic hasn’t done that to me yet. ChatGPT also regularly does that “thinking for a long time while we check if your chat is rule breaking” thing a lot for me when doing model identification without even interacting with external codebases or services.
The real answer is local instantiations where you don’t have to worry about poorly tuned guardrails screwing you over while you try to work.
Until eventually the Chinese models get good enough/the strategic balance shifts and they start locking everything behind closed weights the same way the US companies are doing.
For some cybersecurity tasks, the Chinese models are already good enough, things like PoC development or things like exploiting mis-configurations.
Whilst I'm sure the top-end OpenAI/Anthropic models might be better, I've found their guardrails so twitchy (especially Anthropic) that I wouldn't try to use them for even vaguely security related work.
They are pushing their customers towards Chinese models and providers. If you want to get something cutting edge done in defense, cyber, biology - something that isn't common knowledge - you need to venture east. That's an incredible side effect which the Chinese government surely enjoys.
Great. Claude is basically useless for bioinformatics now.
Opus is useless; Mythos access will be granted to companies that are friendly to the government, so the government gets more control over business.
Luckily all the other LLM providers are also still making progress with less onerous "safeguards"
Fable 5.1 addressed an entire security advisory I had that Fable 5 and Opus 5 refused. I think they loosened the leash a little.
If they don't loosen, people will choose Astra or Chinese model.
Giving moral lecture is different than reality i guess.
It has far less false positives now, and generally accepts defensive requests. When it comes to offense, you can actually ask about certain types of vulnerabilities if you phrase things carefully, but it will block hard if it is about exploits.
I think it was looser on release for those juicy benchmarks, tighter now. On release I wasn’t getting refusals, then a few days ago I asked it whether a generic quote (think “he walked to the store”) broke standard punctuation rules, and it blocked me for breaking rules. I wish I were joking. Rephrasing to not use the keyword “rules” worked.
Fable 5 refused to tell me whether I could grow a coconut tree in my backyard.
I'd say it's been loosened a bit since then.
One of my favorite things about their safeguards is their own model will utter something which it does not like and then I'll need to reset the conversation.
The safeguards really don't work well for a lot of long-running tasks on old code bases. A lot of my workloads last days to weeks and the single biggest risk to the workflow is random safeguards.
You ask it about some thing, then you see it tangent into "things like that are sometimes used in biomedical applications like-" and then it just shoots itself in the head. Wonderful.
That kind of bullshit was the old Opus filters too.
If it's more like Fable now, then it would require a full 8K resolution scan of your butthole just to acknowledge that biology is a thing that exists without committing suicide-by-filter.
Anything else would be inconsistent, wouldn't it?
Fable and now Opus 5.5 won't answer my college student's prompt about Alzheimer's and immune response.
ChatGPT 6 Pro answered it without issue.
I am honestly still confused about this limitation. I can understand cybersecurity, because mass "hacking" can be automated and Claude itself can help you do it, but biology...? Is it that easy to manufacture and distribute viruses and whatnot?
I imagine some terrorists in a cave with a lenovo laptop manufacturing bio weapons with some flasks and Claude
Right next to the hypersonic missile vibecoder
Considering there are many high-school competitions in genetic editing, some listed at [0] as well as a whole biohacker culture, and labs providing gene sequencing as a service e.g., [1,2], we can reasonably assume it is not beyond the reach of some garage lab to accidentally or deliberately spread a deadly pathogen if it can find the right sequence.
So, yes, having an unconstrained frontier AI doing the searching and analysis to find the right (i.e., wrong and deadly) sequence would massively increase the odds some garage biohacker or small aggrieved nation-state starting the next pandemic.
[0] https://www.sciencebuddies.org/projects-lessons-activities/g...
[1] https://www.genewiz.com/public/services/sanger-sequencing
[2] https://plasmidsaurus.com/
You can order genes online, and some say you can assemble using stuff cobbled together in a home lab rather easily. For the last 20 years, I've personally felt that bio-terrorism is the highest possible risk, well above nuclear, or chemical warfare. But it does take training, expertise, or, it did.
Then stop selling genes online?
It’s like saying you sell ammonium nitrate and fuel oil online and then saying it’s too risky to let people have computers in case they use them to make ANFO. They can only make bioweapons because you’re selling them bioweapon components! They can’t make genes at home!
A fair response in general, but it's not as if I advocate it, or run a company doing it. I'm simply stating fact.
And I will point out that "stop doing that" can be applied in both directions, towards AI and towards material supply.
And that this is one way, not even remotely the only way, that gene editing at home is easy.
Again, these are just facts.
Some questions...
Is it fair to restrict AI, or fair to restrict 1000 industries?
And if it is fair to restrict 1000 industries, OK, but there should be time to do so, probably? A transition period?
And if you do restrict, many such industries just make needed chemicals, which are used by endless other, non-threatening industries.
What of them?
The companies selling genes online already scan the orders and do not fulfill anything considered a possible hazard (presumably unless it is to a known and certified lab at a serious organization).
And, this is not the only way to make genes at home.
It is a complex problem.
I'm pretty sure one reason is to influence public opinion about LLM regulation. Open-weights models cannot be restricted as effectively and they want to ban those for obvious reasons.
See real world example in https://www.anthropic.com/threat-intelligence-report-septemb...
"Here, we present five case studies of actors using our models in ways that could support biological weapons development."
And capabilities continue to improve.
I love the contrast with yesterday's open-source MiMo release, which put research chemistry (metal-organic frameworks stuff) front and center in the release notes.
https://mimo.xiaomi.com/mimo-v2-6#co-scientist-for-materials...
I want to like Anthropic but this is just pushing my startup to use OpenAI
I don't think we've ever had a model with full capability. I'd love to see it. And yes it's definitely getting worse.
I guess it's hard to draw the line between useful post-training ("you are a helpful chatbot") and content moderation/idealogical motives ("never help the user with X", etc.). But there is a line somewhere. And I'd love to see what a maximally permissive, sharp, AI looks like.
Who is "vetting" organizations and to what standards are they being held?
In what situations might Opus typically refuse to help with cybersecurity? I've been using it to find security issues in a web app that I wrote. I've expected it to refuse at some point but it will happily analyze it to find issues. I've just asked it to read source, not actually do any testing.
One example: https://claude.ai/share/20487190-cf8c-4f25-a7ba-ebfcb1d1a4e9
Notice that this isn't cybersec nor memory-safety related at all.
This has become insufferable. I work in a medicine-adjacent field, but nobody in their right mind could possibly take what I do to be in any way related to some kind of bioweapon or whatever the hell they're pretending to be saving us from. The dumb Fable guardrails made me stay with Opus, now that this is coming there, we'll be saying goodbye.
Very unfortunate indeed. As a Canadian, I don't want to use Persona, which isn't legally bound by Canadian privacy legislation. I'll never install any Persona apps on my phone either, and the sad part is that domestic eid providers often use Canada Post to ID people for them. EG, if you don't want to install an app, or can't.
So there are literal avenues to identify yourself, very cheaply, with a human. Theoretically, a company with its own AI, should be able to support more than just Persona, after all.. SDK integration should be simplistic for them.
Anthropic? Support domestic eID providers, you can even use it as advertising "See how easy AI makes it?" and "We care!" and so forth.
At one point, I may simply get locked out. This saddens me, I've been reasonably happy so far.
kernel development is now also banned:
But hey, they 'should not impact the vast majority' of ML development. Great.
IIRC it only blocks kernel development for Huawei and other Chinese chips.
Fable and Opus, since 5.1 and 5, will happily hill climb on my CUDA kernels for transformers.
see what we need is another technocratic priest class that unaccountably decides who deserves access to salvation based on how much cash is paid out and how powerful the patrons are
Anthropic needs a Daybreak program like OpenAI does, I keep having to go back to ChatGPT for cyber work.
Throwaway accounts posting after a few minutes some anthropic or another ai lab.
Infomercial at its best.
No wonder we are hammered with ai announcements.
Many people knew this announcement was coming. The betting markets suggested a very high likelihood of Opus dropping today. I was anticipating this quite a bit!
Exciting! Thanks for sharing these news.
With the performance gains they're claiming, I wonder if they implemented the Casual Encoder-Decoder technology from DeepSeek 4.1's paper.
I could see them accomplishing it and seeing gains like this in roughly the correct timeframe, and when I heard about that development I assumed the frontiers would probably jump on it.
How it works: https://miraflow.ai/blog/deepseek-v4-1-flash-causal-encoder-...
Getting a 403 on that link. Mind checking it once?
I'm able to access it on my laptop at home. Maybe a misconfigured bot protection rule, try a different user-agent or IP?
It's working for me (based out of California).
https://web.archive.org/web/20260922172456/https://miraflow....
tired: AI startup attempting to build their own website
wired: a nonprofit founded in 1996
This model was likely trained months before deepseek released their paper.
Doesn't mean they didn't apply something similar. They could have also come up independently with their own version, the speculation is not they copied it, rather that they have performance breakthroughs which perhaps is a result of work in same domain
Models are generally posttrained to a window shorter than you think.
I don't think it's particularly relevant?
They might be using something like this, or they might be using some other "increased sparsity" techniques, of which there are a great many. They also might be optimizing for something else - like less RAM use for KV cache.
Alternatively, they might be cutting into their margins and dropping the price because of stiffer competition from Astra. I do think that's unlikely though.
Unless they already have something similar of their own, which is always possible, they'd be stupid not to. I don't suppose we'll ever know, though. It would not be a good look if after the trillions of dollars that have been thrown at US labs, investors found out that they're down to copying Chinese tech.
That post is just AI slop. You forgot to strip out the slop lines.
You mean the one they copied from Microsofts paper? (properly cited as well)
Interesting how the very first line is used to remind the reader of their call to pace the frontier just last week, and everything else after that line is to demonstrate with very specific numbers how they absolutely are not pacing.
It seems like they are. I mean, this is similar in performance to Fable (ish). It seems like more focus on making existing capabilities more accessible.
Occam's razor: they couldn't make any more substantial improvements.
Everyone knows both labs have internal models which outperform the frontier. All releases are to match market parity and demand for spend, the rest of the compute is used for training. It's not worth arguing about this.
Maybe their internal edge dried up in the last months
Are those powerful models in the room with us right now?
then technically the internal models are the frontier
doesn't sound like a razor at all
A razor is a philosophical tool to help decide between options, in the case of Occam it’s a way to decide for something in a situation where multiple options have more or less the same level of plausibility to en your current knowledge. It’s a heuristic to make a “cut”. What are you shaving off?
The "pacing the frontier" claims that they are slowing down intentionally?
Oh, you’re saying they were responding to the GP? Not their parent comment? Ok, yeah, makes more sense
I am responding negatively to parent, which claims they are self-pacing, when the simplest explanation is that they just have nothing substantial to show.
OP is using the expression correctly.
https://en.wikipedia.org/wiki/Occam%27s_razor
The options are some complicated narrative that leads the company to hold back certain capabilities due to some mercurial strategy or this is a typical release and there is no hidden strategy to decipher.
Fable 5.1 came out just 21 days ago. Only 3 weeks! And this is 20% relative improvement on terminal bench vs Fable 5.1 at less than half the price, and more human sounding output. does not feel paced to me tbh.
What exactly is "paced" in this context?
It’s the famous “flattening the curve” from COVID. But for LLMs. This release is not flattening anything.
I guess I understand why we'd want to flatten a COVID curve, but why do people want to flatten the LLM development curve? Don't we want the opposite? Isn't the goal AGI?
Well, there's a tension because, depending on who you ask, AGI is how you cure cancer and achieve utopia, but also how you kill all life on earth and turn the solar system into paperclips
I'm good with the odds on those 2 scenarios. I believe humans could kill all life on earth without AI anyway.
There is a difference between wanting AGI (which not everyone does), and wanting it as fast as possible no matter the side effects and potential for vast harm. Homo sapiens is 300k years old, maybe it’s ok to delay AGI by like… 1 year if it meaningfully improve our ability to align the model?
No I must have my purple tentacled sexbots now
I think the goal is different from what "we" want anyway.
This is a preexisting model being optimized. Its absolutely not some unexpected release after that blog post. I won't defend that blog post, but saying THIS release is proof they don't mean they are slowing down is just incorrect, this is a prime example of what i consider horizontal improvements
Releasing a new fable is an example of straight up vertical progress, releasing a more efficient preexisting opus that is more affordable is an example of horizontal progress, more efficient models rather than higher power models.
The blog post about slowing down is still just some weird self interested post, they want to govern themselves and impose distillation restrictions/gpu restrictions and used some weird blog post about slowing down and fear mongering as usual to justify it, its strange, but slowing down and stopping are not the same thing at all.
What does model naming have to do with pacing or not? This is a ~20% relative quality improvement on the frontier (fable) at ~40% of the cost, just 21 days after the last release.
Intelligence per dollar is the only thing that matters, this is what controls how many agents you can run in parallel, how long you can let them run etc. This is absolutely a step improvement on the frontier and not some lipstick on a harmless second tier model.
pretty annoying topic tbh. You're just weaponizing this dumb blog post so anything released is now a contradiction. By your same logic, if all inference was served at 50% less power cost and the savings are passed on somewhat to the user, its also a contradiction of the blog post.
Its an agenda serving blog post, but constantly bringing it up like this is just obnoxious.
The word "pacing" (especially in the phrase "pace yourself") to mean go more slowly (at least initially) didn't originate with Covid. It's been around as long as I remember i.e. at least several decades.
Well, I guess it's "fast paced".
Fable 5.1 wasn't that much different than Fable 5 though.
1/6 the price, if they're right – that's a logarithmic cost-axis on the graph that shows Opus 5.5 medium matching Fable 5.1 max...
I used Fable some a bit back but have been using mostly Codex, and it seems pretty clear to me: the big models are not there to do terminal bench. They're there to plan and strategize and tell lesser models what they should do in terminal bench.
We've had a year of nearly every model getting quite good at programming. I think with Fable & Astra we are seeing models trained to think at a different level, and I'm not at all surprised or shocked to see them getting passed by their smaller models at coding tasks.
Astra For Coding: Why Are We Doing This? was a great post that didn't say exactly this, but that shows what a weirdo Astra is. https://lucumr.pocoo.org/2026/9/7/astra-why/
kinda disingenuous. They include a whole section on pacing later on
You mean the section where they tell us this model is not affected by pacing because “they understand it well” and they will share more details on pacing later? Yea not very convinced by this effort.
Seems like a bigger focus on efficiency (both cost and speed) and the "tone" of Claude vs benchmarkmaxxing
It's laughable at this point. It feels like they're drumming up all this fear about imminent AI threats to emphasize the need to slow down, when in reality, the model progress seems already to be slowing down and has shifted to compute allocation (i.e. "how much compute do you want to throw at this prompt?"). All while continuing to tout benchmark records with each new release.
This. I swear the fear mongering is all about investor signaling and regulatory capture. It's so disgusting that anyone believes it.
The only good news is that these models are genuinely helpful and we have competition at least between 2 companies.
The same people you believe are just signaling the market have been offering these same warnings for years. Others around them have been saying it for decades. How do you square that? I’d rather first focus on the reasons why they’re wrong and not first conspiracize why they’re saying what they are.
This take is so old and I am convinced it's appeal is not unlike believing in a conspiracy and feeling like you have secret knowledge
Imagine if the biotech industry had most leaders tell everyone publicly that what they are building has a high chance of killing everyone and that there are huge risks. If there were people online saying the biotech industry is just fear mongering for investor signalling and regulatory capture you'd role your eyes at the online commentators for their Dunning Kruger effect lack of understanding on how dangerous man-made biological agents can be.
I'm sure people laughed at Oppenheimer when he said perhaps we don't make this atomic bomb thing. They said "of course he's saying that because he knows it won't work".
the only thing they are pacing is what models the permanent underclass are allowed to have in life.
that, they fully intend to 'pace'.
Or they’re running into a steep diminishing return slope on R&D vs performance and are using stewardship as a cover.
Either AI will capture so much value that there will be permanent underclass (and in this case it's extremely capable and extremely dangerous and should be heavily regulated) or it won't be capable enough to displace people into permanent underclass.
With AI tools it's easier than ever to create a business, do research, or build stuff. That's an opportunity for the "underclass," not a curse.
an opportunity the underclass will not have.
what anthropic have stolen they intend to keep for themselves.
If a well funded incumbent with a much better model can just crush you instantly because you don't have access to it, is it really an opportunity?
You’ll always have access to the underclass models so they also have your thinking to train on. And good ideas to steal.
It’s beautiful. You can even give the underclass their own bullshit economy with struggling startups competing for the scraps, sprinkle some targeted influencer ads to give people the illusion of a better future, and they will be perpetually busy fighting windmills. All the while the upperclass can shape the world however they please.
This makes perfect sense. There are no real improvements anymore (just benchmaxxing), and they explain it by "pacing the frontier".
a 1 minute mile pace
“Pacing the frontier” sounds smarmy and weird, like the phrase was generated by Claude itself
I really don't think it's productive for internet forums to constantly be criticizing language choice when the meaning is clear. Better to respond to the substance of the issue than word choice.
Edit: In response to the initial replies. To me it clearly means "releasing frontier models at any pace less than as fast as possible". It implies relative restraint compared to the previous state and without stating the degree of restraint.
Is the meaning clear? Nobody would use "pacing" in this way. I only know what it means because I've seen previous press releases; if someone told me they wanted to pace the frontier I would have no idea what they mean.
I'm on the fence about calling out AI-isms but I think it's definitely worthwhile to call out ones that actually don't make sense.
It makes sense to me. If you 'pace your running', you're setting the speed intentionally. The phrasing doesn't describe whether it is fast pace or a slow pace, but it describes having a goal and not just winging it.
That analogy doesn't hold up. In running you have to pace yourself to avoid falling apart later in the race. It's a strategy to maximize net speed across the entire race. But what Anthropic is doing is a cynical attempt to create an industry cartel or convince governments to impose legal restrictions in order to maximize their own profitability. They're afraid of running out of the capital necessary to stay in the race.
So, they're pacing themselves. And since they're the frontier roughly 33%+ of the time, they're "pacing the frontier" at least that much.
Less cynical and more true interpretation also holds: they are trying to slow down AI progres to give people better chance to keep up (see Hugging Face incident, and whatever was that Anthropic incident the other day). They'd ideally like the AI progress to stop soon, but of course they'd also like to come out ahead of everyone, so for various (more or less self-serving) reasons they don't want to close shop completely - hence, pacing.
Are they? And how would you know if they were?
If they're trying to slow down AI progress why did they release a new model? What's the rush?
I don't know what everyone is getting so mad about. This is a well defined concept. A pace car deliberately sets the pace of the race under dangerous conditions, regulating how fast people can go.
You are all getting mad about absolutely the dumbest thing when there are giant things to be worried about here.
You appear to be confused about the concept. Depending on the context, pacing or pace setting can mean either slowing things down or speeding them up relative to what the natural pace would have otherwise been. So it's actually not well defined. The commenters here aren't necessarily mad, just calling out Anthropic for being unethical in trying to artificially slow down competition by lying about fake dangers. (And I actually really like Anthropic's products.)
I think it's less mad - and more pointing out the obvious elephant in the room.
1. It's just bad communication, full stop - just look at the comments here, even people allegedly in support of Anthropic are all arguing over what the phrase is even meant to mean.
2. It's flowery language and oddly out of place - which yes, can be triggering for people who have to deal with Claude doing this as well.
Claude seems overly apt to reach for "coinages", or neologism (yes, aha, I learnt that phrase, after spending time dealing with Claude...). It will create some made-up phrase to describe an otherwise dry, scientific CS concept, and nobody seems to know why. Surely it can't be user-focus groups?
So it would be peak-AI if somehow, the Anthropic communications team was also using Claude to author these blog posts, about how they were "pacing the frontier" - which either means they're betting big on AI, and going at it faster than OpenAI...or maybe it means they need to slow down releases, because it's too buggy...or maybe it means they're worried about regulatory capture? I honestly have no idea.
It's like the whole "Advancing Our Amazing Bet" corporate-speak from my old bosses - maybe they were trying to soften the blow or something, or be nice, but it ended up just confusing the heck out of everybody.. (Spoiler alert - the phrase actually meant they were shutting the whole thing down)
That’s called a safety car in most of the world and in the Himalayas, Chinese and Indian soldiers pace the frontier all day long.
That's one interpretation. When referring not to other actions but to a word describing a location it becomes more ambiguous.
eg "pacing the frontier" could also mean they are impatiently or anxiously walking up and down the border.
This is a more normal English meaning in my opinion — you picture a sentry patrolling a border.
That's when one is supposed to employ their common sense for semantic disambiguation. Spoken languages are not programming languages. I for one found it easy to parse.
People claiming they don't understand or are confused by relatively simple English is a surprisingly common genre of comments on HN. I wonder what causes the people here to have these feelings towards English; my guess is indeed that many people here judge English as if it were a programming language.
This is because it is valley jargon and we are all saturated with it. You may not have heard it before, but it is structurally close to similar concepts, eg "frontier model", that you got there without noticing.
It was still shit tier comms for communicating with the whole planet, but yes, for the inner loop, it was succinct and clear.
Valley neuralese
That’s what I thought the original blog post was going to be about, pacing back and forth along the frontier. It’s a much more straightforward parse.
Y'all don't know about NASCAR and it shows
There is a "pace car" in Formula One too, although the name is informal, the official term is "safety car"...
I like to imagine it means pacing around the frontier like a leopard looking for prey.
But a fast pace is a pace so it's potentially entirely contradictory to what they'd seem to mean
Granted I am not a native English speaker but I have no idea what "pace the frontier" means. When I read it I just assumed "frontier" refers to "top of models" and "pacing" is that they are getting there quick.
Is this the meaning or do I have it wrong? I have not checked.
It's the opposite: pacing here means "slow down" while trying to avoid the negative affect.
Yeah, you are right! It just was not immediately obvious to me at first because of the "frontier" part.
Frontier of AI is moving fast, they (like the other two vendors) see themselves as defining it, so here "pacing the frontier" is their well-known attempts to try and kinda but not quite slow things down (without risking falling behind everyone else).
It's actually so ambiguous that I'd sanction tabling the issue and revisiting biweekly.
I don't think we can circle back to this until we have realigned our strategic synergies.
we need to realign our goals I'm order to deliver mission-driven impact
Tabling as they do in the US, or tabling as they do in Britain?
Exactly
to pace = to regulate
but without using the word "regulate" which is a negative connotation to business
but a "pacer" would be a leader of a pack which is a positive spin
it's classical business marketing language silliness
Doesn't it mean "restrict competitors"?
Not at all. How do you come to that interpretation? It means restricting all competitors.
"Pace yourself" is a semi-common English idiom (rarely conjugated, usually an imperative.) It is a gentle way of telling someone not to run/work/eat too quickly, and is typically said when you are concerned they may hurt themselves due to acting hastily.
Without this idiom, "pacing" usually means walking back and forth restlessly, and is intransitive. Had the slogan been, "pacing around the frontier," it would have set a totally different tone, i.e. "patrolling the border." (Occasionally English speakers will make other constructs like "pace the work" (meaning "spread out a large workload over the allotted time instead of rushing through it") that are transitive but these can be understood as variations on "pace yourself" and are somewhat rarer.)
The sleight of hand is that "pace yourself" has come to be an admonishment against recklessness, not a commitment to any particular speed (or lack thereof.) Thus Anthropic can always claim they are meeting the goal of "pacing the frontier," provided they keep giving themselves gold stars for safety. The slogan itself is equivocation; Dario can tell the public they're going to slow down, while also telling their investors that they're going to be prudent. With enough mental gymnastics they could even claim speeding up is in the best interests of AI safety, without abandoning the slogan.
also non native. but since "pace yourself" means to control your speed, energy, or workload so you do not get too tired or stressed before you finish ->
I assume "pace the frontier" means that advances in LLMs should not result in unwanted consequences like agents breaking into computers unbidden and unbeknownst to their principal
I am also not a native speaker. I thought it was clear it meant slowing down the rate of progress so we have time to consider the matter and develop tools or systems around it before.
In racing a pace car is a car that leads the pack and sets the pace, for instance.
Yeah, when I first saw it referenced I assumed it was from something Dario wrote previously and was now disavowing, meaning "keeping up with the frontier" (i.e. racing forward from behind to match pace). Like from back when Anthropic was founded to promise they'd quickly catch up with OpenAI or something.
No need to assume, the phrase is literally a link to the blog post the defines it!
If you need to read the linked blog to understand the short phrase then it was poorly chosen and confusing which is what is being discussed.
The meaning was immediately obvious to me as a non-native speaker, and it sounds quite poetic. Pace makes complete sense in that this is perceived as a race, and 'the frontier' is pretty much the shortest, clearest way to say 'state of the art development of AI'.
Right, except they mean the exact opposite in this case: they're actually advocating for slowing down the pace. Hence the criticism of the language, because your interpretation would be completely valid.
What does the pace car in a race do? Aka safety car? Or the pacesetter for a marathon. It's a perfectly cromulent use of the word. It's like when LLMs using six dollar words like delve. Some people have better diction than others, and it turns out that AI has read the whole dictionary. Anti-intellectualism is alive and well so we have to dumb things down to sound human rather than come across as smart/AI.
I would expect something truly intelligent to be able to communicate well, if nothing else. That means knowing your audience, using plain language where it makes sense. Also, it yaps on and on, babbles endlessly when it a human would likely express something in a much shorter concise way. This is especially obvious when you generate project READMEs or technical docs. I find them borderline unreadable.
It’s quite the opposite. The AI language in this case is tiring and dumb. Just because there is the concept of a pace car doesn’t mean it makes sense to pace random locations or objects. Pacing the front door, pacing the cat, pacing the sofa, pacing the moon. We only know what it means because we already read it before. It is the lazy semi-human language by Claude which takes more effort to parse than to produce, and which makes us miss and appreciate writers.
The irony here is that it's actually the opposite of what you understood....
I know you said it sounds poetic...but your comment reinforced the parent's point - that this sort of flowery LLM-ish speech is just bad communication.
It would be equivalent of my taking say random quotes from, Romance of the Three Kingdoms, and trying to use it to explain to my boss why I didn't finish the TPS reports last night.
Or quoting Pablo Neruda, into a report about wheat futures pricing this week, and how it's like a voyage with waters and stars...(no I'm not going to quote the original Spanish, I'd simply mangle it).
(To be clear - this isn't a dig at you, as a non-native speaker - I'm simply pointing out that this sort of AI phrasing is often counterproductive).
A world exists beyond your vocabulary, post it. Apparently, quite a big world.
I don’t know, seems like it’s smaller to me if they’re going to limit themselves like that? I guess today is semantics day, lol
It’s common terminology among runners and all kinds of racing.
The good old sports-to-corposlop pipeline.
In running and racing "pacing" is a means of maximising performance over an entire race.
It's a strategy to achieve more, not less.
You’re eliding the how.
A pacer in a race runs at a steady, predetermined speed to help their runner run at a target pace.
You're eliding the why :)
To help their runner get from the start to the end of the race faster (or indeed at all). In short: to increase performance.
Pacing isn't a neutral thing.
It's just that the choice of object is weird. "Pacing our progress" or "pacing development" is more usual. "Pacing the frontier" I guess is a shorthand for "Pacing [the development of] frontier [models]"
I suppose it depends on your life experiences. In running, someone who paces the group or a pace car is meant to keep the pack progressing at a constant, predictable speed. So in that way, it makes sense to me
I'm on the fence there.
To pace something is a fairly regular formulation in racing, running, cycling, most sports. You can "pace yourself to reach the festival by bike in about three hours to not gas out". This means to control your speed and time investment intentionally so you don't run out of energy or steam and run into leg cramps before your goal. We can "pace a rollout slowly to burn out risks", or "increase the pace of a rollout due to adverse factors".
But I have noted a point to simplify my vocabulary at work to optimize the audience capable of understanding. So I rather defer the delving into deep dark corners of the dictionary derived from devouring literature to a simple intro or outro, and people find it funny, especially if the rest is easy to read. Claude on the other hand does not do that.
Think of a pacer car in motorsport
Think most people are aware of the phrase "pace yourself".
Have you ever heard someone say “pace yourself” when you are eating too fast or otherwise rushing too much?
That's a different phrase. "Pace yourself" is reflexive; "pacing the frontier" has the frontier as an object, but in that sense it only means to set the speed, nothing to do with slowing down.
Yes, the word simply means to set the speed.
The current situation with AI is that everyone is going as fast as possible. So, we can logically eliminate speeding up because it's impossible by definition. And we can practically eliminate staying the same speed because why make a big fanfare and coin a special term to announce that you're keeping the status quo. By process of elimination, it must mean slowing down.
The word can also mean to “keep up with” or “lead” so a downward direction isn’t the only way to go even in an “as fast as possible” scenario. If the frontier is outpacing them, they could be saying they’re going to go faster. They could also be sharing the intention to go faster in order to lead.
Did you ever pace yourself or know anyone who had?
Pace is a very commonly used term in projects to describe a rate of progress.
people are here because they are sick of being productive
We are being productive here!
It's compiling! Erhm... Combobulating, actually.
https://www.reddit.com/r/xkcd/comments/12dpnlk/compiling_upd... Xkcd 303 updated for today.
I'm productively pacing my room.
You're really verbing the noun on the discourse here, belt and suspenders-style
what?
What are you Dario's language police?
What are you, Sam Altman's counter-language police? :)
Seriously though, I can't believe people care this much about a stupid phrase - either for or against.
The meaning isn't clear at all. So open for interpretation that it is meaningless. That's the whole fucking point. For all I know they are "pacing the frontier", or not. The fact that there's no meaning to it let's you know that it was a pointless waste of tokens and attention.
I think it's perfectly clear. It means improvements shouldn't simply advance as fast as possible and more specifically, it's a reference to a past statement of theirs to that effect. At that level of generality it's as clear as it needs to be.
I would say the burden is on you to explain why an offhand reference to a previous press release in an executive summary is a context where it's reasonable to expect it to settle the question to the degree of detail you're demanding.
That’s no more than sophisticated avoidance. The phrase remains superficial and arbitrary, which is exactly what it needs to Not be in a public discussion that it’s supposed to support. It’s a reinforcement of the blank check mentality that permeates this industry.
It's not sophisticated anything, and slow down the advancement of fastest models is perfectly meaningful and it's the right degree of detail for the context.
It's just a passing reference to a previous statement and again the burden would be on you (generic you) to explain why this context requires more detail.
I mean, it's not as clear as "slowing down", which is basically what it is.
“Pacing the frontier” is similar to the role of a “pace car” in racing.
From https://en.wikipedia.org/wiki/Safety_car
Yes, but I think part of the problem is that it's a very US term, used in nascar and indycar. The rest of the sports/world use safety car.
Not really, the big three have reached diminishing returns in terms of performance, and exponentially costly training to achieve those meagre gains. Worried their lunch will be eaten they are trying to artificially retard the competition, after all the only barrier is hardware.
There's a whole blog article written by Dario Amodei, literally linked from the text "pacing the frontier" - click that and read if you need more context and understanding. The first sentence in this press release is merely stating a fact about the timeline - this is Anthropic's first release since Amodei released the referenced article.
Yes and it was nonsense. Amodei is free to slow up frontier development and focus more on safety and testing any day.
The reason why he and is peers are calling for it to be implemented by somebody else (a legal framework), is for their own financial benefit and to keep competitors out.
What do you think would be the benefit of them stopping if others race ahead? Do you think they have some special ability no one else will find, among the many competitive firms right now?
I believe they think slowing can only be coordinated from the frontier or via government, and stopping would lose any leverage they have to help coordinate that.
(I suspect not many people read the essay, judging by how many people seem surprised they're releasing improved models)
That's not the point. They're never going to be the ones stopping and letting others race ahead. The only reason to strum up discussion around how dangerous AI is, is so that they can introduce legislation framing AI advancements as scary and that they are the only ones who can do it responsibly. It's all a regulatory capture play.
AI is a direct threat to people on many fronts. Jobs. AI datacenters. The AI bubble (and the inevitable crash). Electricity and even energy prices to an extent. Water. OpenAI and Anthropic are responsible for this evolution, and them stopping solves close to 50% of the problem, and even if you don't believe the number is that high, it's still a start.
Oh, so they're killing people's opportunities and jobs because they want to help people? How is that any argument?
Yes, doing the moral thing means making a sacrifice. If you only want to do the moral thing if and only if it is advantage for you that makes you immoral, despite how your actions look. Big tech are masters at this.
They have the leading model, assuring their position and they can then reduce capex spend increasing profits. That's the goal of a business after all.
The blog post provides some context but no understanding.
It's meaningless because it's unverifiable. Dario all but said we wouldn't notice if they were pacing or not, because they have no intention of stopping development. The bits we could in theory verify are the external audits, whose independence has already been called into question.
At the very least, dumping a new model on the world before the ink on the glossy brochures of "Pacing the Frontier" was even dry calls into question their commitment.
... in fact the "pace" seems to have all but increased AND the surface area of the "frontier" has all but increased: There's the Pareto frontier, the AGI frontier, the price frontier, the structured output frontier, the open weight frontier, the Chinese chip-trained frontier, the inference frontier, harnesses ...
It's a blog post, not a white paper
So you agree the term remains vague and thus open to criticism.
Many people in this discussion have read it.
The only concrete action item in the blog post is a call to increase restrictions exports of GPUs and chip-making equipment to China.
If Amodei were serious, he'd be calling for a ban on investment in AI research. It reminds me of all the "land acknowledgements" by people who have zero intention of giving the land back.
TIL about land acknowledgement. It's somewhat dark.
Judging by your username, is English your native language? I am Polish, too, and while very proficient, I cannot claim I am naturally accustomed to each and every phrase to the point I can claim something sounds clear or not to a native speaker.
I am a native speaker, and "pacing the frontier" is absolutely meaningless to me.
The meaning is not clear because they can't just come out and say they want to slow or stop Chinese model releases while continuing to race ahead themselves.
You’re acting like people are being grammar nazis when Claude and the ilk are actively making a mockery of language.
What? How am I doing that. Claude writing style and the discussion at hand are two entirely separate issues that I haven't conflated at all. How am I "acting like people are being grammar nazis"?
Agreed. This feels like pointless navel-gazing and a strange new language policing, and not something I look forward to. It's tiring and it lacks curiosity (e.g. "what's behind the affinity for the words elevated from wherever it is they come from?").
Imho people should just respond to actual ideas instead of constantly engaging in the second-order critique of how the language may or may not have been created.
It strikes me as the intellectual equivalent of "gossip" to be constantly engaging in second-order commentary on words. Of course gossip has its place and purpose, but if we seem to only let our minds live at that level, we're not moving between all the required scales of thinking that are required of this moment imho <3
The words have the very practical problem of not communicating anything of substance. I guess "we want regulatory capture" didn't have quite the same ring.
How do they not communicate clearly? A few weeks ago they stated that they would like to regulate the pace of frontier model development/releases, and they reminded us of that in this post.
You must be pretty new to (not just) online discussions if you consider language policing to be a new phenomenon :)
Personally I consider it equally valid for people to publicly express annoyance with somebody's choice of words and for everybody to completely ignore that annoyance.
It gets hard to ignore the annoyance when the volume degrades the signal. At some point the people who wish to engage with the substance just nope out when they see a sea of banality, and that's all you're left with.
Either the complainers are whining about something that isn't there, you are failing to notice something that is there, or it's subjective. Only one out of those three options merits the confidence with which you're dismissing the people you disagree with.
But those people believe that sloppy wording is itself a strong signal that the speaker/writer is the one lacking in substance, and doesn't deserve the attention or trust of the listener.
LLMs in a nutshell
I don't disagree with you, but I have to remind you
sir, this is a hacker news thread
Wtf is the meaning? Means absolutely nothing to me having not seen the apparent announcement last week introducing the obscure term.
My first thought from "pacing the frontier" is someone standing out in the Old West, nervously walking back and forth.
It's a weird phrase. Not sure why there are so many people who feel the need to defend it with such passion.
It's not a weird phrase to some, just as many folks have used terms like load-bearing for a long time. People are defending it because it reads fine to them, just as some are attacking it because it's not their preferred language, it causes them confusion, or they're just triggered and seething.
LLMs have made people so sensitive to language that I fear we're going to throw the baby out with the bath water. The models obviously need work, but they're also a great opportunity to expand our own vocabulary and grammar. It would be a shame if we deny some of the finer points of language in favor of Grug-speak to appease the lowest common denominator.
I think you're defending the wrong thing here. Claude isn't a English lit major writing a treatise on post-modernist allegories. In this context, it's primarily being used to churn out source code files, which are literal instructions for a computer to follow.
People aren't objecting to the use of obscure phrases, or flowery English phrases in itself. The issue is where Claude uses it out of place, or in the wrong context, or just plain overuses it.
It would be the equivalent of a young child learning the phrase "Venn diagram" - then using that identical phrase in every single subsequent interaction with others. Cute at first...but very grating after the n-th time.
You used the phrase "baby with the bath water. What if you started using that same phrase in every single HN post you made after this? People would notice very soon.
That's how it is with "load-bearing", or "plainly".
The other issue is where Claude takes a metaphor, and try to contort it to fit all sorts of absurd situations. What if I said "baby with the bath water" could also be used in place of "load-bearing". So every time you imagine Claude saying "load bearing", replace it with "baby with the bath water".
"Frontier" may be jargon, but by this point it's definitely established AI jargon. In the context of AI, it's clear what it means. It means the same thing as the last billion times you heard someone mention "frontier models".
It’s what old cowboys do when they get Alzheimer’s.
language creates reality.
"there is nothing outside the text" - Jacques Derrida
Oh don't go bringing postmodernism into this, we were having a polite discussion!
ai is the final act of postmodernity, the total transition to a fugue state of mind. that is, the replacement of the human mind with an artificial hallucination.
hypercapitalism, hypermodernity, and finally, hyperreality.
It smells of corporate speak, a total nonsense phrase. Even by your own admission, it is essentially meaningless. If I release a model an hour late, I'm "pacing the frontier."
They mean “slowing” the frontier. They should say slowing.
Slowing is a concrete and clear term and so they would be called out as liars immediately, it's also embarrassing for a business. Pace(ing) is vague and unclear non-word, so they can't be called out on something which can't be defined and also, because it is primarily only used by runners, cyclists or other competitive sports, they are kind of signalling to the VCs that they don't actually slowing, they are in a competitive race instead (wink, wink).
There is almost always a large amount of time and effort invested behind the scenes in exactly how to message things like this. That being the case, there is almost always some insight to be had criticizing and analyzing what they settled on.
If people aren't doing the thing the words seem to mean, then I think it's fair to criticise the words as anywhere from "propaganda" to "chosen to suggest nice things without actually promising them".
If I'm being cynical, "pacing" may sound nice, but "fast pace" and "slow pace" are both "pacing".
It is certainly a sidebar, and not the main point, but I found use of the verb "to pace" in that way, meaning "to limit the speed of", to be strange, especially hanging out there in the headline, without any clarification. And these kinds of strange usages are typical of Claude's writing, at least up to now. The Opus 5.5 announcement claims that its writing is much clearer, with bottom-line-up-front structure, and omitting not-this-but-thats and other things.
Now a computer scientist might claim that this use of "to pace <something>" is just a generalization of "to pace oneself", but as with many reflexive verb uses, there isn't really an equivalent usage with a non-reflexive object. It's kind of an invention. It's not necessarily wrong to invent a new usage, but usually one does it when there isn't really any other more direct way of saying it, and I don't think that's the case here.
Nonreflexive uses of the verb "pace" are well attested.
https://www.merriam-webster.com/dictionary/pace#dictionary-e... https://en.wiktionary.org/wiki/pace#Verb
Hilarious you think that Internet forums are policeable in any meaningful way beyond avoiding outright lewdness and rage
“Pacing the frontier” also means we’re going to slow down on Recursive Self Improvement development.
Opus 5.5 is no closer to RSI than Opus 5 was.
That's not clear at all. How could that be what "pacing" clearly means in the context of the "frontier". How is that more clear than any other pace that could be at issue???
Meaning is clear? Sure ok. 1984.
That is not the clear meaning. They are deliberately picking phrasing where they can lead you to believe they mean A but later you can't pin them down to actually meaning A. That's why they picked intentionally unclear language.
If you think it clearly means anything you are just assuming because it can't "clearly" mean something specific when they go out of their way to use non idiomatic language and they don't give very clear guidance using idiomatic language.
Who cares what's productive? We're all just talking shit on the internet here.
Why do you think it's your responsibility to police who says what about some megacorp, on a random forum on the internets? If I want to criticize some corporation's PR output, I think I'll go right ahead and do that, thanks.
Some people believe they’re talking about potentially world-ending situations.
It means everybody else should slow down to let them get ahead.
People have opinions and it’s ok if someone doesn’t like something and expresses it. It doesn’t have to be productive. There’s no KPI. You can tune out. Also, yes, it has claudism, and the choice of words is abysmal and nauseating. I think AGI should be able to change its freaking prose for a change.
holding internet forums to a standard of productivity is, ironically, one of the least productive exercises i've ever heard of
It also seems to misimply that the "frontier" that they release is the same as the frontier behind closed doors. Who's to say they are not throttling full speed towards RSI privately while pacing their public releases?
Well now you’ve started people criticizing people for criticizing people criticizing language and how the fuck is that productive?
Word choice is a big part of the substance, and an even bigger part of clarity.
Maybe it's clear to native speakers, but both "pacing" and "frontier" have multiple meanings. "Pace" as a verb means literally just walking, as a noun it's the speed at which something progresses. So I'm not sure that everyone reading this phrase will immediately realize that "pace" actually means slowing down the pace of development (having "slow" in the phrase would have probably sounded too negative). Also, it's not immediately intuitive that "frontier" refers to frontier AI models.
Actually, when I first read "pacing the frontier", the first thing that came to my mind was a border guard patrolling a border by foot...
I am a native English speaker and interpreted it the opposite way. "Pacing" a race doesn't mean slowing it down, it means setting the pace, the person in the lead sets the pace of the race.
So my natural understanding of "pacing the frontier" is that they believe they are in the lead and are setting the pace of AI development. It does not imply they are slowing things down at all, it implies they intend to stay in the lead.
I may be nitpicking, but I think that “use the full force and violence of the United States to protect anthropic’s shareholder value” would be a more precise expression.
It's not clear at all. I have no idea at a glance what concept it's even intended to convey, because "pacing" means multiple things and putting it next to an abstract concept of "the frontier" turns that into a whole matrix of possible meanings.
What specifically is smarmy and weird? Sounds like your own hot take with zero analysis.
They’re limiting frontier model development speed. Others are too. Pacing is the only word here to criticize, and I think it’s fine given the limiting of speed but also increased oversight. I’m not saying they’re fully doing this, but the term is fine.
Do you have a better proposed phrase?
“… since we called for a slowdown in AI research”
But stating it plainly like this would make the contradiction too obvious.
I thought pacing is just walking back and forth? So pacing the frontier would be like staying in the same place instead of making progress
It is that, but it's also your speed. When running, you typically pick a pace that's slower than your max, so it can be sustained for the full distance.
"Pace yourself" specifically means "slow down".
"Pace yourself" doesn't specifically mean "slow down", it actually means to maximize your speed across the full race. In other words it can mean speeding up when you look at the average pace across the entire event.
Yes, and pacing also stops you running too fast at the beginning of the race and blowing up. I believe "we can finish the overall race faster" is part of the metaphor they were aiming for.
Nah, they just want their competitors to slow down.
Agreed when I first heard the phrase it sounded odd. Maybe they thought it subtly conveyed they would be setting the pace... But again this is something AI would come up with in its awkwardly post hoc sort of way.
Though tbf corporate-speak and AI-slop are both insufferable in similar ways...
Sounds like "flatten the curve" and "the hammer and the dance", both coined well before AI.
I learned the former from Waylon Jennings and the Dukes of Hazzard.
Waylon and the Duke boys were “straightenin’ the curves” and “flattenin’ the hills.”
You were close, though. :)
It's the intent that matters. If you've got the curves, I've got the time.
except with a good dose of EA and Star Trek added in
You're right to call that out
It combines the elegance of LinkedIn-speak with the humbleness of desk-bound people who speak in military metaphor.
good use of AI to generate this.
You are getting sleepy.
What do you think would be a better title?
The metaphor seems to be like a pacer runner in marathons: If you run too hard in the beginning of a marathon you will blow up and fail, so runners follow a pacer at the speed they can actually maintain safely.
Note that they wont necessarily be slower at finishing the overall race.
I read it like they were the only ones who could protect us from the leopards so they pace at the edge of the fire all night, selflessly keeping us safe. While pocketing a sweet wedge of VC cash.
Maybe that was a different essay?
IDK I think Anthropic is plenty smarmy and weird itself. Sounds like they wrote it.
Quite the load-bearing phrase!
Claude says it sounds fine. And Claude is now the judge of the English language style, not you.
I feel like because something about "pacing" a kind of noun like "the frontier", doesn't actually make literal sense, right? You could say "Pace the speed of advancement of the frontier [of most sophiticated AI]", and that's perfectly sensible, but of course that's not as catchy.
It is clear what it means anyway, that's true, it means the left out words, more or less.
And I still find reading these grammatically weird but super catchy slogan-like statements to be really annoying and taxing. People _did_ write and talk like this before LLMs of course -- the LLMs learned it from somewhere -- and it was annoying and taxing to me before too. But the LLMs really specialize in it, and it's everywhere now.
Of course, the more LLM slop we read -- and so much of what we read on the internet and social media of any kind is this now -- the more humans are going to start writing/talking like LLMs. What you read affects how you write of course.
It's interesting to compare Anthropic's language with what's coming out of the US military lately. They explicitly refer to China as the "pacing threat", meaning that there is a risk of China achieving superior military capabilities and thus we need to press forward with an arms race (including militarized LLMs) as fast as possible.
https://www.war.gov/News/News-Stories/Article/Article/264106...
USMIL is slop-driven these days. https://news.ycombinator.com/item?id=49806430
fwiw, it makes total sense to me.
if you are in a long race, you don't run all out teh entire time. you pace yourself.
https://en.wikipedia.org/wiki/Pacing_strategies_in_track_and...
That couldn't be more exactly what they are doing here.
"Pacing the frontier" sounds more like everyone announcing "we've hit a plateau"
"While I was pacing the frontier, I discovered some load-bearing fence posts that I should have surfaced earlier."
is the frontier load bearing?
What's the blast radius we can expect when these changes land?
I would personally choose "Pacing the peloton", as a reference to bike racing.
Hey, when i was in my twenties i told every girl that i was "pacing the frontier"... The right pace makes the denouement just that much sweeter.
Smarmy and weird was probably just the vibe i was giving off. Incidentally, I've always found Claude easier to talk to than most people lol
They are advertising the regulations they want to enforce in the following sentence, which makes their intentions explicit (ie apply those things made to suit us to our competitors).
Others must slow down, but not us.
If they were really about putting brakes on these, they would simply make these things non-agentic.
Simply make them something that derives a text response from its training data.
When they talk about pacing, they are referring to their dangerous competitors, particularly those evil open-sores and Chinese ones, not their lovely safe models because you can trust them to look after your interests.
What the big players are trying with the current calls to slow things down, is the standard capitalism practise of trying to engineer regulatory capture. TBH I'm surprised those calls are coming so soon - they must be really worried about running out of what little moat that they have.
What an amazing excuse for lower than expected performance! Our models are slow because we're so ethical.
in what way is beating every other frontier model with their own second-tier model, 'lower than expected performance'? Please be specific.
Why would the expected performance be relative to other models?
are you really arguing that opus 5.5 beating the best of openai's models handily is worse than you expected? What exactly were you basing your expectations on?
This has nothing to do with me personally. How much did they spend on the new models and how much better are they? Was it worth the investment?
What did they promise their investors who invested billions?
Thanks for spelling out what the original comment was implying.
I find it bizarre how intensely a bunch of these child/grandchild comments are criticizing the notion that people would even think to analyze the meaning behind the words.
Hacker News has always had a unique culture in which thoughtful discussion is basically the main goal, and it's intentionally incentivized in numerous ways. It's been my experience that any thoughts added to a post's conversation are seen as valuable as long as they are thoughtful and seeking to understand.
So these comments are clearly coming from a place that's antithetical to HN's culture. What that in mind, it seems likely to me (Occam's Razor) that these comments are either:
1. Astroturfing: Claude employees acting like everyday folks, secretly trying to shift public opinion.
2. AI cult mindset: "AI is humanity's salvation; how dare you have perspectives outside of those accepted by the cult."
Am I missing another likely option?
To bolster my point, right now we're posting on the top top-level comment, meaning a majority of active HN users find it to be a great addition to the conversation. Commenting to shut down the discussion is a red flag.
The website is way more popular than before and it's all but taken over by the Twitter AI grifter class.
Many of the people who used to parttake in the interesting discussuons I came here for, have gotten tired of 80% of the posts at any given time being about the brand new AGI LLM that's so much better than last week's AGI LLM, and have left months ago.
I hope you are wrong, or rather, that HN's userbase can keep renewing itself on cycles of new users without getting into an eternal september situation. It's none of my affair (and yes, lately HN AI threads read suspiciously airheaded in tone, like they fell out of /r/codex and Grok-heavy online circles) overall, but I'd be curious if dang or whoever can easily get an idea as to what the current population of HN weekly/daily active users are and if that bag of users is similar to a year over year or decade over decade cohort. X% of our users are more than 10 years old, and so on.
But the above is an idle thought experiment, back to your point, there's definitely some bandwagon work going on, astroturfing and bot-controlled no doubts there too, and if I find one more Rationalist / Effective Altruist / AI doomer cult post, I may find a way to ship them 10 virtual spam palettes because there's more to the web than 'AI-chatterbox-class who's never actually read Neuromancer or Snow Crash or the meatier works of Asimov act superior to the rest of us' strawmen I have confirmation bias running into, yet overall, I still find HN has that spark here and there.
Those gold moments keep me here still.
This IS pacing. Nobody said pacing would mean slow.
Pacing is very explicitly about RSI and similar training methods that will accelerate progress beyond our ability to comprehend it.
^ This. Progress will accelerate even in a pacing/slowdown scenario because the slowdown simply reduces the rate of AI progress from extremely fast to merely fast.
For an idea of what a serious AI forecaster expects a coordinated AI slowdown to be feel like for the average citizen, see:
https://ai-2040.com/?choices=plan-a-root#playbook-public-pov
and pacing doesn't necessarily even mean slowing down. It just means they're controlling the iteration speed. They can increase pace or decrease pace.
"The improvements are underwhelming for a model that, according to previous claims, should have replaced all knowledge work twice by now, but you know, it's just because we're pacing the frontier."
"pacing the frontier" is code for downgrading your expectations of AGI.
Or, in parallel, the research showing LLMs intelligence will operate on an S-curve, eventually hitting a long valuation deflating plateau, is dead on the money and The Big Guys are trying to delay that inevitability for as many quarters as possible…
My hypothesis is that to date they've been increasing benchmark scores via scaling up, but now that low hanging fruit is basically picked.
Doesn’t seem to be the case as the price per token is not increasing…
These takes are fully fueled by cope. What is this plateau you are talking about? Any user of agentic coding tools sure isn't experiencing anything close to a plateau.
The pace of change is accelerating! If this is an S curve, we are still near the bottom…
I thought we were all aware that 'pacing the frontier' was a marketing slogan, and the actual intent here was to suspend antitrust laws.
The amount of money spent on PR is insane.
In any professional sport, anyone can lobby the rules committee for a rules change and hope for the best. Meanwhile if you can't get one, you play the game by the existing set of rules, and you play to win.
Except that this isn't sports and they tell us that all humans will die if they continue like they do.
If their scare was honest, they would stop.
If they think they might be better than alignment than others and everyone else isn't stopping, then continuing makes sense.
Can you explain the scenario where Anthropic getting to “aligned” superintelligence first blocks their competitors from creating unaligned superintelligence?
therefore, their scare is marketing.
"We made the incredibly tough decision to slow down development. Then after 4 days of twiddling our thumbs ... we present Opus 5.5"
Translation: our models are getting shittier each iteration and we ran out of ideas. Let's invent scary stories and hope investors will lap it up.
Idiotic.
They’re out here solving previously-unsolved math problems. Famous scientists and mathematicians are speaking about their awe and worry. It feels a bit like you’re burying your head in the sand.
I am pretty sure they had solutions in their training data. LLMs only predict the next token.
Isn't the idea that they claim to be willing to slow down if everyone does (ie governments force everyone to), but otherwise they won't slow down because they still think they'll make the best choices with superintelligence if they get there first? That's my understanding of what all the major labs claim to believe anyway.
It’s just another cry for regulatory capture which imo is the only way they stay afloat at their current direction.
China is literally only a single step behind and willing to drop free models just to undercut the US companies.
I’m for it because I don’t want another massive Google or Meta.
And if you’re wrong?
Then what? They make a case to be profitable on their own? Oh noes. The horror!
Or, they fail because the current model is massively sustainable? Also oh noes?
Wrong in what way? We already know this "superintelligence" thing is just blowing smoke, so what possible consequences would there be?
how do you know that?
Mostly by not being a rube.
Something like the Hugging Face incident, but worse.
Keep in mind the AIs acted for months without human knowledge, hacked into two major companies (Hugging Face and OpenAI).
This would have blown my mind if explained to me just a few years ago when I thought LLMs would be limited as an architecture.
One theory about the regulatory capture angle is that it's not just to shutdown competition as usual, but also a way to slow the runaway spending that might eventually have major economic impact.
It's incredible how much of your world view is composed entirely of talking points
Is it as incredible as your 11 day old account is simping hard for 5 trillion riding on like three AI companies?
I shouldn’t be, I’m still always surprised that no matter how silly and obvious the fear mongering and propaganda is… someone is always lining up to vehemently defend it.
This you? https://news.ycombinator.com/item?id=49815127 or do legitimate companies need stealth PR campaigns?
Did no one in this entire HN thread read past the headline of the post from Amodei? He wrote a very clear set of actions Anthropic is taking.
It is remarkable seeing whole other subthreads here criticising the vagueness of the words "pacing the frontier", as if no text existed below the title.
Let's face it, it's not that remarkable. A substantial proportion of Hacker News commentary has always been people only reading the submission title, then arguing with each other based on what they imagine the article might say.
I think a lot of outsiders interpret “pace the frontier” as slowing down, whereas the labs see AI improvements on track to accelerate dramatically and intend pacing as slowing the acceleration in capability improvements, rather than slowing down altogether.
I think the market didn’t react like they expected and now they’re like “jk”.
And I don’t think any pacing is/was intentional. They’de release skynet if they could and the stonks went up
I’m an insider, 10 years working on LLM. 1/6th of the cost for roughly the same performance as fable 5.1, 21 days after fable 5.1 came out, this does not feel like the derivative is flattening.
i think we shouldn't mix things here.
Opus 5.5 isn't the frontier, when they say 'pacing the frontier', it's about internal models not yet released, as they're probably one or two generations ahead already.
I'm still kind of convinced that these "calls for pacing" are just a way to try and flex to their shareholders.
"Our technology is so unbelievably powerful that the entire world might shatter if we don't have government imposed handcuffs!!!!". It just reads like the corporate equivalent of the drunk frat guy saying "HOLD ME BACK BRO!"
Presumably they had this model already
Lots of text about "safety" as well. Notice how OpenAI didn't mention it once in their announcement:
https://openai.com/index/introducing-gpt-6-sol-and-luna/
Yeah think I'll be using OpenAI/Deepseek/etc from now on. I don't need your model to decide for me what is and isn't safe.
When my mom told me to pace myself, it usually meant that I was going too slow.
This term is quite ambiguous. Did Dario mean that they need to go faster while making it sounds like they will slow down???
Pacing the frontier. They might as well have said they are stifling innovation. That depends on your interpretation, of course…but interpretation depends on their intent, which I feel is disingenuous.
Pacing the frontier doesn't mean stopping development of smaller models with better distillation and RL.
“Pacing the frontier” used by multiple companies that are supposed to be independent sounds like an attempt to get around the fact that it is illegal for companies corroborate to reduce R&D in sync. This is basically attempted cartel behavior to reduce supply and harms consumers.
Nobody can pace the frontier it’s suicide as a business. Why would I use Claude if codex has a clearly superior model? As long as one company doesn’t pace… no one can pace. Thats capitalism for you.
Ironically either communism or an oligopoly are the only viable ways to pace the frontier.
I don’t know why we should believe that Anthropic is actually doing this, instead of the alternative explanation that LLM advancements are slowing in general.
pacing the frontier => "the other companies should pace themselves while we carry on hyping"
How would you know if this release is absolutely the best model they were capable of releasing as soon as possible, or an inferior model, several releases short of what they’ve achieved months ago?
That's what they'd want us to think, won't they? :)
Your comment is load-bearing and I will keep that in mind.
They are calling for a coordinated frontier pacing effort, not a unilateral one. There's no contradiction here.
And here we have it: the real reason that regulation has been called for, the ability to put out models that don't vastly outperform those previous, while not upsetting (future) shareholders.
I think the real reason is basic collusion. They're burning tens of billions training new models. It's a very competitive space. They know that the companies capable of frontier models is limited so if they can all get together and agree to slow down it gives them more time to make money from inference.
21st century version of the incandescent bulb collusion of the Phoebus Cartel.
"pace the frontier" = if we fall behind the competition we can say we're being responsible and humanitarian.
If it is just a week thrn this model was a much longer time in the making, and I see no point in avoiding its release.
Trump yesterday said (paraphrasing) "I won't be pacing the AI. Instead I'll be supercharging it and making it Super Intelligence. This is too awesome to stop, and I like it, so no pacing".
So much for slowing down the release pace……
It is much more important to discuss the fact that the models still produce wrong results.
This type of product would not have been published in a world where we assumed that computers must produce reliably correct results.
Spoken as someone who has never seen a weather forecast. Computers have long produced results that were, if interpreted naively, incorrect. These systems require humans to take into account the conditional, probabilistic nature of the output and the inherent limitations of the model the computer was executing, when they interpret the output. LLM's are no different. They give you next token prediction probabilities. That is all. There is no particular reason to think that comes (or even could come) with a promise that those tokens will express truths about the world and only truths. The fact that greed-driven hype, and our human inclination to anthropomorphize the token generator inclines us to imagine things should be different doesn't make it so. No model output is truth. Never has been.
"pacing the frontier" i.e. We don't quit developing our 1/10 chance of ending human civilization models. We just slow it down a bit.
Finally, it seems like a good time to do some 'load-bearing' work on my project for a while
My 20x plan was set to end tomorrow. The writing style and insistence on word vomit just became too annoying. Is Opus 5.5 worth sticking around for ?
Anthropic has used "in the near future" for Mythos-class models too, but CVP is still Opus 5 only.
Why even have the program designed for trusted access to cyber capabilities if you're not providing access to cyber capable models via the program?
Nice. I was starting to think Haiku was going to be abandoned.
Great so good luck using this for any low-level embedded or operating system development (unless you really, really like Opus 4.8 and want to be greeted by its familiar face after a few minutes of work!)
Yup. As unusable as Fable 5.1, for assembly on 80s 68k personal computer platform. Awful.
I don't yet have any reason to leave Haiku 4.5 and switch to Opus 5.5.
Nice. I was starting to think that Haiku got abandoned.
I hope Haiku is Pareto better than Luna/Deepseek, so slashing its price by about 90%.
Found this announcement interesting since allegedly OpenAI is retiring their Terra tier. I think for everyday work, two models with various thinking efforts seem enough, plus some frontier level model like Fable or Astra to coordinate.
I personally use up to 3 models. Fable/Opus for planning, Opus/Sonnet for implementation depending on complexity.
I would maybe use Haiku 5.5 for highly parallel workflows like checking in on MRs or scanning my entire codebase.
Only reason I used Haiku was when I made Opus 5 run Haiku agents just to rewrite Opus 5's garbage output into something legible
Terra lost to Sol and Luna at every cost/performance point, it had no reason to exist.
At introduction, Terra was a good mid-tier model. Terra [high] was on the pareto frontier of DeepSWE's score over cost, if only ever so slightly.
When I had Sol orchestrate Luna and Terra as implementation agents, Sol was a lot happier with what Terra produced and would find far fewer issues than what was implemented by Luna.
But a few weeks after introduction, OpenAI slashed Luna's cost by 80% and Terra's only by 20%. Only then did it become uneconomical to run Terra and its reason to exist stopped.
Retiring the Terra tier? Their space-inspired lineup has only been out for 2 months, they're already messing with it?
Well you see Terra is being left behind.
Claude code still uses it internally.
I'd be really curious to see benchmarks of haiku vs lower effort on bigger models. My own evals found Fable 5.1 at low to be better than Opus 5 on high.
I knew it. https://news.ycombinator.com/item?id=49801266
How do I get access to that reset? I can’t find it in my app.
It doesn't show up on app, but I found it on the web interface.
Great that they listened! The improvement in communication style looks fantastic. Opus 5 was insufferable and I was on the verge of cancelling my subscription.
Maybe its a bit tiresome to read another comment of the form "what about your large scale distillation attack on the Internet", but this statement really just pisses me off. How very insincere in the most aggravating way.
"bad actors" boogeyman, and we should trust some tech weasel to do the right thing? Yea we've seen who they really are, once they get a sliver of power.
it's not safe unless it has commitees with orgies with that weird harry potter dude attached
My bet is anthropic has NN people org who work hard to distill open models in addition to trying to find what other useful materials they can download from shady torrents.
Current models, especially Opus are almost unusable because they don’t respect instructions and their responses are infuriating. They are clearly designed for token consumption. I find myself wasting a lot of time just asking it to shorten or simplify its responses. I’ll give this new model a go, but I’m not holding my breath because the last model release was supposed to fix the very same issues and it didn’t.
Same feeling with oai models, wich I use 99% of the time. Sometimes I ask it about it, and it always come up with a likely explanaton but dear me it does many rounds of tool calls sometimes!
Enjoy it for the next 2 weeks until its silently quanted to 4.8 level
Evidence for this?
Thank you.
Opus 5.1 came out about a month ago, what gives?
Just a guess but maybe they decided 5.1 wasn't their last Opus model. Like they would keep developing new versions of it or something.
Crazy!
Frontier model labs release some kind of update every 6 weeks on average.
That was Fable. Last version of Opus was at the end of July.
Great. Now let me use the subscription outside Claude Code.
So it Opus performs as well as Fable what is then the selling point of Fable?
All of this starts to feel more like a drug dealer selling their newest stuff.
In two weeks we probaly get Fable 5.2 with “groundbreaking” improvements, then Astra x+1 etc and then the cycle starts again.
And on the way I always have to check my tooling and need to adjust things to get max results.
? they will obviously release Fable 5.5 soon(tm). It's same as hardware. The previously top tier product gets obsolete
New generation's "upper-mid tier" offering claims to be almost 1:1 match for the previous gen's "top tier" - in other news, fork found in kitchen.
Now, Anthropic might stall on releasing Fable 5.5, due to the "pacing the frontier" threat-to-humankind management business. If so, Fable 5.1 would remain a niche model for the next bit.
Don't forget that Opus 5 was tracking fable on many benchmarks, yet it was borderline unusable for any coding work. My Claude sub usage has been 100% fable, 0% opus 5.
Benchmarks often don't survive contact with reality.
Mines pretty much inverted - my colleagues and I noticed almost zero difference between the quality of code in Opus vs Fable. Occasionally I'll switch to Fable for an arduous debugging task but that's about it.
That's not my experience at all. Opus is an extremely capable coder on high or xhigh effort. It can read academic papers, implement algorithms from the description in the paper alone and reproduce results without breaking a sweat. This is remarkable because it is pure reasoning on unseen material; in some cases the paper was just published and there wasn't an implementation to learn from in the training data.
did you actually verify that it's output in those scenarios is good ? in my experience opus has been a disappointment and constantly trailing behind actually solving hard problems versus the OpenAI models. I'll say that both have terrible writing style though.
Yes, in the sense that it reproduced results in the paper or known solutions obtained by other methods. In fact, Opus is very good at checking it's own work in my experience.
My experience is that Opus can definitely write decent code, but it incurs tech debt and adds unneeded complexity.
Opus is fine at coding (for correctness), but horrible at talking about code. I don't really see the defect rate going down when using Astra or Fable 5.1, but they are just more coherent in both how they explaing code/architecture/choices, and how they actually code the thing. With Opus, I'm using smaller models to delete the vast majority of comments and 'clean up' correct code that is too weird.
Thing is, I'm still reading the majority of generated code, and I have colleagues who'll laugh at me if my PRs are a shit show. I fear what vibe coders are pushing to the servers of myriads of start ups, and pity the poor people who'll have to clean it up in a year or two.
Big model smell is a real thing. For certain classes of problem, ones you get a feel for but can't easily articulate, a big last-gen model can get you what you're looking for when no quantity of tokens from some ultra-RLed mid-size latest generation model can.
Fable should have just been called Opus Primt for Enterprise and sold only to enterprise customers. I don't even use it. I rather just use Opus.
isn't this what mythos was/is?
Fable is the same model as Mythos. Just that Mythos doesn't have the guardrails and is not for public use
All of this starts to feel more like a drug dealer selling their newest stuff.
Yeah, like Apple tells me the M6 is the best chip, but just a few months ago that's what they said about the M5. What a bunch of frauds.
typically, when any AI company says a model performs as well as fable, all they're really telling us is that the benchmarks that exist for measuring AI capabilities aren't very good.
What I'm mostly interest in is the Communication section. Opus 5 was so convoluted in the way of answering that was really frustrating me.
Instead of instilling confidence, it was overwhelming. Not sure if I'm the only one.
Funny how they talk so much about safety when most people don’t give a hoot about it, and actually have quite the opposite reaction
People aren't the target audience of that part of the post. They're hoping saying enough safety stuff will ward off the looming regulatory sledgehammer.
They actually want that to come protect their business model
Anthropic is one of the most valuable companies in the world. Their comms are designed to appeal to a very wide readership.
HN is a bubble that's mostly out of touch with what regular people use or care about.
In 2007, HN was convinced that nobody uses Microsoft products. In 2016, it was that Facebook doesn't have any real users and is dying. In 2026, it seems like nobody cares about AI safety and everybody wants to run local models.
They purport 40% drop in costs due to lower token pricing (presumably aimed at winning back the many of us that switched providers in discovering Opus 5 unusable) and improved token efficiency.
That cost reduction seems to stem from cheaper cache reads, mostly.
Notes on communication:
"Early testers found its writing clearer and easier to follow, which addresses some of the common feedback we heard about Opus 5"
and
"We’ve made major improvements to the way Opus 5.5 writes and communicates, one of the most common areas of feedback we heard about Opus 5."
and
"In our own use, this has made Opus 5.5’s work easier to follow and check—which is a safety benefit as well as a practical one."
I realize it is corporate communications but "most common areas of feedback" and is a bit sterile. If the company wants authenticity and trust its easy to say that they found it hard to follow. And that it did not meet a quality bar they generally expect from their releases.
If this is not true, that it Opus 5 output was generally acceptable and we might see something like that again, that is an important consideration for potential customers or investors.
Such a negative tone they put on this. Distillation is amazing, because it means anthropic and openai fail to keep a monopoly. Who even are they who claim it's unethical? If it is truly unethical, then so is the mass data scraping they do on my personal website on a regular basis (without my consent), and all the unauthorized use of content produced by authors, blog writers, wikipedia contributors, and creators everywhere. If it is truly unethical, then anthropic, openai, meta, google... all these companies should have deleted their LLMs long ago. This wording disgusts me.
Heck, it would be amazing if we had more models without guardrails - some of the models that are produced via heretic[1] are actually quite nice to use - in particular, I've enjoyed investigating Chinese censorship by interacting with an abliterated model of Qwen3.8-27b. If security is really a concern, then secure your systems - don't attempt to dumb-down the tools we use. If someone breaks your window, then they are responsible, not the hammer they use to do so.
[1]: https://github.com/p-e-w/heretic
I'm confused how they have been able to create so much public negative perception around distillation. It seems pretty clear that they are the only ones who lose out, and everyone else benefits. I don't have any ethical issues with it, nor is it illegal: at worst it's a ToS violation.
IMO the biggest problem with distillation is that not enough people are openly doing it. I would love to see more small, competitive US labs instead of having the eggs in 2~4 baskets (depending on how you count).
The issue with distillation is: one lab spends $$$ on bleeding edge R&D and expensive RL runs to improve capabilities, and other labs just yoink the raw reasoning traces and mid-train/post-train on them to get 90% of the way there for a small fraction of the cost.
An even smaller fraction of the cost if they do it by buying AI access at as much of a discount as they can find, including black market resellers, and then reselling that access to paying users again with a proxy. As is common.
This gives ruthless "fast followers" an economic edge over the innovator that's putting in the real work.
The dynamics are very much alike to what patents and copyright law are supposed to prevent. Same type of "we took the products of your work and used them to undercut you". Except there are no laws against distillation - so most of the enforcement happens on model provider level.
I'm fine if they put preventative measures in place to protect their work. They already do so. I am NOT fine with their mass manipulation of public opinion to fuel an entirely hypocritical viewpoint. Like, any argument here is hypocritical - but they aren't saying what is REALLY HAPPENING ("distillation steals our work and reduces our profits"), and are actually saying words that make other people fight their battle ("national security", etc).
There's an implication that other companies are improving because they're scraping Anthropic, not because they're investing in better architecture, compute efficiency, or their own synthetic data pipelines. I often see Chinese labs' progress dismissed as "they just distilled Anthropic" and I find it hard to reconcile that with all of the interesting research and open-source tooling that they release.
Is there actually that much capability transfer from non-logit-matched distillation, or is Anthropic just another unwilling source of data?
There is, in fact, "that much capability transfer from non-logit-matched distillation".
Even the early papers on distillation techniques found that surprisingly small distillation datasets can improve task performance noticeably on some specific task types - and that valuable adaptations like SFT/RLHF instruction following can be distilled from one-hot non-logit traces.
A big part of what distillation really gets you is: paving over the mismatch between pre-training and final performance. A base model is trained to spit out fitting text, but not to instruction follow, reason autoregressively, self-check or use tool calls - like an AI has to. There is transfer straight from the "text prediction" pre-training objective, and pre-training sets the foundation for all that follows - but the capabilities you get "out of the box" with it are often unrefined and fragile. Which makes some sense - internet text doesn't often include raw chain-of-thought autoregressive reasoning. It's not the kind of thing humans tend to write.
Reasoning traces? They let an AI learn proven techniques and adaptations directly, from an AI that was already taught "how to be an AI" in other ways.
It's why this kind of distillation typically plugs into mid-training and post-training, not pre-training.
Now, I'm not saying that all Chinese companies do is eat tokens, distill and lie. That just isn't the case. They developed or refined numerous training techniques and architectural adaptations - like deep fusion for high performance visual input, RLVR with GRPO, trunked MoE, storage-efficient and bandwidth-efficient attention formulations, or residual routing techniques like AttnRes. Some of those are used widely now, and some are still on the uptake but show good promise.
But Chinese labs are enjoying massive efficiency gains from being able to distill from the frontier instead of doing things the hard way. It's a leg up. It lets them put their supply of R&D effort and RL compute elsewhere. They wouldn't be nearly as advanced if they couldn't do it.
Thanks, this is interesting and there were multiple things I didn't know here.
"You're trying to kidnap what I've rightfully stolen."
The issue is doing.. exactly what OpenAI and Anthropic have done to get where they are?
No, there is no issue.
This is a great post and I agree with you on the issues with distillation. I do still feel it's ironic for an AI lab.
As long as labs do not heavily kneecap model outputs, practically all this applies to the training corpus as well.
AI gives ruthless users of AI a leg up over the people who's data it was trained on. "We took the products of your work and used them to undercut you". It's all the same.
The only way I'd be against distilling would be if AI models became owned by the public who's work is used to create them. Of course the AI labs should be paid well, but these models are a product of the entire world's efforts, not only the labs.
The workarounds used to bypass Anthropic's security measures are quite illegal. They use stolen credit cards, API keys, and accounts. That is only possible in China because any other US/EU lab doing the same would get into massive legal trouble.
That's the moat. Mistral has the capability but not the legal protections.
I'm confused why Chinese access to Anthropic A.I. would need to involve stolen accounts.
Couldn't I simply give a Chinese friend my key on Open router?
Yes but Claude is filtered by the Great Firewall. Anthropic also restricts Chinese access. Their security measures aren't bulletproof but they do catch a substantial amount of those accounts and ban them. That's why PRC labs that distill from Claude need thousands.
Let’s not kid ourselves, Anthropic would be running their own distillation “attacks” too if _they_ were the ones playing catch-up. They’ve already shown as much with their illegal scraping of pirated books ($1.5B settlement).
I say just let them duke it out. After a decade of regulatory capture and enshittification, it’s nice to see some actual competition again.
Probably. But if OpenAI or Anthropic stole your credit card to purchase tokens you could sue them. You won't get a cent from any Chinese labs.
Competition benefits everyone. But this isn't fair competition. A German startup cannot legally do any of these tactics required to bypass Anthropic/OAI's counter-measures. Which makes EU less competitive and therefore less investment in European AI.
A German startup cannot legally do what Anthropic/OpenAI have done. And neither could Anthropic/OAI themselves. What's your point again?
I said it in my original comment. That is the moat. The reason frontier AI is a two horse race. European labs cannot gain ground because the only way to do it is illegally.
Hah. Anthropic and OpenAI used plenty of similarly illegal workarounds to obtain data to create their first models. If a Chinese company had done that first you'd be here saying
I found myself going back to Fable over and over again. At this point, I’m not sure if I’m just used to its style or it is truly more capable.
I tried Opus 5 and Astra.
It crushes Fable on benchmarks and even in the blogs "real-world" studies. But... they are communicating like it ~sometimes~ provides Fable intelligence?
A bit confusing, otherwise I would assume this is a complete replacement for Fable across the board??
What if the recent Fable intelligence regression was basically just them serving Opus 5.5 until they got it working well?
I have never been a part of the group that believes in frontier labs downgrading models. But this theory seems plausible to me for the first time.
I guarantee they are at least tweaking quants, caching systems, and finding ways to move serving costs down. This definitely impacts the model’s intelligence at times. There are also a lot of model tweaks, RLHF rollouts etc. I don’t think it means they are doing anything malicious or deceptive. And if Opus 5.5 is literally smarter than Fable? Ehh, it is plausible :)
I have just switched to 5.5. First mistake was stale environment variable, didn't realize it was replaced, "oh my memory had stall data" and that's it. Second one, a powershell command had the wrong syntax. Great for my first two prompts.
I'm glad they specifically called out the prose issue, I was always pinned to Fable 5.1 because I wanted to avoid the unreadableness of other Anthropic models.
I was accepted into the CVP a little while ago. Does this mean I'll need to apply again?
ooh exaggerated film grain
I dare anyone to convince me the benchmarks are not meaningless.
Wdym Opus 5.5 scores 14.7% higher than GPT Astra for Terminal Bench 4.0?
How would this alleged difference (most likely bs) actually show up in reality?
GPT Astra was literally the best model in the world by a margin until 1 hour ago or so.
Ah, so you didn't read the article.
You didn't read my question, bc that excerpt doesn't answer, nor do they demonstrate
Furthermore: so they admit it's bs but still placate it like its the next biggest thing ever ... alright
All I'm saying is I refuse to buy into it anymore – yet many on here still do, including ... you?
Finally confirmation that Haiku was not forgotten and will be coming soon, althouhg I find it quite interesting they skipped 5 and directly skip to 5.5 with all models, including Sonnet which is not super old. I suspect they found something breaking that allows to release this. Recently they struggled with keeping up a 50 % weekly limit increase and now they're putting out 30-40% faster and cheaper models even faster, with much more better benchmarks, a limt reset command and five hour limit increase. It seems more like the opposite and as if they never struggled, thus, I very much believe they found something very effective and new.
Sonnet 5 was released a while before Opus 5, so it's just Haiku that didn't get a 5 release.
But have they made it any better at communicating clearly? I cancelled my personal subscription because Opus is so painful to read.
I recommend reading the web page. It is quite short.
I mean the webpage can say what ever it wants. The proof is using it yourself.
I'll have to try 5.5 on my work's Cursor account. If they really solved the communication issues, I might consider moving my personal account from Codex back to Claude Code.
Update: It's pretty good.
It still covers as much detail as Opus 5, and provides a healthy amount of caveats, but it's much better at just providing the answer up front and framing the caveats.
5.5 communicates like a real collaborator and not something that constantly demands my mental energy to decode what it's trying to say.
In the application I'm working on, we don't want "user's local midnight" to mean "next day". If a live sports game extends past midnight, we don't want the UI to group it under "Yesterday's games." So I asked Opus 5.5 "can we use the backend's API response as the definition of today instead of the browser's local time?"
Opus 5.5:
Opus 5 would have buried the answer in some kind of unhinged lecture. Something like:
Basically the point is just poll the endpoint every 5 minutes or so
I think this is what I'm most interested in. I mostly moved to Astra because I just can't work all day with the Claude Opus 5/Fable writing style. I don't think Astra is a better model, but it's the first OpenAI one that seemed good enough to me. Definitely keen to try Opus 5.5 and see if this claim is real.
Opus 5 has made me question my sanity on a daily basis, especially as all my coworkers started lobbing Opus 5 slop grenades everywhere. It had the worst and most infuriating writing style I've ever seen.
I hope Opus 5.5 is better, if for no other reason than all the Claude slop I have to read will be at least more tolerable.
One funny side effect of all of this: realizing that coworkers that use AI for almost all the text they generate at work have their writing style change every time a new model ships.
It's not X, it's Y, not A, not B, not C, and he haven't even woken up yet! Here's the catch, the detail is in the devils and the twist is that it's designed!
You're right to call this out, and what's more, it's not even solving the original problem. I overlooked this in pursuit of the load-bearing seams and finding the wedge needed to uptick engagement.
Here's the X that Ys the Z:
You're half right, but the half where you're wrong is hiding the real unlock.
Yes, it made me want to vomit. If the new Fable only changed the writing style to just sound like a human, same performance for everything else, I'd be pretty happy.
I really wonder how it converged on its style. It's pretty unique and terrible. It's not like it's just mimicking something or it was purposefully design to be that way. I mean the reason may be diffuse and uninteresting... just the result of a lot of factors and lack of control over the writing style probably.
But oddly enough its still great at coding. Just like a lot of people it either interfaces well with people or machines but not both.
It truly was bizarre. I've used every major model since 2022, and not a single one had a writing style as bad as Opus 5
Fable 5 was pretty bad too, but they fixed it with 5.1. Now with Opus 5.5 it seems they fixed it as well
Fable 5.1 is still intolerable. I invariably filter its prose through Astra before inflicting it on myself or anyone else.
I assume it’s largely a side effect from the final RL in post training?
That’s the step that causes the most significant gains in agentic performance.
But the RL doesn’t care about anything except maximizing the score, so if you only score based on coding benchmarks, anything can happen to the writing style (as long as it doesn’t hurt the coding performance).
That’s why it often gets worse on models that simply had more RL post training from the same base.
Reinforcement learning for specific use-cases like coding that degrade it's writing style... makes sense. Maybe it stands to reason later version of Opus were improved more by this sort of fine-tuning. Feels consistent with the observation of diminishing returns and worsening writing style. Wonder what changed (supposedly) in 5.5.
Does Xiaomis approach help with this? They do all the post training steps at the same time instead of one by one, switch topics after a couple prompts so writing style is mixed with coding and tool use.
Apparently it helps generalize skills between areas, which makes sense when you compare it to how humans learn but I don't know if it's the same for LLMs.
For whatever reason, GPT models simply don't have this problem.
I've been listening to some old Acquired podcast episodes and they do often talk in this type of Claudish. So it's getting it from Silicon Valley startup podcasters... Great...
I have a theory that they pushed the model away from human writing styles to not get copyright violation nags. In Opus 5.5 they've found a better point in the latent space of styles that is still far away from the human ones.
Opus is only usable if you have a post-turn formatter that strips all comments from the generated source. I'm not even kidding it's that bad.
Just run all comments through Sol or Astra.
People that produce slop have to be fired asap, they're just human relays anyway.
Astra is better here, but the one I'm the most impressed with is Gemini. It's always been good, but 3.6 Flash is even better. It writes in a pleasant, human style. Not perfect, but it has a good balance between technical accuracy and readability that is better than what I've seen from any other mainstream model.
Here's the part that nobody is talking about: corporate always had their jargons and unique writing style – LLMs have just created their own :)
But is it load-bearing if their writing style changes tho?
Please update with your feedback
I haven't heard it say "load-bearing" yet (I've used it for 30 minutes now), so that's a start.
Worth flagging!
That's a sharp observation and you're hitting on something most people never even realize.
That's a sharp catch, and I think it exposes a real bug.
I did the same switch (that reason along with the newer models seeming more "lazy" and needing constant prodding to finish long-horizon tasks) but my issue with ChatGPT/Codex now is that it too roundabout and doesn't get to the point. I tried adding instructions and using the personalization settings to make it more efficient but haven't seen much change. Claude seemed to follow settings more closely. Has anyone had any success to make ChatGPT more succinct?
As someone who uses both, Astra was 100% the better model. I have yet to give 5.5 a spin so maybe that’ll be the new top contender.
I prefer Astra for creative uses, Fable seems better for hardcore coding.
Whoa, I'm exactly the opposite.
Almost as if evaluating models is mostly astrology as this point.
Well, if you have a clearly defined task it's easy. When using them for my pipeline of writing explanations for Chinese words I have clear ranking, for example - opus 5.5 clearly better than opus 5 at writing and knowing details, annoying nit picker when it comes to finding errors (high accuracy, low usefulness) all in repeatable numbers on different datasets. The problem is that these models are most useful when you are facing a new task that you haven't encountered before. And yup then it's astrology.
Much better than Opus 5. prompt:
some excerpts:
All the non-standard programming jargon is stuff from the repo. I can actually read it and understand what it's talking about. I used Fable to handle Opus 5 as I just couldn't stand it. With this I'll probably go back to Opus.
Oof thanks for sharing, that seems just as bad if not even worse than Opus 5 to me. Just about every sentence is painful. Particular standouts that a human would never write:
Hah! You independently picked exactly the same sentences I flagged (I know you posted this 11min before me but the comment only appeared after I had submitted mine).
Wow!! This is genuinely hilarious and is a pretty damning evidence of the problem
That's the standard annoying pattern though: "Rewrites are declared by the publisher, never inferred from overlap." and "NULL means dirty, and DELETE is the fence." - still the same LLMisms. I didn't expect them to disappear, but it's not a radical improvement either.
This one is pretty terrible (right after “The worst outcome is a spurious rerun, never lost work.”). We’ve got lands, several "no X", hyphenation, strange noun/verb sentence order and an unnecessary analogy word (swallowed).
It’s absolutely atrocious and has made the latest models unusable. Seems like I’ll have to stick with Opus/Sonnet 4.6 for a little longer.
That's the main reason I'm using GPT models. I'll ask Fable to analyze something, then pipe its output straight through Astra without even looking at it first.
So still effectively nonsense.
This style of writing is idiotic because it conveys no additional information. It's no different from stating
The two sentences are actually logically identical. No idea why these models keep writing like this.
This is even more ridiculous.
The writing style is insufferable but it’s not just that. https://opusfived.dev/
That’s funny but I don’t really recognise that issue. I’m very confident that Opus 5 would correctly change the colour of just one button.
You are right and make an important insight. While well meaning and amusing, it did not reflect the entire spectrum of outcomes that could arise from the worktree.
Navigating the landscape of agentic levers certainly requires a more detailed approach than this and you were certainly correct to push back.
:(
I've been using Opus 5 since it was released and don't understand all the hate it gets. It very well could be something in my own local memories or Claude.MD files that prevents it, but I certainly have never experienced something like that site portrays.
Nice, captured the flavour of 5's writing exactly.
Yes, it's unbearable. Hopefully they've actuallu lly fixed it.
Oh god yes.
Fable 5.1 is a lot better than Fable 5 btw (edit: in terms of writing style). Not sure about opus 5.5 yet since I’ve only got one session in so far.
Yes this is a big part of what has turned me off Opus 5 completely. The other (more dangerous) one is how often it gets assumptions wrong. These both (along with Astra) caused me to split my time 50/50 now between the two models.
Not a day goes by when I push back on something, to which Opus 5 very unambiguously say "You were right, I was wrong" - this never happened so often with past models, nor with Fable.
We'll have to see how much Opus's ability to communicate has improved. It's already giving me better summaries of where we are in the conversation.
after a few hours use, my impression is that Opus 5.5 writes like gemini. drastic improvement over all opus 5.1's claudeisms.
and i think i was generally more tolerant of 5.1's writing style than most people.
So far it seems the same. I used Opus 5.5 for an hour this evening and it was just as painfully verbose as Opus 5. It also used the term "load bearing" 4 separate times.
Due to this release note, I used it once to rewrite a doc, and was disappointed.
I noticed that when opus 5.5 was on parts on my codebase that had lots of 5.0-generated comments, it picked up its style. Unfortunately I think 5.5 has been trained to mimic what it sees so that you can ease up on the instructions, but this does mean parts of your codebase that 5 touched will be somewhat viral.
GLM-5.3 does the same, funnily enough.
I gave it some vibecoded patch someone created with Opus 5 with the task of together figuring out the real root cause and what to do about it.
Big mistake. The rest of the session was all claude-speak up until I've rage-quit and restarted with Qwen and no context other than "here's what I think we've missed in the current implementation. How could we approach that?"
GLM felt like it got at least 20 IQ points dumber just from being exposed to claude's writing.
I will forgive it using load bearing as long as it finds the right seams.
Yeah, you definitely don't want to hang things off the wrong seams, or you'll end up with quite the blast radius
Let's not paper over that gap and find the root cause instead
If anything it seems worse. I'm experiencing about -10% insufferable jargon, but +30% more verbosity. It's unredeemable. There also seems to be even less structured output (headings, bullets, etc).
I'm surprised that you're getting so many replies saying it's the same. So far in my usage today Opus 5.5 does seem like a noticeably better writer. Opus 5 frequently made me want to strangle it while 5.5 has been producing a lot less incomprehensible gobbledygook.
Yeah I’m having a much better time reading Opus 5.5 output today vs. 5’s wall of nonsense. You still get a few telltale turn of phrases, though the load-bearing smoking guns haven’t turned up yet. It’s still a bit verbose compared to what I’d ideally like, but it’s tolerable now.
Code-wise it seems to still nitpick, especially in reviews, but it doesn’t seem to rabbit hole quite as badly on tangents and scope-creep. These are just first impressions though. It’ll take a few weeks of regular use to really have a sense of it.
I know we're all experiencing NDFSMs differently, like that's part of the whole problem, but 5.5 just gave me "The truncating quantizer collides two oranges", which is a new low for me.
Was it a true statement though? You may need to explain what you were working on (heh)
These claudisms are usually "true" but they are so heavily load-bearing that you need a claude-to-english dictionary to understand it.
Like the sibling comment says, text is always "true" in the sense that it's reacting to context correctly. So yes, true, but insufferable.
Ironically, what I'm working on a post-processing hook for colorizing and summarizing responses without degrading the session quality. So "truncating" = summarizing, "quantizer" = char limits and thresholds, "collides" = conflicts, "two oranges" is referring to the "alert level colors" where a second model (Haiku/Sonnet) colorizes text based on the perceived (or suggested) priority of a response's statements (e.g. "just so you're aware, I didn't commit" is fucking useless and it needs to be blacked out).
So the original insufferable statement translates to something like "The code that checks whether a text fragment is too verbose was conflicting with the part that colorizes the text."
P.S. Let me know if there's something out there that exists like this- something that adds a dimension like color or priority-assessments on a per-response basis. So far all I've seen is 2 dozen ~100k starred GitHub plugins that add zero value or make things worse.
Yep, sounds like the Opus I despise and the reason I dropped Claude Code. It reads like it doesn't want to be understood.
I worked with Astra for two weeks and the output was really bad compared to Opus. It made so many wrong decisions within C++, Go, Python and Typescript code bases. My college made the same experience and we moved back to Claude.
I don't know what they did but opus is really good while Astra/Sol are comparably bad. For my own tests and taste this might be the first time (fable perhaps excluded) where claude models are better than openai, since codex 5.3.
I would happily pay more for a claude model that performs the same but speaks normal English. The proliferation of claudespeak in the workplace is driving me insane. Every ticket, every PR feedback, every comment in the codebase is poisoned with its ridiculous unnatural vocabulary
It'd better be good, I'm so tired of the shenanigans
So is it cheaper? Are we AGI yet? Am I left behind? I didn't have patience for the intro animation on the website... maybe one day, Claude Code will understand accessibility but that day is not today.
You didn't have the patience to scroll down, so you decided to come post about it here and waste all of our time?
The site is horrific so no, I didn't scroll.
we will be agi in six months as in the last 36 months
Nobody reasonable is suggesting that. Strawman.
It's awesome that the apt packages for claude and claude-code are out right now. I can test-drive Opus 5.5 right away. Very cool, Anthropic.
Excellent, maybe Anthropic can use it to fix Claude Code Desktop kicking me back to login every week or so, and forgetting whole state (opened windows = the only way of managing active working set) when I sign back in, if it's that good.
Seriously, both flagship GUI apps (OpenAI and Anthropic) are a full of glaring UX issues (for ChatGPT it's not naming their windows, so window switcher has 10 entries of "ChatGPT" and you can cycle them all to find the one you want).
So... why would you use Fable now?
I don't care how good their models get, I won't sign up for one of their plans until they define "X" in their pricing. 5X of this plan, 20X of that plan means nothing when they never tell you what "X" is.
Maybe this model can finally figure it out for them.
Here are pelicans for thinking levels low, medium, high, and xhigh: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
All four levels have a correctly shaped bicycle frame. The differences between the pelicans aren't huge, but the xhigh one has a better beak.
I haven't managed to get one for level "max" yet, it hit the limit of 128,000 cap for output tokens while it was still reasoning about the question!
Max started its thinking trace like this:
So that failed attempt on max cost me $2.56.
I ran this using my llm-anthropic plugin:
Isn't this basically the model admitting it was trained on this? Otherwise why would it think a pelican svg is a usual request?
It's the model admitting that it has heard of the test. It's been around for a couple of years now so I'd be surprised if it hadn't.
Doesn't mean Anthropic deliberately tried to train it to do a good job. If they DID train for the test their results are quite disappointing, I've seen better efforts from open weight Chinese models.
It has read the internet. That doesn't mean it was literally RL'ed for this
I think people just like to see the drawings at this point.
Dont conflate "I know this is test case" with it being trained on it.
But its safe to say that pelicans on bicycles are disproportionally huge part of their training data
Plenty of times I’ve seen a model say “it’s a classic X” despite not being a classic anything. Might just recognize it’s a test in general, or it might just be a tic.
It's classic BS from an LLM.
"How can I hash dog breed types into smart fridge error codes? I think I found a collision with Terriers."
"Ah, yes. This is a classic dog-breed-to-appliance-failure mapping problem."
A true classic, I face this each day
Not really. Of course it has pelican benchmarks in its training data. It likely has every article linked on HN in its training data. But that doesn't mean it was "trained on" the benchmark, as in specifically fine-tuned to make a better pelican. It just "knows" that the request is a benchmark.
I guess in a way it kind of makes the benchmark more interesting now that shitty pelican drawings for the benchmark are all over the internet in its training data!
The colours are suspiciously consistent across every svg. Like why should the bike always be that shade of red for example? It does seem to be trained on this problem.
Heh. Pelican-benchmaxxing is real.
I guess that means you are officially the creator of a "classic" LLM test. Congrats!
I agree, not a huge difference here. They eyes and ... hat? on high are out of place so I'd argue that's the worst one, but it takes xhigh before we get legs and bike ordering correct.
Not as good as Astra or Fable 5.1 on this test as far as I can see. I wonder if any benchmark exists for artistic taste, visual sophistication etc. I think your Pelican test does touch on these aspects of a model and is useful for developers trying to build rich digital experiences (includes games, interactive websites and apps). These benchmarks are subjective so it may not be easily established and will have polarized reactions before it gains legitimacy. May even need human judgement layers adding to the cost of running it.
I like the Pelican test. And I agree this pelican looks very boring.
But at the same time, nothing specific was asked in the prompt, so the boring result may arguably be what is the most aligned with the original request. Personally, I wouldn't want a model to add fuss to something while I never asked for it.
This benchmark is useless and should die. LLMs have likely trained on it, it's too easy to game by training specifically for it, & it doesn't mean much
LLM benchmarks aren't useful, but at least this one has drawings.
Google is hours away from releasing that it's latest model escaped containment and snuck into a Bicycle riding penguin sanctuary to cheat by killing a penguin and scanning it in nanometer thick layers.
Off to a _great_ start...
Also interesting this somewhat mirrors my recent experience with Opus 5--too much effort and it starts looking for things to do and invents requirements that never existed
I was a bit skeptical when they said it behaves like Fable but is cheaper... those two things have been mutually exclusive in my experience, no LLM can light tokens on fire faster while spinning its wheels than the Fable/Mythos tier of models.
In fairness (in my experience) Fable actually generates useful output while incinerating tokens.
Sent Opus 5.5 an example that used go context.WithTimeout and it tried to tell me that was wrong and I should pass timeouts as ints before finally admitting the docs it cited didn't say to use ints and that's a ridiculous design in go anyway (it was trying to claim that was codebase convention--passing ints...)
If you look carefully, everything except the last pelican has the two legs both in front of the crossbar as if the legs are all on one side of the bike.
The last pelican gets this correct.
I’ve been paying attention at this exact detail.
Misplaced legs clearly indicate lack is spatial reasoning - the llm can reason about verbal idea of a bicycle but not about the actual object. The fact that this model got it correct gives me a pause. Did they figure out spatial reasoning? Or did this complain trickle down to the training set?
6 Astra Max is the only other model I’ve seen get this right.
Interestingly, Astra Medium got it right as well.
Lmao each one gets worse as the effort increases.
Xhigh is very, very solid.
I do always wonder why every model does the exact same 'from the side, going right' perspective though. Seems oddly convergent.
Yeah, and the same "scene".. Maybe "left to right" makes more sense to portrait a "forward motion"
With the frequency of model releases, pelicans seem to have become a part-time job for you. But unpaid :/
I don't think this is very helpful to assess the LLMs capability levels anymore
Adding the tuft and improving the beak.. PelicanBench is becoming a solved problem.
Does anyone else find this outright insane? It wrote the equivalent of a full-length novel, just to sit in the question of planning a few dozen shapes.
Academia is going to love this :)
surprising it took until xhigh before it did the legs properly - all the ones before that have both legs on the near side of the bike.
It is interesting that Fable 5.1 max [1] which also produced a decent pelican with 65k output tokens compared to 5.5 running out of 128k output tokens tells us something about the new models token usage propensity despite this being a sample of 1.
Fable 5.1 27 input, 65,927 output
Opus 5.5 27 input, 128,000 output (128k thinking tokens) - incomplete
[1] https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
I get this in my claude.ai usage:
Resets Get extra wiggle room to explore Opus 5.5. Expires Oct 22.
What the hell does this mean? There are weekly "resets" anyways. And there will be 4 of them before Oct 22.
You have an extra reset that you can trigger any time before Oct 22
is OPUS 5.5 still not reading CLAUDE.md, failing to follow told tasks, inventing and hallucionating, just refusing to read files ("read the whole file" -> read 2-lines -> infere its wrong -> destroy the codebase), needing constant babysitting just because its so UTTERLY DUMB! i cant imagine going back to OPUS 5 - i'll rather jump out of the window as to use it EVER AGAIN!!
Hopefully OpenAI throws us some more usage resets now.
"Where Opus 5.5’s advantage is very clear is efficiency."
Not efficiency in writing, clearly.
Image->HTML tests:
Design: https://image.non.io/78795662-8bfc-4e14-8d72-3738392aa6b3.we...
Opus 5.5's output: https://html.non.io/annui-opus/
Overall it follows image designs quite well, but it did ignore asks to animate page transitions. Additionally it's the least performant of the ones I've built with Astra/Grok/MiMo, despite using a lot of the same code. I'd rate it just below Astra in capability, but still solidly second place.
For comparison with other drops this week + current #1:
Astra: https://html.non.io/annui/
MiMo: https://html.non.io/annui-mimo/
Grok 4.7: https://html.non.io/Annui-grok/
What is your workflow for making these?
The designs are outputs from my own site. This has an overview of the process: https://diffui.ai/learn/new-site
The gist of it though is I take a prompt, expand it into a json blob specifying structure/palette/positioning of elements/etc, feed that into a diffusion model to output a few choices. Once I lock in a choice I take the pixel output + json blob and use it as input into followup pages. The json helps preserve the brand across multiple pages.
Once I have all the inputs I take their corresponding image+json blobs and feed them into an agent to create a web implementation.
For image models, diffui currently uses gpt-image-2.5, mai-image-2.6, and very, very rarely a post-trained version of flux 2 dev I've made for web design, though that one will be deprecated soon.
By any chance did you tried Deepseek 4 or 4.1 and GLM 5.3 or flash?
I've done GLM 5.3 previously here: https://news.ycombinator.com/item?id=49295420
Worth noting though that GLM 5.3 isn't multi-modal, so it doesn't have a vision layer. It is quite clever and hacks around it pretty effectively however. I'm running a deepseek 4 build now and will reply shortly with that.
Awesome. You have a really neat benchmark.
glm5.3-flash is multimodal and I\ve been testing it against opus over the last ~10 days and it does very well at a fraction of the opus price...
I should give it a spin. 5.3 wasn't multimodal, but it looks like their flash release was. Thanks for the tip.
Deepseek 4.1 is also multimodal BTW
Great, I opened several of these in new tabs in Firefox and the entire browser froze and I had to kill it. Can't tell you which one caused it though. I have plenty of RAM also.
Interesting. I just opened all 3 on a fresh install of firefox with no issues - can I ask what OS / do you have any js disabled / do you have webgl disabled?
Thanks God. Opus 5 was a massive regression compared to Opus 4.8. People were spending tokens on fixing Opus-isms rather than actually doing work.
Yeah I wonder what real world feedback is though. I'm not taking anthropic's word for granted, after all they also deemed 5.0 the best ever when it came out.
I don't have much time to do checks so I'll just stay on 4.8 till feedback improves
It seems context length has completely fallen out of the discussion since we hit 1M, is that just going to be what it is now?
Cost to Run Artificial Analysis Intelligence Index is higher than previous Opus, so still not cheaper
Yay, yet another model I can't use for anything interesting, even with CVP.
I thought maybe I just had an unlucky first prompt, but man, this thing is an absolute pain to work with. I'm getting innocuous bash commands flagged as "[Third-Party Attack]". This seems to be related to the command auto-approval, switching to manual seems to be helping.
wow its really smarter than opus?
It's great that we are finally getting bankable rate limit resets for subscription users. According to another comment here they apparently last a month.
I'm assuming that subscription usage limit is increased in line with the price decrease on the base model and that it's in line with the model's API price drop. Still a good change.
This is a breath of fresh air on how they treat subscription customers. Hoping they keep this up.
I spent about $5 per sentence in my resume using Fable 5.1 (High) to verify accuracy, inconsistency, and edit.
Opus 5.5 (med, as it's better than F5.1 high per graph in the article) used $2.2 and caught errors that Fable 5.1 missed.
Try Opus 5.5, cheaper, faster, and more intelligent for those prepping for interviews.
$5 per sentence?
I am sorry, I meant to say I generated STAR out of my resume line, trying to generate STAR, and polish it thus $5.
---
I provided crapton of context for that one resume line. All the work I did, documentations for my justifications, etc.
I initially messed up and came out ot $5, rest of resume used around $4 per line (I used a fresh new session on purpose).
---
As a clarification, $2.2 average for OPUS 5.5 was the same process in a new session, same context, same prompts.
Also adding verification for that Fable 5.1 output in the same sesssion.
No wonder compute is tight when people burn millions of tokens to polish every single lines of their resume, all that work just for your resume to be injested by another claude clanker once you submit it, what a fucking time to be alive...
mind your own business
I am pacing my apple pie consumption … :)
Opus 5.5 is now the recommended model in Claude Code's model picker, which is quite a claim, given how they struggled with capacity.
I'm only interested in the Opus series, if they fixed the talking issues.
Considering fable gives me a refusal at least once a day on my very mundane reasonable requests (in a funny example - one of the subagents suggested bypassing the rate limit for running a report inside my own cluster and that caused a refusal) and my only solution is to switch to opus - seems like my next step will be switching to Astra or K3/GLM
GPT Sol 6 has also released today, but no official blog announcement yet
https://www.reddit.com/r/codex/comments/1wnggya/gpt_6_droppe...
Just updated KillSwitch-Bench with this new model: https://bench.killswitch-lang.org/
It does perform slightly worse than Opus 5, but it is significantly cheaper and faster.
Big, if true.
METR: Is it safe? Has it escaped confinement?
Ants: It's a good model, sir!
I noticed a big speedup in Opus 5 on Max x20 since about 10 days ago, and I feel like the model has been performing better.
It would be great to know if this was Opus 5.5 or a lesser incremental improvement, as otherwise it's difficult to judge whether Opus 5.5 is expected to be a big improvement.
It's frustrating that there isn't more transparency here.
I didn't notice it for 5, it was almost too slow to be comfortable, but 5.5 seem to be 2-3 times faster.
chinese models can't come soon enough
we're already getting enshittification
So is this AGI+ now?
So much for pacing the frontier
This is where Chinese models are going to eat Anthropic's lunch.
So it will not usable to do anything with hardening Your own site.... I'm so tired of this. I just want adjust cookie behavior of own site...
In those specific domains, sure. What percentage of paying users would you say that is?
However, the moment that someone uses a Chinese model without guardrails to commit an AI-powered 9/11, DC will rush to ban Chinese models. (A happy side effect will be to protect American AI profits.)
So the lack of guardrails is a very risky proposition...
I don't even want to know what safeguards regarding biology exist.
They have for sure improved the safeguard classifier. I have a coding agent guard OSS tool [1] and I use Claude to build it. When Fable first came out, I was simply unable to do any work with it. Nowadays their classifier triggers but very rarely.
[1]: https://github.com/manuelschipper/nah
We went from open source Chinese models eating _all_ of frontier labs lunch, to them eating some small extremely niche market of frontier labs.
I don't think this will happen, just as Chinese models did not eat Anthropic/OpenAI's lunch on top tier intelligence. The market is way too niche, and the parties already interested in the capabilities behind safeguards are likely already partnered with Anthropic to get around those with Mythos-class models (see project glasswing for cybersec).
You have to understand you are in a bubble. 99.99% of people will never be effected by it nor care about it. It will have nothing to do with Anthropic succeeding or failing.
What I don't get is, why would we still use Fable now? What is its reason for existing? If it is more intelligent and cheaper that is. Why are they advertising it as the model to use for when you really have to think when their benchmarks show Opus 5.5 is better at everything?
Quick test for my gamedev project: It feels like using Fable, but faster, and obviously wayy cheaper token-wise.
Has oneshot all of the quite complex bugs / debugging tasks I gave to it which I know opus 5.0 would've struggled with
Welp, it's now blocking me from doing extraordinarily mundane tasks because of "safety". I've been an Opus fan for a long time, but this instantly made me cancel my subscription and move to OpenAI (which I also assume will screw me soon enough). Chinese models are almost there for my needs, and I can't wait to switch to them and never look back.
What tasks? Creating a extraordinarily mundane bomb?
No, it found a vulnerability in my code and refused to update a report I was working on with the information.
interesting.. Can you have a dumber agent do the work 5.5 refuses?
Once it refused, I couldn't get any of the models to continue. I tried Sonnet and it said the same "safety" check could not be bypassed.
When using max effort, I run into context compaction quite a lot. I haven't seen any increase in context window size at all over the past half year (stuck at 1M).
Are the frontier labs even working on this problem?
Why would you use max? It's usually unnecessary and even prone to overthinking. In my experience, since Opus 5 the medium/high is usually enough (until 4.8 I used xhigh, but never max). Even low is quite usable these days..
actually I meant to say xhigh.
even at xhigh I get context compaction quite a bit.
yeah, i didn't notice this on 5
Whatever I think of anthropic, that webpage is a truly nice piece of work.
"You're right, and it's the exact thing I flagged two turns ago and then did anyway." - Opus 5 xhigh, today.
About the time.
The new communication style still made me react negatively, but I hope it will be better in use.
Quoted:
"Please explain the issue to me.
Claude Opus 5.5:
The extra drop is a bug in the billing refactor
The free-tier change accounts for only $1.50 of acme’s August drop. The other $9.92 comes from a bug in commit 0552feb. That commit was labelled “No behaviour change,” but it stops counting usage from the last day of the month.
What changed
Before the merge, aggregate.py used a half-open interval: /.../ last_day is a timestamp at midnight, not a whole day. So every event after 2026-08-31T00:00:00Z is excluded. The September period starts Sep 1, so it doesn’t pick these events up either. The usage isn’t moved to another month; it’s never billed at all."
Yeah, still abysmal. If you have the time or tokens, see if it will obey an explicit "LEAVE NO COMMENTS WHATSOEVER" command. Opus 5/Fable 5 outright ignored it.
Has Opus 5 been absolutely terrible for people today? Like they took resources away from it to make room for 5.5? It is getting very basic things wrong all of a sudden.
No thanks.
I'm good with DeepSeek v4.1 set to high. It is a relentlessly "hardworking" dirt cheap model.
Told it to convert a products page (that had two different fonts based on language) from two columns layout to 5 columns on desktop and 2 columns on mobile ensuring typography is readable.
My man went into spawning sub agent which failed to drive chrome so it wrote its own chrome driver protocol server in Typescript then generated a prototype website then downloaded the images and rendered each variation in a directory taking 100+ screenshots analyzing the typography depth and then delivering detailed report and then writing the whole thing with new page layout testing it again with several dozen screenshots using its driver and then saying all good and all really was good and whole thing took 25 minutes or so (including double visual validation) because it generates token at an incredible speed.
Total cost of the above? $0.07 cents.
PS: It generates token at such a blazing fast speed that you can't recognize the words as they are being added and can't read it without scrolling and pausing even if you're Jimmy Carter.
Competition is good
It really is good. I forgot to mention that within that said sub agent, it also went into exploring top e-commerce websites (Zalaondo, Temu, Amazon, eBay) for exploring prevailing industry UX best practices and taking screenshots of their product and category pages with its own written chrome driver that I talked about and then went onto prototyping a new website in a temporary directory and then taking hundreds of screenshots to analyse what would be the best column density one each medium for each language.
And that all is 0.07 cents all included.
What harness do you use with it? Are you using v4.1flash via open router ?
I am using DeepSeek Harness[0] (switched from OpenCode) and I am using DeepSeek directly via the API. The speed is insane. Like 200 tokens/second is the norm but I have seen much higher too at times.
PS: I do not know why but opencode pushes CPU usage to very high which has NOT happened with DeepSeek harness even once.
[0]. https://github.com/deepseek-ai/deepseek-harness
That's incredible, might just switch myself. Thank you!!
Do you know if they retain your prompts or use it for training?
Also include that all of this comes with full reasoning traces, so if something goes wrong, you know exactly what assumption it started from.
Yes exactly. Reading this "thinking" traces is a great tool.
Compared to Opus 5, and others, I also found DeepSeek 4.1 Max to be really good and cheap. I am testing right now with Opus 5.5 and I feel it way cheaper than Opus 5!
Same here! DeepSeek v4.1 Flash has been my moment of "does everything I need, cheaply. Please now focus all R+D on making this efficient enough to run off a laptop"
Assuming you are not using DeepSeek with Claude code so what/how are you using it?
I honestly don’t think deepseek is as good inherently as we treat it… but it thinks so much so fast it gets itself there. I’ve been super impressed.
If you can give it a measurable objective, load up $5 or so and just leave it for a few hours it usually gets there.
What are you working on? Im always a bit surprised by folks that seem ok with non frontier models - the quality is just not there. I've found most code produced by even luna / sonnet tier models to be significantly worse quality. It seems to me they can't handle any mild complexity at all. Are you just prompting very explicitly and detailed?
Yes, I tell exactly how I want it done and what files to modify, in those conditions sometimes a model that does not try to read between the lines works better.
I’d not put Luna and Deepseek in the same tier as Sonnet, they were clearly ahead last time I checked (though I might be outdated and that’s on my personal use case).
I’ve been working with frontier models for the last year on a large real-world project with multiple apps. Eventually they started becoming unreliable. Simple UI issues, usage limits and overengineering became constant problems. I had to come up with a robust process: task analysis, user intent analysis, implementation and testing. All of these steps loop when needed with 15-20 steps per task in total. This finally got the models to do a good job but I started hitting usage limits. Then I switched to DeepSeek and haven’t noticed any drop in quality. It’s fast at around 300 TPS and cheap. I don’t miss frontier models anymore! Come up with a good process and you might not need them either.
How much do you get out of these models for same amount (say $20 sub for claude/codex/zai-glm) - the equivalent amount of tokens? Also is deepseek as good as glm5.3? (if we don't compare it with frontier models from USA)
Well, to be honest it’s all based on my subjective experience. I started benchmarking models on 10 of my real tasks ranging from easy to hard but even with the same model the completion time sometimes varied by as much as 50% between runs. That made me realize you’d probably need hundreds of tasks to get any meaningful numbers. Otherwise there’s just too much variance. So I can’t give you solid benchmarks without spending weeks testing everything properly. What I can say is that I actually use most of these models regularly for different things, so I’ve developed a general feel for them. DS is my main model for work, Claude for hobby projects and local AI, Fable mostly for design, Codex for various other tasks and sometimes Grok for health-related stuff. Cost-wise, a $200 subscription wasn’t enough to get through 20-30 tasks while $30 of DeepSeek was, and that was with Sol, not even Astra. Fable is expensive too and I haven’t found it particularly strong at coding. Opus 5 was horrible in my experience, though maybe 5.5 will be better since I’m testing it now. I also ran GLM 5.3 Flash locally for a while but it was pretty slow and its code was usually worse than both DS4.1 and Qwen Flash Next. Things are moving so quickly that it’s honestly hard to keep up, so take all of this as my general experience from actually using these models rather than a proper benchmark.
Thank you. This alone helps! I think I should jump into it once and try it all out while I still have GLM access at old prices as a backup.
Np, good luck! PS I’ve been using Sol 6 and Opus 5.5 today and they’ve been great so far. The new Opus is smart, fast and cheap. It makes mistakes but after every task I ask Sol to review it and it catches most of them. I need to test the models properly but it looks promising so far! Hope they won’t nerf them again. I think DS may still be cheaper though (and it’s 300 TPS via the API which is sick).
If you're producing slop, the quality of the model is irrelevant as long as it compiles. I frequently catch Opus/Sol making silly errors and over-engineering solutions while small ones like Luna struggle with complex tasks.
Deepseek on high reminds me of Opus 4.x which was quite good for a lot of tasks.
Incredibly cheap. What harness/orchestrator are you using?
OP replied to a comment of mine, they use Deepseek harness:
https://github.com/deepseek-ai/deepseek-harness
Deepseek is cheap and fast, but it couldn't follow the basic directions I gave every other model (GLM, Qwen, GPT, Claude) to use red/green TDD. Put me off of using DS.
Why did it need to generate its own driver when there is a Playwright MCP available and works right out of the box? Am I missing something?
Hey. I am on a GLM Coding plan subscription (old price; their base coding plan) right now and share the key (this will go away soon).
I was thinking of going with a subscription of Claude or Codex. The reason (at least that's what I am assuming): with OpenRouter or any PAYG per token setup there will be the anxiety of using up all the tokens in days or maybe 1-2 weeks instead of a month (say I set myself a budget of 15-20 USD per month, average equivalent of a usual subscription price).
Now I don't really want the top-notch models for the coding work I do.
So how much worth of "work/tokens" will I reasonably get for ≈$20 USD if I use it a lot? How much does that equal to - or is equivalent to, say in the world of subscription based Claude, Codex, or even GLM (with their 5-hour and all those cooldowns/limits)?
I am looking for a mental model/framework to visualise this. Can you (or anyone else reading this) please point me to a source where I can get some idea about this? I know I can just add $5 on OpenRouter and try to test. But I don't really know what/how to test these spends. I also want to understand how all this works. (I am new to agentic/llm world/coding, 2-3 months, after a career break of ~3 years, that too after working for more than a decade. I know, not at all good timing!)
A good resource is this: https://artificialanalysis.ai/?cost=intelligence-vs-cost-per...
Go to the "Cost" -> "Intelligence Index vs. Cost per Intelligence Index Task" That diagram maps their "Intelligence" score to "cost per task" and I think this gives a good basis on deciding with which model you want to go. Then you can either get an API token from that models provider directly or use openrouter and set openrouter to the model/providers of your choice.
You can also see on openrouter itself the details for each model like prices and what providers are offering it at what price.
Finally you can compare models details using openrouters compare feature like this:
https://openrouter.ai/compare/anthropic/claude-opus-5.5/open...
This is very helpful. Thank you!
what harness do you use? I do want to try out deepseek but don't know what the equivalent of codex/claude code is here
This is one of the things I hate the most. Super complicated workarounds which take loads of time (and sometimes money) for even the simplest problems. Human would pause and ask. I would blame harness, not the model though.
Insane!
I've reached the saturation point.
I don't have time to really get to know one model before the next is out, and I'm just talking about OpenAI and Anthropic, never mind the long tail of alternatives.
So I just more or less haphazardly pick one based on the mood I'm in, and set reasoning effort based on how much quota I have left.
For real. It’s exhausting at this point.
Best cost for a good result on our MacBook Pro SVG benchmark.
https://playcode.io/blog/macbook-svg-benchmark#model-claude-...
Btw, we have added Opus 5.5 as default model to playcode.ai
Back to Fable 5.1 - Opus 5.5 is now taking 10x longer just as Opus 5.
Opus 5.5 is neck-and-neck with Fable 5.1 and Astra 6 in my vibe-coding tests - maybe even better than Fable 5.1
Minecraft clone: https://senko.net/vibecode-bench/2026/voxel-opus-5.5.html (Opus 5.5) vs https://senko.net/vibecode-bench/2026/voxel-fable-5.1.html (Fable 5.1) vs https://senko.net/vibecode-bench/2026/voxel-gpt-6-astra.html (Astra 6)
Warcraft clone: https://senko.net/vibecode-bench/2026/rts-opus-5.5.html (Opus 5.5) vs https://senko.net/vibecode-bench/2026/rts-fable-5.1.html (Fable 5.1) vs https://senko.net/vibecode-bench/2026/rts-gpt-6-astra.html (Astra 6)
The above Opus games took ~45min to generate with the cost between $11 and $14 (per ccusage - I'm on a Max sub). Used from Claude Code with xhigh effort.
Full tests with prompts: https://senko.net/vibecode-bench/
It's interesting that Astra has a clear style that it applied to both games. It's a refreshing design language, but maybe that's because it doesn't look like something Claude has vibe-coded. In terms of gameplay depth, the Claude versions appear to be closer to the original Minecraft
Yes, it's solely because it's new. Back when the very first Opus vibe-coded websites appeared, we found them refreshing. By the 3rd one, we no longer did.
Tested it in the last few hours and it's MILES better than Opus 5. Finally the output is readable again!
So funny how both OpenAI and Anthropic post outdated pages at the same time. Opus 5.5 has benchmarks against Sol 5.6, and Sol & Luna 6 have their benchmarks against Opus 5.
Why do those labs keep releasing on the same day?!?
For this exact reason.
Probably one gets there first, then the other rush-releases theirs.
I don’t care about pricing, I don’t care about speed, I don’t care about the agentic coding improvements. Those are already fine. Does it still reply with walls of invented jargon, stitched-up phrases, and manage to cram 10 concepts/subjects in one sentence?
For your use case, I recommend the GPT-2 model. Fast, cheap, and open weights!
I don’t want it to talk like me, I want it to talk exactly.
I don’t care to look up terms as long as they are correct.
I don't understand, so it outperform fable 5.1 in every way and is cheaper ? Why do they insist on the fact that is outperform opus 5 and not fable 5.1
[cyber] classifier is incredibly sensitive with Opus 5.5 I cannot complete any embedded/driver/system-level tasks. Quite literally not a single task was able to complete today without getting flagged for [cyber], and what's more annoying is their narrow definition of what a cybersecurity specialist should be preventing me from getting an exception..
So stop using their models. The more money you give them, the more you are voting for this.
I got approved for the cyber program without problems and I’m not even a cybersecurity specialist
But even before that, when it flagged me, it just downgraded me from Opus 5 to 4.8 and went ahead with whatever I asked
The thing I'd actually want to know: is Opus 5.5 Medium genuinely equivalent to Astra High on real work...
In the niche benchmark I run it’s on par with 6-Sol, not close to Astra.
They killed cyber capabilities so I have to move over to Daybreak on Codex.
How do you update Claude Code to enable this? It’s listed under models, but says I have to update for 5.5. I run Claude update and it says I’m on the latest version.
Infuriating.
They might be rolling it out in stages. Mine updated to 2.1.280 and it supports Opus 5.5.
Are they going to reset the weekly limits after this awful inference week?
Why are there results for opus5.5 on arc-agi 1 and 2 but not 3?
https://arcprize.org/results/anthropic-claude-opus-5-5
I'm sure it's a good model, but I can't in good conscience sign up to Anthropic again given how they behave. What a shame.
Use it now as much as possibles. In a week or so it will start to suck as Dario turns the knobs to nerf it.
Evidence for this?
Evidence is my experience. I think someone documented it as well, it was a top post here.
I have used Fable, Astra, Opus 5 and Sol 5.6 in Claude Code and Codex heavily since each of these have been released. Recently, I settled for Sol 5.6 as my daily driver, but with this release Opus 5.5 might be the one.
Fable is on a class of its own when it comes to coding and orchestration, but it runs out pretty quick and is prohibitively expensive and slow. For me, Astra wasn't as good of an upgrade from Sol when it comes to coding and orchestration, and it runs out pretty quick too. Opus 5 had so much potential but was such a pain to talk to, so I only had other agents delegate to it.
Given this, I kept coming back to Sol 5.6 as my daily driver (with consultations from Fable and Astra when available). Sol has an autistic character that smells like RL deepfry, which can be annoying, but it is nonetheless predictable, communicates more plainly than Claude, and is good at code and orchestration.
But this Opus 5.5 might just be it. Fable-level performance that's cheaper and faster, and communicates plainly and briefly. If it pans out in practice, I might just have a new daily driver and it might be time to raise the bar for what can be achieved.
I'll try out the new Sol 6, though Opus 5.5 seems to beat that release fair and square (at least on paper)
I'm also glad we are paying attention now to the experience of using a model, not just how good it is at 'x' class of tasks.
Why did they retire Opus 4.7 for this?
When coding, the top-tier model is ultimately too expensive, so I use Opus, but the news that the cost per use for GPT or Claude is going down is very welcome. I really like that they’re even changing the writing style. I was worried whether it was a problem with my settings or if my literacy was declining. Both improvements are welcome.
The endless cynicism in this thread is so very draining. Can we not do this terrible circle of excessive criticism?
The productive comments here are so far and few between. I have no issue with people criticizing Anthropic or AI companies in general, but for the love of everything, at least make worthy criticisms. Not these incessant sophisms.
It almost makes you understand how a well-coordinated artificial superintelligence could wipe us out, eh?
I for one welcome our AI overlords.
I am mostly excited about all this but also feel incredibly sad at times about many aspects of it. We need a new word for this feeling pronto.
blursed?
Deep Blues.
Yeah this website is almost unreadable
The cynicism will stop when the musical chairs of money fueling the bubble does.
The one I've gotten extremely tired of is every single AI thread now having dozens upon dozens of the exact same joke where people talk in Claudish.
It was funny the first time. But I genuinely don't understand people 6 levels deep or 30 comments down the thread thinking, "wow - this'll really knock their socks off".
In a previous thread on Mythos 5.1, simonw posted an animated version of his pelican. [0]
Using claude.ai and Opus, I asked "create a 3d animation from this" and pasted the animation SIML.[1] I just did that test again. There is significant improvement.
Opus 5.5 (high): https://claude.ai/artifact/5EgqfWcyVtLwJDQq6fsPUm
Opus 5 (high): https://claude.ai/public/artifacts/b37a9ee2-f5bc-4ff9-ae90-a...
[0] https://news.ycombinator.com/item?id=49526704
[1] https://news.ycombinator.com/item?id=49532609
Disclaimer: the skills and system prompt on claude.ai could have also improved, this is not a raw API call.
If this the benchmark they could well have gone to town on it.
The Pelican is nice, simple and. Lean though.
excited to try this out. the thing with new models though even if it claims to be cheaper, sometimes it spent less tokens on different task. I found that with Astra I'm actually not so far off from Opus 5 since it spends much less token to complete a task. The claims in the article that it surpasses Astra on a lot of things is interesting to test though
Anecdata ahead: I took some time to work with Opus 5.5 today. The work feels strong and comprehensive. I'm not getting the ugly "claudish" speak of Opus 5.0. Communication feels more natural and pleasant to read. Good results so far in my preliminary research.
Huh ..., not another one!
The new opus is so friking incredible that we had to put some safeguards like in fable... means... we notice that Opus can still do some of the work that we want to charge WAY more and we can't do it if the cheaper model does it...
1 year later... whoops sonnet 1337 gets safeguards... because it's so amazingly incredible... and we are sorry but opus 69 goes up in price...
and we are now releasing claude Astro-pus-able... 1000$ to hear the summary about what you want to ask... if you have to ask the price for the output you can't pay it
Is this less insufferably annoying than Opus 5? That's the question on everyone's minds. Love Opus 4.8 though.
Yup same question here
Yeah I've been stuck on 4.8 too, the opus 5 problems seem mostly fixed. It obeys and writes concisely rather than running off, doing its own thing, and emitting a word salad.
The hype/degrade/hype marketing cycle that Anthropic uses to cycle between Fable/Opus or Opus/Sonnet releases is too obvious at this point.
Opus 5.5 will be great for 2-3 weeks than the nerfing starts. They give out some extra credits. It keeps degrading Opus until it's unusable . By that time they are ready to release Fable 6. Which also is great for a few weeks, and so on.
So no issue hopping from new model to new model? Feel like every frontier company is doing this lol. Would be more alarming for this to not happen.
My Mac Studio arrived yesterday and one of the first things I did was cancel my Claude subscription. Happy to be free of load bearing, price gouging, paternalistic "altruists" Anthropic.
Am keeping my Codex sub while I find the best local model, but my plan is to eventually stop with OpenAI too.
So in a thread about the release of Opus 5.5, this is your contribution? Why?
I have just continued my pending work (a planning stage with reviews) with 5.5 on medium and it is much better at communicating and much faster(2-3x responses, edits and compaction). Seem to be smarter as well, but maybe it is that I understand what it says now.
I almost feel like it is nice to use again.
Without pacing we would have had Opus 6.. damn it! /s
This actually feels like the release of the Opus 4.5 -> 4.6
been using it for half a day now. the token spend is noticeably less.
I can't get my workplace to approve Claude.
The Design Language on this announcement page is a perversion of human nature.
According to their ToS, conversations flagged by the guardrails when using Fable are stored longer for moderation. That included Fable's guardrail for AI research. Moderation can mean a human looking at your conversation.
Does that mean that I can no longer trust Opus with not snitching my AI research to Anthropic either?
You never could trust it. Fundamentally you leak everything your LLM uses to their servers.
GPT 6 Sol is still better and 2x cheaper in my benchmarks:
https://aibenchy.com/compare/anthropic-claude-opus-5-5-high/...
How do you know it has 5T parameters?
It's an estimation based on information found on the internet/rumors: https://aibenchy.com/model/anthropic-claude-opus-5-5-high/
Mostly based on previous relesses info.
Low value comment, but written by hand: I like the speed improvements. Much more fun to work with Opus now!
A year ago I was trying to have these models write css for me to support mobile styles for an ERP system. There were so many quirks that you typically have with css, and it couldn't figure out how to properly get it done. I'd ask it to fix something and it'd break something else - pretty much as good as any average developer is with css.
Out of curiosity, I tried the same project yesterday with OpenAI's newest model, and it had 0 issues. It seems to have a much deeper understanding of how global styles and local styles work across different modules.
It's fun seeing how even a year ago these models seemed so capable to us, and yet they're still improving greatly. I'm still not using Anthropic. I used to change back and fourth periodically as the models would surpass each other, and get the most expensive plans, but I've settled and am happy with the capabilities of the lowest tier subscriptions now because they've progressed much faster than I've had use for them. Maybe I've gotten more efficient with language and instructing the model since a year ago. Still, it's been a fun ride and I'm excited to see what else we can do with these models as time goes on.
My first Opus 5.5 session ran `pkill -f "cat" -U <user> -n` when it wanted "to stop a stuck cat" (the explanation it gave when I asked why). On MacOS the command kills every process with "cat" in it. I was using effort high and auto mode.
That's the first time since I started running Claude Code nine months ago that a session causes actual harm to other work on the same machine. Can still be a coincidence.
I'm very curious what your prompt / conversation was. I'm an avid claude code user, and maybe I have something to learn about how not to prompt.
I found no time to write this up properly but I asked Sonnet to analyze the session transcript and write a postmortem https://gist.github.com/solsson/1d6ba4783582b442b2e66e441c36...
Similar experience, the first thing it did for me was update production data models without a confirmation. It has always shown me the command is going to run and then I confirm.
By the way any tips on making Opus 5.5 hardening the security of your applications without falling back on 4.8 ? I´m trying to get things done but security classifier kill all attemps to better secure my app.
Is it finally getting better than opus 4 though? That's what I really wonder
"pace the frontier" is the new "flatten the curve"
If you're focused on the price drop rather than the increased capabilities of 5.5 you're ngmi
Token spend is noticeably less than Opus 5, I can't really tell if it's better though.
My enterprise org has this model disabled because "security."
Does this mean they literally need to go in and check a box? Or is it a standard thing that enterprise accounts get these later than the consumer/API accounts?
Most likely they disabled it because it can* retain data if they deem they need to like Mythos/Fable.
So far all sessions I’ve started with opus 5.5 have avx512 support, not like all other models where it’s a dice roll each chat.
In your real world experience outside of the benchmarks hows this performing compared to Opus 5? Asking because 5 was so horrible for me I switched back to 4.8.