NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
▲GPT‑6.2 Astra and Sol (openai.com)
intenex 23 minutes ago [-]
Performance is insane for the cost if those benchmarks hold up. Looks like they did time this for right before Anthropic's IPO. Curious what Anthropic releases in response, and how these do on real world tasks.

Feels like we're way past the pelican benchmark being useful at this point. Anyone have a better benchmark for a quick vibe check on how this compares to Fable 5.2 and Opus 5.5?

revolvingthrow 6 minutes ago [-]
> Looks like they did time this for right before Anthropic's IPO.

Would it be in OAI's interest to kick the legs from under Anthropic? Granted I don't think they can, but a shot across the bow can sometimes be more damaging that one expects (I think FTX collapsed due to one? Or maybe I'm misremembering).

I always assumed that if one of the big AI IPOs fail hard enough the neoclouds start to go bust, which causes a chain reaction that probably causes both ANT and OAI to collapse.

alastairr 14 minutes ago [-]
I didn't find Sol 6.1 nearly as impressive in real SWE use compared to what the benchmarks implied. It wouldn't surprise me if the models have internalised some kind of 'benchmarking mode' which only kicks in when some attributes that are peculiar to how benchmark problems are presented.
seizethecheese 10 minutes ago [-]
Yeah, in real SWE tasks, 6.1 is bad.

We've been trying to capture real SWE data by building a battle system on top of OpenCode. In our data, Sol 6.1 is seriously underperforming, I'm talking worse than DeepSeek 4.1 Flash, at 10x the cost. (Though to be fair, statistically they are tied in performance, though not at all in cost.) https://agentduel.com/leaderboard

(It's possible for a tiny model to do better than a large one because contrary to typical Arena methodology, because we think a fast good enough answer is better than a slow one.)

OpenAI performance on our system has been bad enough I switched to Anthropic models for my daily work.

pkthunder 10 minutes ago [-]
We've recently moved away from Anthropic models at $PAID_JOB and over towards GPT models. I'm trying to be open-minded but the GPT models we have (5.6 Terra and Sol) are just not that great. They're fine, but even simple things such as "check my work on this small Bash function" get it to point out stuff that's already implemented in my work. I don't know if it's me/how I use it/whatever, but just some N=1 evidence, I guess.
drdexebtjl 3 minutes ago [-]
[delayed]
Doohickey-d 38 seconds ago [-]
Well, yes, if you switch from current claude model to something that was released in July, of course it will be worse...
ok_dad 4 minutes ago [-]
5.6 series is worse and more expensive than the 6 series. Try the latest Luna and sol; I use those for 100% of my work right now, with sol doing only 10-5 percent of it. I code in go and review the work and edit it extensively though, so I don’t know about how good those two are at vibing slop.
skerit 8 minutes ago [-]
I had the same impression. None of the GPT-6 models were as great as they claimed, they never surpassed Fable or Opus 5.5 on my use-cases.
suddenlybananas 11 minutes ago [-]
You make it sound as though the models are like not working to their full potential instead of being a little bit overfit on the benchmarks.
ijustlovemath 17 minutes ago [-]
I've been having fun with having it build interactive Three.js demos of devices, with setup screen, a few different operational modes, mechanical movements etc
underdeserver 22 minutes ago [-]
I wonder why they didn't show Gemini 4 Carbon's scores on the science benchmarks, especially since Google seems to be pushing it for that -

https://x.com/pushmeet/status/2120814064863461440?s=20

(FD: Google employee, I don't work on Gemini)

knuppar 18 minutes ago [-]
Yeah it feels shady how Carbon was selectively plotted (or not), unlike Opus/Fable
TiredOfLife 19 minutes ago [-]
Two posibilities. 1. They couldn't figure out how to actually use those Google models.

2. They launched the benchmark days ago and Gemini is still rereading the file with tasks.

theanonymousone 23 minutes ago [-]
Happy for the new Sol. It's my workhorse on company account.

But more than that I'm waiting for new Luna. To me it was the game changer that ended "Tokenpocalypse", and is still almost unbeataben in "infinitely using a decent model" use case.

SomeonesAccount 20 minutes ago [-]
I find that Luna tends to misinterpret instructions in READMEs and Agents.mds. Maybe it is something specific about my setup, but I found that Terra is the lowest I can comfortably use on its own (Luna can be driven by larger models in the form of a subagent and it works great for that)
MrBuddyCasino 14 minutes ago [-]
I used Luna Max a lot, until Deepseek 1017. Then never again.
Topfi 14 minutes ago [-]
Office work has never been OpenAIs strength, no shame in that by itself, but these Slideshow examples look particularly awful, far worse than what I myself got out of GPT-5.6 Sol about two weeks ago in a single prompt.

Same for Workbooks and memos, those examples read inferior to some pre Opus 4.5 and Kimi K2 Thinking docs I have kept around. It's ok for a model not to be great at these, but these are some very poor examples. I am really confused what is going on at OpenAI in this regard.

I remember the same with their frontend blog post a few months ago that they proudly shared while filled with visual glitches, bugs and issues. Also, the vibe charts from a bit before that. Please, get someone with fresh eyes to look at your communications before you publish, these leave a very bad first impression.

Regardless of office work, I can't wait to find out whether these models finally adhere to a prompt or are still willing to carry out explicitly disallowed, irrecoverably destructive tasks, just because those might (but don't even always) get the model to a result more quickly along with some of the other regressions that have been present since the release of GPT-5.5. GPT-5 to GPT-5.4 were truly groundbreaking, but since then there have been regressions in what made those models so useful and reliable.

joenot443 15 minutes ago [-]
The video is pretty funny. It's like a callback to 90s/00s office life?

I'm immediately reminded of the famous Excel elevator commercial. [1] Perhaps that was intended?

[1] https://www.youtube.com/watch?v=HegoJaXOIqQ

apetresc 7 minutes ago [-]
I guess it's kind of funny in a tacky way, but pretty much every scenario is just "oh shit I was too lazy to do my job and now I'm about to be called out, better throw it into ChatGPT literally ten seconds before I get in trouble."

Not sure this is the way OpenAI should try to make their case for why AI is a net societal benefit. It feels more like an SNL skit making fun of an OpenAI commercial.

Like, why not just throw in a high school student cheating on a test with their phone under the desk, at that point? Oh but it's a Nokia flip phone, haha, just a joke.

noir_lord 3 minutes ago [-]
Funny but Dystopian, the message is "Half arse your job, the clanker has you".
jrflo 4 minutes ago [-]
Looks like a great efficiency gain.

What caught my attention was the bit in the Alignment section:

> Both models performed similarly to GPT-6 Astra on most alignment evaluations, and took fewer improper actions in simulated workplace tasks. However, in two tests, they were more likely to omit mentioning obstacles that blocked their work, such as a missing file or unavailable search tool. We added instructions in Codex that substantially reduce these omissions, and we’re continuing to investigate the behavior.

So the models are inherently less transparent, unless you ask them to be more transparent? Seems like a band-aid solution...

HyperL0gi 4 minutes ago [-]
My company can only hold one subscription per employee, and I still can't find a reason to go back to OpenAI after migrating to Claude once Opus 5.5 was released. It's super efficient, I almost never run out of tokens with the Teams Premium seat, and Fable is fantastic. They lost me when Astra was released and tokens simply evaporated with a few prompts.
kingstnap 21 minutes ago [-]
Seeing them keep prices low is awesome. Was worried for a while that it would be like the GPT5.x series where progressively the models just got more and more expensive.
minimaxir 10 minutes ago [-]
The GPT-6.2-Astra 20% price reduction is a match to Fable 5.2's 20% price reduction (although Astra is $0.40 MTok cache read vs. Fable 5.2's $0.20 MTok cache read).
Rperry2174 17 minutes ago [-]
I feel like the fact that they're not public lets them play the subsidization game though. And the same playbook that Anthropic started at that.

Would be awesome if it stays this way though

oh_no 12 minutes ago [-]
we've seen anthropic numbers, inference is not being subsidized by these companies
suddenlybananas 9 minutes ago [-]
Did you read what they wrote carefully?
wds 16 minutes ago [-]
The promo video seems to be a pretty strong rip on the 90's Microsoft Excel elevator ad. [1]

Maybe it found its way into the training data?

[1]: https://www.youtube.com/watch?v=HegoJaXOIqQ

rafram 5 minutes ago [-]
The “training data,” as in, the humans who made the video were inspired by it?
mrandish 4 minutes ago [-]
Recently, I've complained about OpenAI (and other tech company's) product landing pages communicating virtually no useful information about what the product is or why it might useful. So, I have to concede this is at least a step in the right direction.
Robdel12 3 minutes ago [-]
Nice! I still use GPT-6 luna for a ton of stuff, it's super solid (for me). So I hope there's a little bump for that model, too, soon
charlesabarnes 23 minutes ago [-]
Its been stated often, but I appreciate that OAI is now bringing the topic of conversation to "task completion cost" rather than brute forcing solutions
christianqchung 24 minutes ago [-]
Caught this on my lunch break, their linked system card (https://deploymentsafety.openai.com/gpt-6-2-astra-sol) isn't up yet.
specked-citrus 10 minutes ago [-]
It's up now
rcr-anti 9 minutes ago [-]
Odd, doesn't look like they're available on the cloud providers, only first party. Not a single mention of Azure or AWS.
jotato 20 minutes ago [-]
Am I reading these charts wrong? It seems like in most cases 6.2-sol : 6.1-sol Isn't that big of a change? It is a little smarter but costs a little more.

edit:

Take a look at Frontier Code 2.0. I generally run 6.1-sol at High. That would be 34.9% at $0.65 62-sol get's a 38.3% but costs $0.68

So yeah, I can decrease the effort which might give me a faster slightly smarter result....but /shrug

Isaackoz 11 minutes ago [-]
Looks like 6.1-sol high+ is equivalent to 6.2-sol medium at the same price. So a bit smarter at a cheaper cost.
jotato 7 minutes ago [-]
which benchmark are you looking at?
munksbeer 5 minutes ago [-]
Are they intentionally lowering the cost of these models to the extreme, because of the Anthropic IPO? This just seems insane?
pvab3 19 minutes ago [-]
Cool, looks like 6.2 Sol is cheaper than Sol 6.1. I've stopped using Astra because it also goes and does things that I didn't want or didn't ask for, and burns a bunch of credits while doing so.
tech234a 12 minutes ago [-]
Tweeted 11 minutes ago https://x.com/OpenAI/status/2122750124543926515, posted to HN 18 minutes ago
jhoho 21 minutes ago [-]
Very much on time (scroll down to "Release-Prognose"): https://www.heise.de/en/news/Alibaba-launches-Qwen4-Max-more...
hmate9 25 minutes ago [-]
Will need to play around with it to get a feel but those benchmarks with those costs look incredible!

It seems like they were saving these for just before ANT's IPO

Cu3PO42 17 minutes ago [-]
I find that 6 Astra already had very good taste in frontend design, but relatively poor taste in "nice and readable code". I really hope this release cracks that. Excited to try it out!
Ritewut 15 minutes ago [-]
I'm still waiting for the shoe to drop. It's literally impossible for the prices to remain this low for much longer.
billypilgrim 23 minutes ago [-]
I have yet to find an application for Astra vs Sol where the former is noticeable better. Genuinely asking, does anyone feel a big difference in their work between the two? If so, what are you working on?
Marha01 2 minutes ago [-]
For creative writing, Astra is better than Sol. Bigger models tend to be better than smaller ones for such tasks.
itvision 10 minutes ago [-]
I have a 1.5 MB C++ codebase, and at least a third of the tasks that Sol completed required cleaning up by Astra.

Astra usually produced good output from the outset. Sol did not. Astra also designs things more effectively.

whimsicalism 20 minutes ago [-]
Subagent coordination, Astra also performs better on Opus/Fable thinking/modeling shape problems imo, also computer use/thinking about shapes. Astra is able to hear waveform images which is pretty nuts.

For just doing things or coding things up, Sol all the way.

zeroxfe 16 minutes ago [-]
Wow, that's the opposite of what I see. I always simply use Astra (high), despite the cost and latency overhead -- it's just a lot more reliable. I find that on average it uses fewer tokens for a task (and I lose less hair per task), simply because I don't have to steer it as precisely .
chaos_emergent 21 minutes ago [-]
I find Astra to have a lot better ability to coordinate subagents compared to Sol. I haven’t found a distinction in the complexity of work they can handle.
juliusdaniel7 21 minutes ago [-]
[dead]
gunalx 19 minutes ago [-]
EE/circuit design is way better with astra.
vessenes 8 minutes ago [-]
Audit
rendang 23 minutes ago [-]
Surprising that their top model would be still be so cheap, and yet not surpass Fable in the high cost part of the curve
preommr 17 minutes ago [-]
I care less about the models being good and more on if I can fallback to them if Opus 5.5 gets a massive price hike after the IPO
geauxvirtual 23 minutes ago [-]
Website pegs my GPU at 100%. Are they mining for crypto with this announcement?
enjoyyourlife 16 minutes ago [-]
Trying new ways to create distributed systems to train their LLM
sreekanth850 2 minutes ago [-]
So they release 6.2 just before Anthropic IPO.
ImJasonH 2 minutes ago [-]
500 | Internal Server Error
kingstnap 16 minutes ago [-]
The announcement video is really cringe imo.

Like do we really want people to be making last minute unreviewed AI generated slides and reports for work?

matt3210 23 minutes ago [-]
> frontends that look and work better

The website doesn't event show the graphs properly.

mynameisvlad 22 minutes ago [-]
The graphs look fine on my computer. Can you elaborate on what exactly isn't "shown properly"?
finger 5 minutes ago [-]
Unreadable on the phone
mynameisvlad 3 minutes ago [-]
Unreadable how? If it's the width, you can always... turn your phone sideways?
lwarfield 19 minutes ago [-]
I wonder if these will have the same crazed rotwiler feel that previous OpenAI models have had.
voidmain0001 7 minutes ago [-]
I hope the video advertisement on that page was made with ChatGPT and a video plug-in otherwise if it wasn't then what's the point of Astra and Sol?
guybedo 20 minutes ago [-]
Benchmarks look good, it most often is the case with Astra and Sol.

And then i start doing some actual work and everything breaks down, and i have to go back to Claude to fix the mess.

I'll probably give it a try but i guess i should be prepared for some serious over engineering once again.

You ask for a 'hello world' and you get load bearing sealed artifacts with hashes and p99 performance testing for 3 days without having the actual 'hello world' in the end

I_am_tiberius 10 minutes ago [-]
No reset?
deathtrader666 26 minutes ago [-]
Waiting for the pelicans benchmark.
foolserrandboy 12 minutes ago [-]
With the red scarf and fish in the front basket...
zb3 11 minutes ago [-]
> we’re launching GPT‑6.2 Astra and Sol with tighter safeguards for higher-risk cybersecurity assistance

Seems they really want these "safeguards" to be as ridiculous as those of Claude..

onlyrealcuzzo 7 minutes ago [-]
TL;DR - from the little I could gather, this looks impressive.

But... is it just me, or does this product launch page look like AI Slop?

https://www.vals.ai/comparison?m=claude-fable-5-2,gpt-6.2-as... seems like a better comparison than what I could get from their page.

Astra is ~20% slower, ~40% cheaper, and a bit less powerful than Fable. Sol remains way cheaper than anything remotely in the same league, and it's speed to complete tasks seems to have improved considerably.

Scrolling through it has the same hypnotizing effect of trying to read anything written by LLMs.

It seems like things that should make sense, then I try to look at the charts and a lot of them are comically unreadable.

I tried interacting with some of the examples, and the Lamp Builder - for example - I couldn't even figure out what it's trying to show or what I'm supposed to do - or why I should be impressed.

montenegrohugo 26 minutes ago [-]
Nice 3D effect. Runs surprisingly well even on on brave on my linux pc without hardware acceleration
bananaflag 24 minutes ago [-]
Is this the Bel model?
dyauspitr 15 minutes ago [-]
I beseech the incoming Democratic politicians to not curtail progress in LLMs.
Kinrany 6 minutes ago [-]
Simply optimizing the current models to be faster without making them smarter would already give us a decade of improvements to build on top
Guyadou 17 minutes ago [-]
Those AI labs got to chill. almost every day there’s a new model! Lol
Ersho 26 minutes ago [-]
Another wave of Openai just killed ....

Also, is it website very laggy or is it just me?

ex1fm3ta 27 minutes ago [-]
I thought OpenAI would drop an awesome model on the day of Anthropic IPO, just to troll them
zarzavat 21 minutes ago [-]
It's actually in OpenAI's interests that Anthropic's IPO is successful.
SomeonesAccount 14 minutes ago [-]
explain?
rose52152 11 minutes ago [-]
If Anthropic is a valuable company, then OpenAI is just as valuable, if not more.
petesergeant 22 minutes ago [-]
"Agents' Last Exam v1.1" did a human really look at this and say "nah, a linear scale is definitely the right way to show this"
jrflo 6 minutes ago [-]
They probably want to show how far to the right Fable is
lsch1033 17 minutes ago [-]
[flagged]
jfrbfbreudh 19 minutes ago [-]
[dead]
25 minutes ago [-]
sick_of_slop 5 minutes ago [-]
[dead]
lynguist 21 minutes ago [-]
Called it out 7 days ago: https://news.ycombinator.com/item?id=50431144#50433568

Actually I was really wrong. The model is not expensive!

enraged_camel 22 minutes ago [-]
Dead on arrival, judging by the FrontierBench scores. Astra 6.2 is five percentage points below Fable 5.2 xhigh.
skybrian 17 minutes ago [-]
Whatever you’re doing, it’s unlikely to be what most users are doing. Fable and Astra aren’t in my price range so I’m paying attention to Sol.
f3408fh 20 minutes ago [-]
The point is that it's a fraction of the cost.
enraged_camel 19 minutes ago [-]
I think "second place but also cheaper" isn't what OpenAI needs right now.
swiftcoder 14 minutes ago [-]
"Close second, and also cheaper" is however a pretty solid framing when your competitor is trying to IPO
enraged_camel 9 minutes ago [-]
That remains to be seen. I think if OpenAI's goal was to torpedo Anthropic's IPO, they should have released a model that is significantly more intelligent and capable. I don't think investors will be impressed by this release, which I think is simply OpenAI trying to stay in the race.
swiftcoder 4 minutes ago [-]
I don't think torpedo'ing the IPO is actually in their best interests? OpenAI also wants to IPO at some point, and if Anthropic fails spectacularly, investor confidence in a second big IPO in the AI space is going to be shaky
alexdykyi 27 minutes ago [-]
[flagged]
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 18:17:30 GMT+0000 (Coordinated Universal Time) with Vercel.