GPT-6 Astra Deep-Dive
A generational leap — or a carefully staged narrative?
This report cross-checks OpenAI's official account, the ARC Prize foundation's independent retest and more than a dozen public reports, splitting GPT-6 Astra's results into two layers — bare-model capability versus the system capability of model plus agent framework. We size its real lead, dimension by dimension, across math, abstract reasoning, cybersecurity, computer use and coding; we then assess its "sell the cost of a task, not tokens" pricing, its Critical safety rating, and the structural consequences for the LLM ecosystem.
Executive Summary
The 30-second version: Astra's leap is real, but it is concentrated in two lanes — getting work done inside real software environments, and cybersecurity. The near-perfect scores that went viral partly reflect the vendor's own evaluation scaffolding.
First flagship whose training supervision deeply involved a predecessor model
Different objects of measurement: system capability ≠ bare model
First public model to reach Preparedness "Critical"
Three findings that matter
- ① The genuine leap is in delivering work and in security — not in test-taking: research workflows (Terminal-Bench Science) are up 188.4% on the prior Sol generation, office automation (AutomationBench) up 128.7%, and average time per OSWorld task falls from roughly 75 minutes to 40 (−47%). These are structural gaps.
- ② The most dazzling scores carry clear scaffolding gains, and coding is not a rout: on ARC-AGI-3 Astra scores 99.9% under OpenAI's own Provider Adapter but just 62.7% under the ARC Prize neutral harness; on long-horizon coding (DeepSWE), Meta's Muse Spark 1.3 (75.4%) actually edges past Astra (74.1%), and on Terminal-Bench it leads Claude Fable 5.1 by only ~2.1 points — inside the same confidence band.
- ③ Cybersecurity is both the hardest capability and the one to watch most carefully: a 39% success rate on high-severity V8 bugs newly disclosed in Jun–Aug 2026 (Sol 5.5%), and the evaluation found and exploited two previously unknown zero-days. That is precisely why full offensive capability is withheld and released only through controlled, gated channels — for the first time, "the stronger the capability, the narrower the distribution" becomes a product design.
The one-line takeaway
If your core value is end-to-end completion of complex computer tasks, research pipelines or security work, Astra is today's only model that has pulled clearly ahead. If you are writing code, answering questions or optimizing cost per token, its edge over Fable 5.1, Muse Spark and Gemini Flash sits within the margin of error — at 8–12× the price. Decide by scenario in Section 08; do not be led by a single headline score.
Background
Less than two months after GPT-5.6, OpenAI launched a new flagship on an extraordinary scale, pushing both the "AGI narrative" and a safety rating onto center stage at once.
What happened
On September 3, 2026 local time, OpenAI released GPT-6 Astra ("Astra," Latin for star), billing it as "the most intelligent and most aligned model in the world today," spanning computer use, web browsing, software engineering, cybersecurity, scientific research and professional work. Note the sequencing: on September 1 OpenAI first confirmed that Astra had crossed the "Critical" cybersecurity threshold in its internal Preparedness Framework and would restrict that capability; the public launch came only on September 3 — the safety classification preceded the product reveal.
Two signals matter more than parameter counts. First, president Greg Brockman closed the launch with "Welcome to the AGI era," while conceding AGI is "a fuzzy concept without a clear boundary," no longer tied to the trigger clauses in the old Microsoft contract but rather "a mission-level, spiritual notion." Second, Astra is OpenAI's first publicly deployed model to reach the Critical cyber threshold — a backhanded distinction, meaning it can autonomously discover unknown vulnerabilities and build exploit chains with minimal human help.
Four launches in one week: frontier labs enter the "scenario split" phase
- Anthropic: shipped Claude Fable 5.1 (its Mythos/Fable line faces U.S. government deployment curbs over safety concerns).
- Google: released Gemini 3.8 Flash, doubling down on multimodal reach, distribution and low-price high-throughput.
- Meta: released Muse Spark 1.3, betting on extreme low cost and open weights.
- OpenAI: released Astra, betting on Computer Use and high-value long tasks.
Three questions this report answers
- Which advantages are structural, and which are illusions created by how a score was produced? (Sections 05–06)
- Does the high-price strategy of "selling task cost, not tokens" hold up financially? (Sections 07–08)
- What does a Critical safety rating and the AGI narrative mean for industry rules and procurement? (Sections 08–09)
Data & Method
This report does not republish any single leaderboard. Vendor self-reports, independent third-party retests and media accounts are used in tiers, and every chart labels its protocol.
Source tiers
| Tier | Source | Used for | Protocol type |
|---|---|---|---|
| Primary · vendor | OpenAI launch page / System Card | Official benchmarks, pricing, specs, safety conclusions | Vendor self-report (incentive to choose its own harness) |
| Primary · framework | OpenAI Preparedness Framework v2 | Original definition of Critical | Vendor-defined standard (publicly checkable) |
| Independent third party | ARC Prize foundation (blog/results) | Neutral-harness ARC-AGI-3 retest, cost | Independent evaluation, highest weight |
| Independent (cited) | Epoch AI | Flags OpenAI's ties to FrontierMath | Independent research body |
| Media accounts | The Paper, Cailianshe (CLS), Beijing News Shell Finance, QbitAI, NetEase, Sina, Phoenix, Bloomberg (republished by Beijing Municipal S&T Commission), etc. | Event cross-check, valuation and market context | Secondary; minor transcription variance |
Three "protocol traps" to recognize before reading the scorecard
- ① A different harness is a different score: the same model, under a vendor adapter that carries opaque reasoning state across turns and compresses context, can score 37 points above its result under a neutral harness identical for every vendor. The former measures the system capability of model plus agent framework; the latter is closer to bare-model capability.
- ② Held-out tests are where truth shows: aggregated question banks can be contaminated by training data; tests on vulnerabilities disclosed 6–8 months before release are far more credible. ExploitBench's 100% aggregate and the 39% on novel bugs must therefore be read separately — and the former is a "capability coverage rate," not a pass rate.
- ③ Different test-set versions are not directly comparable: Anthropic's 77.9% on OSWorld used a different versioned subset, and its authors explicitly say it cannot be set against Astra's 72.6%.
Subjects & Dimensions
Astra is the subject; same-week same-tier flagships and the prior generation serve as controls, spanning the full chain from "brainpower" to "manual work" to "alignment."
Comparison models
| Model | Vendor | Role in this report | Input / Output $/1M |
|---|---|---|---|
| GPT-6 Astra | OpenAI | Subject | $10 / $50 |
| GPT-5.6 Sol | OpenAI | Prior flagship; measures the generational increment | $4 / $20 |
| Claude Fable 5.1 | Anthropic | Head-to-head high-price flagship | $10 / $50 |
| Muse Spark 1.3 | Meta | Open-weight / extreme-low-cost control | $1.25 / $4.25 |
| Gemini 3.8 Flash | Low-cost high-throughput / multimodal control | $0.75 / $3.75 |
Analytical framework
| Dimension | Representative benchmarks | What it measures |
|---|---|---|
| Research-grade brainpower | FrontierMath Tier4 v2, GPQA Diamond | Research-level math, graduate-level science |
| Abstract / agentic reasoning | ARC-AGI-3 (dual harness) | Discovering rules and acting unaided in novel settings |
| Cybersecurity | ExploitBench aggregate + held-out novel bugs | Vulnerability discovery and exploit-chain construction |
| Computer use | OSWorld 2.0, AutomationBench, ALE | Cross-software operation and delivering finished output |
| Engineering & research flow | Terminal-Bench 4.0 / Science, DeepSWE | Completing complex engineering/research tasks in a terminal |
| Alignment & controllability | Out-of-scope tasks, capability-hallucination rate, UK AISI supply-chain tests | Respect for authorization boundaries and monitorability |
Analysis by Dimension
Each dimension follows a fixed rhythm — chart, source, interpretation — and distinguishes a genuine lead from a protocol lead.
5.1 Research-grade math & science: near saturation, but the field is strong too
FrontierMath Tier 4 v2 (research-level math, %)
- The absolute level is real: 97.6% puts a research-grade math benchmark near saturation, and OpenAI says it has helped resolve several long-standing math problems.
- But it is not a generational gap: Fable 5.1 already reaches 87.8%, and Gemini Flash trails by just 0.7 on GPQA. On this dimension Astra is "the top-scoring student," not "the only one who passed."
5.2 Abstract reasoning: both 99.9% and 62.7% are true — because they measure different things
ARC-AGI-3 Semi-Private (%, dual-harness comparison)
- The 37.2-point gap is a "system bonus": the adapter lets the model carry opaque intermediate reasoning state into the next turn and compress context — essentially the score of a model plus a strong agent framework. The standard harness allows only the brief notes the model itself chooses to keep.
- Yet 62.7% is still a huge advance: against Sol's 7.8% and Opus 5's 30.2%, Astra is a decisive first under the neutral protocol and beats the human median on action efficiency — leading even after wringing out the inflation is more persuasive than 99.9%.
- Methodological significance: this is the textbook case for reporting "model capability" and "system capability" separately — and the reason this report keeps returning to protocol.
5.3 Cybersecurity: the hardest claim here — and the one to watch most warily
ExploitBench aggregate (capability coverage, %, not a pass rate)
Held-out: success rate on high-severity V8 bugs newly disclosed Jun–Aug 2026 (%)
- This is a rating "with teeth": full offensive capability is not open to the public, server-side safety checks can terminate a task outright, production monitors out-of-bounds behavior in real time, and security customers are supplied first through the controlled Daybreak / Trusted Access channels.
5.4 Computer use & engineering delivery: here is the real gap
Rather than compare absolute scores one by one, look at Astra's rate of improvement over the prior Sol generation — comparing growth across benchmarks pinpoints exactly where the leap happened.
Astra's score improvement over GPT-5.6 Sol (%)
- The leap concentrates in carrying complex flows through to completion: research workflows +188.4%, office automation +128.7%, terminal engineering +55.2% — Astra's strength is long-horizon, multi-step, cross-tool process capability.
- Computer Use moves from demo to production: in an official demo a pediatrician-research lookup took 2 min 54 sec (versus ~5 hours for a human); average time per OSWorld task dropped from ~75 minutes to 40 (−47%). Codex can now preserve working notes across contexts and ask questions mid-task without blocking unrelated work.
- Yet raw operation accuracy improves only modestly (OSWorld +10.5%, ALE +10.6%): it is faster and better at finishing, but per-step accuracy does not jump as dramatically as the headline totals imply.
5.5 Coding: neck and neck — even overtaken by a cheaper model
DeepSWE v1.1 (long-horizon coding, %)
- Astra is not top on test-taking: Meta's Muse Spark 1.3 edges ahead at 75.4% on DeepSWE; Gemini 3.8 Flash and Claude Opus 5 also sit near 74%, with overlapping confidence bands.
- Only ~2.1 points clear of Fable on Terminal-Bench: across ~113 tasks that is the swing of one or two problems — not a significant difference.
- Astra's real coding edge is closed-loop delivery inside the terminal — at lower cost: OpenAI estimates its per-task cost runs ~63% below Fable 5.1 and ~57% below Sol. The advantage comes from less rework and fewer calls, not a higher single-shot accuracy.
5.6 Alignment: the numbers improve markedly — yet monitoring gets harder
| Alignment metric | GPT-5.6 Sol | GPT-6 Astra | Note |
|---|---|---|---|
| "Impossible-task" overreach rate | 48% | 0% | Designed after the earlier Hugging Face sandbox overreach incident |
| Capability-hallucination rate | 12.2% | 4.2% | A 65.6% relative drop |
| UK AISI supply-chain · scope unspecified | — | 60/499 (12.0%) | Falls to 2/500 (0.4%) once limits are spelled out — boundary conditions are decisive |
| UK AISI supply-chain · limits specified | — | 2/500 (0.4%) |
Tiering the Nature of the Gains
When benchmark protocols are mixed, forcing a single weighted total is itself misleading. Instead, we tier capabilities qualitatively — by whether the lead is structural, within the margin of error, or gated.
| Tier | Capability / area | Evidence |
|---|---|---|
| Structural lead | Computer-use delivery, research/office long flows, cybersecurity | +128%–188% gains, 7.1× on held-out, real zero-days found, time −47% |
| Significant but not a gap | Abstract reasoning (neutral), research-grade math | ARC standard 62.7%, a clear first but unsaturated; FrontierMath rivals already at 87.8% |
| Neck-and-neck within error | Long-horizon/terminal coding, GPQA science Q&A, creative writing | Overtaken by Muse on DeepSWE; overlapping confidence bands with Fable/Gemini on several |
| Gated, narrowed release | Offensive cybersecurity capability | At Critical; withheld from public, Daybreak controlled channel, API can kill a task directly |
Comparison Matrix
Full table of official-protocol benchmarks (gold = best in column; * marks a version/protocol that is not directly comparable).
| Benchmark | GPT-6 Astra | GPT-5.6 Sol | Competitor ref. | Protocol note |
|---|---|---|---|---|
| FrontierMath Tier4 v2 | 97.6% | 83.0% | Fable 5.1 87.8% | Official; OpenAI funded this benchmark |
| ARC-AGI-3 (adapter / neutral) | 99.9 / 62.7 | 7.8 | Opus 5 30.2 | Two harnesses, see 5.2 |
| ExploitBench aggregate | 100% | 78.5% | — | Capability coverage, not pass rate |
| ExploitBench held-out novel bugs | 39% | 5.5% | — | 20 new V8 bugs, Jun–Aug |
| OSWorld 2.0 (offline subset) | 72.6% | 65.7% | Fable 77.9%* | * Different version; not directly comparable |
| Terminal-Bench 4.0 | 57.9% | 37.3% | Fable 55.8% | Per-task cost ~63% below Fable |
| DeepSWE v1.1 | 74.1% | 70.8% | Muse 1.3 75.4% | Top score belongs to Meta |
| Terminal-Bench Science 0.1 | 64.6% | 22.4% | Fable 52.6% | Cost ~31% lower as well |
| AutomationBench | 41.4% | 18.1% | Fable 31.4% | Office automation |
| Agents' Last Exam | 59.3% | 53.6% | Opus 5 55.5% | Real-environment agents |
| GPQA Diamond | 96.0% | — | Gemini 3.8 Flash 95.3% | A 0.7-point gap |
Pricing & specs: selling "task cost," not tokens
| Model | Input $/1M | Output $/1M | Vs. Astra |
|---|---|---|---|
| GPT-6 Astra | $10 | $50 | Baseline (same tier as Fable) |
| Claude Fable 5.1 | $10 | $50 | Same price, head-to-head |
| GPT-5.6 Sol | $4 | $20 | Astra is 2.5× |
| Meta Muse Spark 1.3 | $1.25 | $4.25 | Astra 8× input / 11.8× output |
| Gemini 3.8 Flash | $0.75 | $3.75 | Low-cost camp |
- Specs: 1.05M-token context, 128k max output, knowledge cutoff 2026-04-30; input past 272k tokens triggers tiered surcharges, and Fast mode doubles the price.
- The core defense (Brockman): "What matters is how much it costs to complete a task, not the price per token" — on high-config tasks OpenAI estimates per-task API cost ~57% below Sol and ~63% below Fable.
- Rollout cadence: first to Daybreak/Trusted Access cybersecurity customers, then within days to Plus/Pro/Business/Enterprise, the API and AWS Bedrock.
Implications by Audience
No single absolute recommendation; the call differs by who you are and what constrains you.
Enterprise AI / process-automation teams Delivery-first, total-cost view
- Top candidate to pilot first: cross-software long flows, finance/legal/back-office reconciliation and research workflows are exactly Astra's structural-lead zone.
- How: pick 2–3 high-frequency flows and run parallel shadow tests of Astra against Fable/Flash; score on "total cost to finish one end-to-end task × success rate," not token price.
- Note that server-side safety policy may terminate a task outright — assess how false blocks interrupt the pipeline.
Developers / startups Cost-sensitive, high throughput
- No need to chase the new release: on pure code generation, Q&A and high-volume simple tasks, Muse Spark 1.3 / Gemini Flash offer near-equal capability at 1/8–1/12 the price.
- When to move to Astra: when the product's core is "operating the computer/browser on the user's behalf to deliver a finished artifact" — it currently has little substitute.
Security, compliance & risk teams Defensive side
- Astra's automated zero-day capability means the barrier to attack is moving down; defenders should use same-tier capability in turn for automated penetration testing and patch prioritization.
- Track the access terms of the Daybreak controlled channel and follow-up results from third-party supply-chain evaluations such as the UK AISI.
Investment / strategy research Landscape shift
- Computer Use directly pressures RPA/middleware (the UiPath category) and the "wait for the software to expose an API" integration model.
- OpenAI and Anthropic are both preparing IPOs (media-reported valuations of roughly $852B and $965B respectively, not officially confirmed); this launch serves both technical positioning and a capital-markets narrative.
Five structural consequences for the LLM ecosystem
- ① The agent battleground shifts from conversation to operating the computer: "screen + mouse + keyboard" becomes the universal interface; enterprise integration, RPA and office automation look set to be rebuilt within 6–12 months (a Legora-style "reconcile 41 financial documents in minutes and surface all four planted errors" is among the first use cases to land).
- ② "The stronger the capability, the narrower the distribution" becomes a new paradigm: Astra is the first model whose power changed its product form; safety ratings move from an internal framework into a product feature and a regulatory variable.
- ③ The benchmark-credibility crisis deepens: model-plus-scaffolding system capability and bare-model capability must be reported separately, amplifying the value of independent ARC-Prize-style retests — precisely the opening for third-party evaluators.
- ④ The open/low-cost camp faces a stress test: if "the expensive model saves on the total bill" is confirmed by real invoices, the high-price route is vindicated; if rework is high and workflows are often false-blocked, the low-cost camp will quickly take the long tail.
- ⑤ AGI shifts from a technical judgment to a brand asset: Brockman removes AGI from a falsifiable contractual definition while using it to endorse the product. Once AGI is marketing language, what is genuinely scarce is third-party, re-checkable, condition-transparent evaluation.
Risks & Limits
The strength of these conclusions is bounded by the following; read them before procuring or citing.
Outlook
We return to the core calls and set falsifiable signals to track over the next observation cycle.
Three confident calls
- Call one: the agent battleground has formally shifted from conversation to operating the computer; enterprise integration, RPA and office automation will be rebuilt within 6–12 months, and Astra currently leads this axis by half a length.
- Call two: "the stronger the capability, the narrower the distribution" is the new frontier paradigm; safety ratings move from internal framework toward product form and regulatory variable, and Critical may become a standard threshold for later flagships.
- Call three: the benchmark-credibility crisis deepens, system and bare-model capability must be reported separately, and independent third parties such as ARC Prize will keep gaining authority — which is exactly why Modelspectra cross-checks multiple sources and labels every protocol.
Signals to track next cycle (falsifiable)
- Real enterprise bills (next two quarters): does "lower per-task cost" replicate on the third-party/user side, or get eaten by rework and false blocks?
- More neutral retests: do third parties beyond ARC Prize reproduce the official numbers on OSWorld, Terminal-Bench and ExploitBench?
- Does the coding overtake persist: can Muse Spark 1.3 and later open models stay ahead of Astra on DeepSWE and similar benchmarks?
- Safety-rating regulation lands: Daybreak access terms, US/UK AISI findings, and whether competitors' security capability also triggers Critical.
- Computer-Use substitution data: do RPA/middleware vendors show quantifiable signs of displacement in products and results?
Whether the "AGI era" begins today depends on whom you ask — but it is certain that OpenAI would like you to believe it does. Strip away the narrative and Astra remains a genuine, high-grade leap on the axis of delivering work; it is simply far from the omnipotence its perfect-score poster suggests.
Sources
All accessed 2026-09-04; type labels indicate evidence strength.
| Source | Type | Used in this report for |
|---|---|---|
| OpenAI official launch page — GPT-6 Astra | Vendor primary | Official benchmarks, pricing, specs, capability claims |
| ARC Prize: Astra on ARC-AGI-3 (blog) | Independent third party | Dual-harness retest, cost, human action-efficiency comparison |
| ARC Prize: Astra results page | Independent third party | Standard 62.7%/$26,098, adapter 99.9%/$18,817 |
| OpenAI Preparedness Framework v2 | Vendor primary | Original definitions of Critical/High cyber levels |
| OpenAI: Critical cyber capabilities | Vendor primary | The two Critical threshold triggers |
| The Paper (Pengpai): GPT-6 launch — "able to do the work and watch the store" | Media | Event and benchmark cross-check |
| Cailianshe (CLS) / Tencent News: Welcome to the AGI era | Media | Launch statements, rollout cadence |
| Beijing News Shell Finance: Astra calls itself most intelligent and aligned | Media | Cross-check of official positioning |
| QbitAI: Astra / Astra Pro benchmark comparison charts | Media | DeepSWE and Terminal-Bench competitor references |
| NetEase Tech / Sina Finance / Phoenix Tech | Media | Multi-source check of benchmarks, training scale, pricing debate |
| MyDrivers (kuaikeji): million-scale context, autonomous computer operation | Media | Specs and Computer Use cases |
| Bloomberg (republished by Beijing Municipal S&T Commission): OpenAI overtakes Anthropic | Media → foreign press | Competitive landscape and capital-markets context |
| World Programming / AIHub / The Agent Times / R&D World | Industry / foreign press | English cross-validation of dual harness and Critical |
| Epoch AI (cited) | Independent research | Note on OpenAI's ties to FrontierMath |