Anthropic's large language models

From Systems Analysis Wiki
Jump to navigation Jump to search

Anthropic's large language models are a family of large language models developed by the American artificial intelligence company Anthropic and released under the name Claude. The first Claude models were made publicly available on March 14, 2023, and the family has since grown into a tiered lineup used for conversation, writing, coding, reasoning, agentic workflows, computer use, vision, and long-context tasks.

Claude models are trained using constitutional AI, a method Anthropic developed to make models more helpful and harmless without relying primarily on large-scale human feedback. Beginning with the Claude 3 generation in March 2024, each generation has typically been released in three size tiers, ordered from fastest and least expensive to most capable: Haiku, Sonnet, and Opus. In June 2026, Anthropic introduced the Mythos-class tier above Opus, comprising the generally available Fable 5 and the restricted-access Mythos 5, which share a single underlying model.

Models

No. Date Model Type Note Source System / Model Card
1 2023-03-14 Claude Claude First public Claude assistant; offered together with Claude Instant. Anthropic
2 2023-03-14 Claude Instant Instant Faster, lighter, lower-cost version of the first public Claude assistant. Anthropic
3 2023-04 Claude 1.3 Claude Later first-generation Claude model; used as the comparison baseline for Claude 2. Anthropic Claude 2 Model Card
4 2023-07-11 Claude 2 Claude Second-generation Claude model with improved coding, math, reasoning, longer responses, and 100K-token context. Anthropic Claude 2 Model Card
5 2023-08-09 Claude Instant 1.2 Instant Updated Claude Instant model with improved math, coding, reasoning, safety, and structured responses. Anthropic
6 2023-11-21 Claude 2.1 Claude Claude 2 update with a 200K-token context window, lower hallucination rates, system prompts, and beta tool use. Anthropic Claude 2 Model Card
7 2024-03-04 Claude 3 Opus Opus Most capable model in the Claude 3 family. Anthropic Claude 3 Model Card
8 2024-03-04 Claude 3 Sonnet Sonnet Mid-tier Claude 3 model balancing intelligence and speed. Anthropic Claude 3 Model Card
9 2024-03-13 Claude 3 Haiku Haiku Fastest and lowest-cost model in the Claude 3 family. Anthropic Claude 3 Model Card
10 2024-06-20 Claude 3.5 Sonnet Sonnet First Claude 3.5 model; higher intelligence than Claude 3 Opus with Sonnet-tier speed and cost. Anthropic Claude 3.5 Sonnet Model Card Addendum
11 2024-10-22 Claude 3.5 Sonnet (new) Sonnet Upgraded Claude 3.5 Sonnet with improved coding, tool use, and computer-use capability. Anthropic Claude 3.5 Haiku and Upgraded Claude 3.5 Sonnet Model Card Addendum
12 2024-10-22 Claude 3.5 Haiku Haiku Faster and cheaper Claude 3.5-family model. Anthropic Claude 3.5 Haiku and Upgraded Claude 3.5 Sonnet Model Card Addendum
13 2025-02-24 Claude 3.7 Sonnet Sonnet First hybrid reasoning Claude model, with standard and extended-thinking modes. Anthropic Claude 3.7 Sonnet System Card
14 2025-05-22 Claude Opus 4 Opus Opus-class hybrid reasoning model for coding, advanced reasoning, and long-running agent workflows. Anthropic Claude 4 System Card
15 2025-05-22 Claude Sonnet 4 Sonnet Sonnet-class hybrid reasoning model; upgrade from Claude 3.7 Sonnet. Anthropic Claude 4 System Card
16 2025-08-05 Claude Opus 4.1 Opus Incremental upgrade to Claude Opus 4 with improvements in agentic tasks, coding, and reasoning. Anthropic Claude Opus 4.1 System Card
17 2025-09-29 Claude Sonnet 4.5 Sonnet Sonnet model focused on coding, complex agents, computer use, reasoning, and math. Anthropic Claude Sonnet 4.5 System Card
18 2025-10-15 Claude Haiku 4.5 Haiku Fast, cost-efficient Haiku model with near-frontier performance. Anthropic Claude Haiku 4.5 System Card
19 2025-11-24 Claude Opus 4.5 Opus Opus model for coding, agents, computer use, deep research, spreadsheets, and slides. Anthropic Claude Opus 4.5 System Card
20 2026-02-05 Claude Opus 4.6 Opus Opus upgrade with stronger coding, cybersecurity investigation, long-running agentic work, and 1M-token context in beta. Anthropic Claude Opus 4.6 System Card
21 2026-02-17 Claude Sonnet 4.6 Sonnet Sonnet upgrade across coding, computer use, long-context reasoning, agent planning, knowledge work, and design. Anthropic Claude Sonnet 4.6 System Card
22 2026-04-07 Claude Mythos Preview Mythos Invitation-only research-preview model for defensive cybersecurity workflows through Project Glasswing. Anthropic Claude Mythos Preview System Card
23 2026-04-16 Claude Opus 4.7 Opus Opus-tier upgrade over Opus 4.6 with stronger coding, vision, and long-running professional work. Anthropic Claude Opus 4.7 System Card
24 2026-05-28 Claude Opus 4.8 Opus Opus-tier upgrade for complex reasoning, long-horizon agentic coding, and high-autonomy work. Anthropic Claude Opus 4.8 System Card
25 2026-06-09 Claude Fable 5 Fable Mythos-class model made available for general use with additional safeguards. Access to the Mythos-class models (Fable 5 and Mythos 5) was suspended on 2026-06-12 under a U.S. government export-control directive; the models were not deprecated or retired. The U.S. Department of Commerce lifted the export controls on 2026-06-30, and Anthropic began restoring Fable 5 globally on 2026-07-01 (Anthropic statement). Anthropic Claude Fable 5 and Mythos 5 System Card
26 2026-06-09 Claude Mythos 5 Mythos Limited-availability Mythos-class model through Project Glasswing; same underlying model class as Fable 5 with different safeguards/access. Access to both Mythos-class models was suspended on 2026-06-12 under a U.S. government export-control directive. The export controls were lifted on 2026-06-30; Mythos 5 access is being restored to a set of approved U.S. organizations (following U.S. government approval on 2026-06-26), with Anthropic continuing to work to expand access through Project Glasswing (Anthropic statement). Anthropic Claude Fable 5 and Mythos 5 System Card
27 2026-06-30 Claude Sonnet 5 Sonnet Sonnet 5 model for coding, agents, and professional work at scale. Anthropic Claude Sonnet 5 System Card

Benchmarks

No. Date Model Typea MMLUb GSM8K HumanEval MATH GPQA-Dc MMMU SWE-Vd SWE-Proe
1 2023-03-14 Claude Claude
2 2023-03-14 Claude Instant Instant
3 2023-04 Claude 1.3 Claude 77.0f 85.2 56.0
4 2023-07-11 Claude 2 Claude 78.5 88.0 71.2
5 2023-08-09 Claude Instant 1.2 Instant 86.7 58.7
6 2023-11-21 Claude 2.1 Claude
7 2024-03-04 Claude 3 Opus Opus 86.8 95.0 84.9 60.1 50.4 59.4
8 2024-03-04 Claude 3 Sonnet Sonnet 79.0 92.3 73.0 43.1 40.4 53.1
9 2024-03-13 Claude 3 Haiku Haiku 75.2 88.9 75.9 38.9 33.3 50.2
10 2024-06-20g Claude 3.5 Sonnet Sonnet 88.7 96.4 92.0 71.1 59.4 68.3 33.4h
11 2024-10-22 Claude 3.5 Sonnet (new) Sonnet 88.7 93.7 78.3 65.0 70.4 49.0
12 2024-10-22 Claude 3.5 Haiku Haiku 77.6 88.1 69.2 41.6 40.6
13 2025-02-24 Claude 3.7 Sonnet Sonnet 62.3i
14 2025-05-22 Claude Opus 4 Opus 72.5j
15 2025-05-22 Claude Sonnet 4 Sonnet 72.7j
16 2025-08-05 Claude Opus 4.1 Opus 74.5
17 2025-09-29 Claude Sonnet 4.5 Sonnet 77.2k
18 2025-10-15 Claude Haiku 4.5 Haiku 73.3
19 2025-11-24 Claude Opus 4.5 Opus 80.7 80.9l
20 2026-02-05 Claude Opus 4.6 Opus 91.3 80.8l 53.4
21 2026-02-17 Claude Sonnet 4.6 Sonnet 89.9 79.6 58.1
22 2026-04-07 Claude Mythos Preview Mythos 94.6 93.9 77.8
23 2026-04-16 Claude Opus 4.7 Opus 94.2 87.6m 64.3
24 2026-05-28 Claude Opus 4.8 Opus 93.6n 88.6 69.2
25 2026-06-09 Claude Fable 5 Fable 95.0o 80.0
26 2026-06-09 Claude Mythos 5 Mythos 94.1q 95.5o 80.3
27 2026-06-30 Claude Sonnet 5 Sonnet 85.2p 63.2p

Table notes

  • a Tiers follow Anthropic's naming. Before Claude 3 there were no named tiers: "Claude" is the flagship line (Claude 1/2), "Instant" the fast, low-cost line (retrospectively the Haiku lineage). From Claude 3 on, the family splits into Haiku, Sonnet and Opus. "Mythos" and "Fable" form the Mythos-class tier above Opus; Fable 5 and Mythos 5 share one underlying model.
  • b Early-era figures (rows 3–12) are Anthropic's own, from model cards/addenda; settings differ by benchmark and generation. MMLU: 5-shot CoT for Claude 1.3 and Claude 2 (rows 3–4), plain 5-shot (not the higher 5-shot CoT variant) for the Claude 3 and Claude 3.5 rows (7–12). GSM8K is shown only where Anthropic reported it and uses 0-shot CoT; the October 2024 Claude 3.5 addendum reports MGSM rather than GSM8K, so the GSM8K cells for rows 11–12 are left blank. HumanEval (Codex): 0-shot. MATH: 0-shot for Claude 3 (rows 7–9), 0-shot CoT for the Claude 3.5 rows (10–12). GPQA-D: 0-shot CoT. MMMU: validation split, 0-shot with chain-of-thought where reported — for rows 10–11, but not for Claude 3.5 Haiku (row 12), which launched text-only. See the Claude 2 model card, the Claude 3 model card, and the June/October Claude 3.5 addenda for exact settings.
  • c Modern GPQA-D figures (rows 20–24 and 26, where reported) were run under newer Anthropic evaluation settings, often with adaptive/extended thinking at high or max effort, and are not directly comparable to the 0-shot CoT figures in earlier rows. Anthropic notes that GPQA-D has become saturated for top models.
  • d SWE-V figures are Anthropic-reported and generally use Anthropic's simple SWE-bench scaffold (bash + string-replacement file editing) on the full 500-problem set. Trials, prompt additions, context length, thinking budget, and high-/adaptive-compute settings vary by release (see row-specific notes); they are not comparable to independent leaderboards (e.g. vals.ai), which use a different harness.
  • e SWE-Pro (SWE-bench Pro, Scale AI) is a harder set. Figures shown are from Anthropic's own harness; on Scale's standardized leaderboard the same models score markedly lower (e.g. Opus 4.6 ≈ 47–52%).
  • f Row 3 (Claude 1.3) figures come from the comparison table in the Claude 2 model card, where "Claude 1.3" is a named column.
  • g The API snapshot ID is claude-3-5-sonnet-20240620 (June 20, 2024); Anthropic's announcement page is dated June 21, 2024. This table uses the snapshot date.
  • h 33.4 (Claude 3.5 Sonnet) is the June 2024 release figure. The upgraded version (Oct 2024, row 11) scores 49.0.
  • i 62.3 (Claude 3.7 Sonnet) is on the full 500-problem set. On the n=489 subset: 63.7 without a scaffold pass and 70.3 with one.
  • j 72.5 / 72.7 (Opus 4 / Sonnet 4) are standard mode. In "high compute" (parallel attempts plus internal candidate selection): 79.4 / 80.2.
  • k 77.2 (Sonnet 4.5) is standard mode, 200K context, averaged over 10 trials, no test-time compute. "High compute" gives 82.0; the 1M configuration gives 78.2.
  • l 80.9 / 80.8 (Opus 4.5 / Opus 4.6) are both Anthropic figures but under different configs: 4.5 with no thinking budget, averaged over 5 trials; 4.6 with adaptive thinking, max effort, averaged over 25 trials (exactly 80.84; 81.42 with a prompt modification). The ~0.1 difference is noise, not a regression.
  • m 87.6 (Opus 4.7) is from Anthropic's system card; independent vals.ai reports 82.0. The jump over Opus 4.6 largely reflects a grader change, not only the model.
  • n 93.6 (Opus 4.8) — the benchmark is saturated (~93–94% for top models) and differences are within statistical noise; this cell may also be left blank.
  • o Fable 5 and Mythos 5 share the same underlying model but are reported separately in the system card: Fable 5's public safeguards route high-risk requests to a Claude Opus 4.8 fallback, which slightly lowers its measured scores. On SWE-bench Verified / SWE-bench Pro, Fable 5 scores 95.0 / 80.0 and Mythos 5 scores 95.5 / 80.3. Anthropic's combined launch chart ("Claude Mythos 5 / Fable 5") shows the higher Mythos-class figure (80.3).
  • p The Claude Sonnet 5 system card reports SWE-bench Verified = 85.2 and SWE-bench Pro = 63.2, averaged over five trials with Anthropic's standard SWE-bench configuration. Anthropic's comparison for the Pro figure is Opus 4.8's 69.2.
  • q Claude Mythos 5 scored 94.1% on GPQA Diamond in the Fable 5 / Mythos 5 system card. Anthropic did not publish a separate Fable 5 GPQA-D figure and describes the benchmark as saturated, stating it plans to stop reporting future performance on it.

See also

Literature

  • Bai, Yuntao; et al. Constitutional AI: Harmlessness from AI Feedback. Anthropic, 2022.
  • Jimenez, Carlos E.; et al. SWE-bench: Can Language Models Resolve Real-World GitHub Issues?. ICLR, 2024.