A/GEOResearch

Checked

  • Mistral Large 4, open weights Mistral
  • Gemini 4 Carbon Google
  • GPT-6.1 Terra OpenAI
  • Kimi K3.1 Pro Kimi
  • Decisions API, general availability OpenAI
  • mammoth-1 and elephant-1 Base Labs
  • DeepSeek V4.1 Flash 1017 DeepSeek
  • Perplexity Decider v1.2 Perplexity
  • d1-ultra Liquid AI
  • Muse Spark Open Meta
  • Gemini 4 Argon, open to all Google
  • Muse Wonder Meta
  • Muse Wonder Full Meta
  • Microsoft-Decision-1 Microsoft
  • Claude Haiku 5.5 Anthropic
  • Karotte (RL environment framework) Preference Model
  • Decisions API beta OpenAI
  • Mistral Large 4 Mistral
  • Nano Banana 2.1 Google
  • Clef and Clef-flash Cloudflare
  • Strands Decider 2B Amazon
  • Gemini 4 Argon Google
  • GPT-6.1 Sol OpenAI
  • Claude Sonnet 5.5 Anthropic
  • Claude Opus 5.5 Anthropic
  • GPT-6 Luna OpenAI
  • Grok 4.7 xAI
  • MiMo-V2.6-Flash MiMo
  • MiMo-V2.6-Pro MiMo
  • Jev TypeSafe AI
  • Kimi K2.8 Preview Kimi
  • GPT-6 Astra OpenAI
  • Gemini 3.8 Flash Google
  • Muse Spark 1.3 Meta
  • Claude Fable 5.1 Anthropic
  • Claude Mythos 5.1 Anthropic

LLM Watch · Dashboard View

AI model leaderboards on one screen

  • Releases36New AI models in the release log since September 1, 2026. Models change often, so AI answers about your business can change too. Check them each month.
  • Context1MMost flagship models can read about 1 million tokens in one request. That is about 750,000 words. Length is not the limit. Clear facts and clear structure help AI tools use your content.
  • Price spread100×GPT-6 Astra and Claude Fable 5.1 cost $10 for each 1M input tokens. GPT-6 Luna costs $0.10. That is 100 times less. For simple, high-volume tasks, a low-cost model is often enough.
  • AI summary clicks8%In a Pew Research Center study, people clicked a result link on 8% of Google visits with an AI summary, and on 15% of visits without one. If the AI summary does not name your business, fewer people find you.

Release log

36 since Sep 1
  1. Mistral Large 4, open weights Mistral Available
  2. Gemini 4 Carbon Google Limited access
  3. GPT-6.1 Terra OpenAI Available
  4. Kimi K3.1 Pro Kimi Available
  5. Decisions API, general availability OpenAI Available
  6. mammoth-1 and elephant-1Base Labs Available
  7. DeepSeek V4.1 Flash 1017 DeepSeek Available
  8. Perplexity Decider v1.2 Perplexity Available
  9. d1-ultra Liquid AI Available
  10. Muse Spark Open Meta Available
  11. Gemini 4 Argon, open to all Google Available
  12. Muse Wonder Meta Available
  13. Muse Wonder Full Meta Limited access
  14. Microsoft-Decision-1Microsoft Available
  15. Claude Haiku 5.5 Anthropic Available
  16. Karotte (RL environment framework)Preference Model Available
  17. Decisions API betaOpenAI Preview
  18. Mistral Large 4 Mistral Available
  19. Nano Banana 2.1Google Available
  20. Clef and Clef-flashCloudflare Available
  21. Strands Decider 2BAmazon Available
  22. Gemini 4 Argon Google Available
  23. GPT-6.1 Sol OpenAI Available
  24. Claude Sonnet 5.5 Anthropic Available
  25. Claude Opus 5.5 Anthropic Available
  26. GPT-6 Luna OpenAI Available
  27. Grok 4.7 xAI Available
  28. MiMo-V2.6-Flash MiMo Available
  29. MiMo-V2.6-Pro MiMo Available
  30. JevTypeSafe AI Preview
  31. Kimi K2.8 Preview Kimi Preview
  32. GPT-6 Astra OpenAI Available
  33. Gemini 3.8 Flash Google Available
  34. Muse Spark 1.3 Meta Available
  35. Claude Fable 5.1 Anthropic Available
  36. Claude Mythos 5.1 Anthropic Limited access

Creative writing

Creative Writing v3
EQ-Bench Creative Writing v3
Board rankModelBarElo
#1 GPT-6 AstraOpenAI 2,176.9
#2 Kimi K3.1 ProMoonshot 2,172.6
#3 Claude Fable 5.1Anthropic 2,155.3
#4 Claude Opus 5Anthropic 2,135.0
#5 GPT-6 SolOpenAI 2,126.0
#6 Kimi K3Moonshot 2,083.3
#7 GLM-5.3Z.ai 2,076.4
#8 Claude Opus 5.5Anthropic 2,050.9

Full board and notes →

API input price

Per 1M tokens
Input price per 1M tokens, current API models
GPT-6 AstraOpenAI$10
Claude Fable 5.1Anthropic$10
Claude Opus 5.5Anthropic$4
Muse WonderMeta$4
Kimi K3Kimi$3
GPT-6.1 SolOpenAI$2
Claude Sonnet 5.5Anthropic$2
Gemini 4 ArgonGoogle$2
Grok 4.7xAI$2
Qwen3.8-MaxQwen$2
Kimi K3.1 ProKimi$2
DeepSeek V4-Pro-0813DeepSeek$1.32
Muse Spark 1.3Meta$1.25
GPT-6.1 TerraOpenAI$1
Gemini 3.8 FlashGoogle$0.75
Mistral Large 4Mistral$0.70
MiMo-V2.6-ProMiMo$0.435
DeepSeek V4.1 Flash 1017DeepSeek$0.30
Qwen3.8-FlashQwen$0.15
GLM-5.3-FlashGLM$0.15
MiMo-V2.6-FlashMiMo$0.14
GPT-6 LunaOpenAI$0.10
Claude Haiku 5.5Anthropic$0.10

List prices. Output costs more. All models →

Longform writing

Longform Creative Writing
EQ-Bench Longform Creative Writing
Board rankModelBar/100
#1 Claude Opus 5Anthropic 86.3
#2 Claude Fable 5.1Anthropic 85.3
#3 Claude Opus 5.5Anthropic 84.6
#4 Claude Fable 5Anthropic 83.0
#5 Grok 4.7xAI 83.0
#6 GPT-6 AstraOpenAI 82.8
#7 Muse Spark 1.3Meta 82.8
#8 GPT-6 SolOpenAI 82.8

Full board and notes →

Human votes

Arena Text: Creative Writing
Arena Text: Creative Writing
Board rankModelBarscore
#1 Claude Opus 5.5 (high)Anthropic 1,520±13
#2 Gemini 4 Argon (high)Google 1,517±13
#3 Gemini 4 Carbon (high)Google 1,515±20, early
#4 Claude Fable 5 (high)Anthropic 1,501±7
#5 Claude Opus 4.6 (high)Anthropic 1,499±6
#6 Gemini 3.7 Flash (high)Google 1,490±8, early
#7 Claude Opus 4.7 (high)Anthropic 1,489±7
#8 Claude Fable 5.1 (max)Anthropic 1,489±11

Full board and notes →

Agent memory (BEAM)

BEAM · accuracy % by tokens
BEAM: Beyond a Million Tokens: accuracy (%) at each conversation size
System100K500K1M10M
past.devMemory API 92.1 89.6 90.7 85.0
Exabase M-1Exabase 76.9 — 75.0 68.0
HindsightVectorize 75.0 71.1 73.9 64.1
Mem0 PlatformMem0 — — 64.1 48.6
HonchoPlastic Labs 63.0 64.9 63.1 40.6

Self-reported by each company. Full board and notes →

AI slop

Slop Score
EQ-Bench Slop Score
Writing rankModelBarslop
#4 Claude Opus 5Anthropic 0.9
#3 Claude Fable 5.1Anthropic 1.1
#1 GPT-6 AstraOpenAI 1.2
#5 GPT-6 SolOpenAI 1.2
#7 GLM-5.3Z.ai 1.2
#9 Grok 4.7xAI 1.2
#10 Muse WonderMeta 1.2
#2 Kimi K3.1 ProMoonshot 1.3

Full board and notes →

Images

Arena Text-to-Image
Arena Text-to-Image
Board rankModelBarscore
#1 GPT Image 2.5 SunburstOpenAI 1,427±5, early
#2 GPT Image 2.5 FlareOpenAI 1,401±5, early
#3 GPT Image 2 (medium)OpenAI 1,381±4
#4 MAI-Image-2.6Microsoft AI 1,329±5
#5 Nano Banana 2.1Google 1,325±9, early
#6 Grok Imagine Image 2.0xAI 1,317±7, early
#7 Reve 2.1Reve 1,300±8
#8 Grok Imagine Image 2.0 (Aug 1)xAI 1,288±5

Full board and notes →

Decision models

Decision models
Decision models
ModelReleasedInput / 1MPublished score
Jev 1.13TypeSafe AI $0.042 JevBench 72.13 (3rd of 112)
d1-ultraLiquid AI $0.042 Beats Jev 1.14 on 112 evals (self-reported)
mammoth-1 (27B)Base Labs Free until Oct 27 Jev Decision Index 71.24 (self-reported)
Microsoft-Decision-1Microsoft $0.042 No numbers published
Decisions API (GPT-6 Luna)OpenAI $0.10 No numbers published (generally available since Oct 22)
Clef (27B)Cloudflare $0.24 Decision Index 61.2 (self-reported)
Clef-flash (9B)Cloudflare $0.038 Decision Index 57.1 (self-reported)
Perplexity Decider v1.2 27BPerplexity $0.02 85.71% on its own 11-task panel
Strands Decider 2BAmazon (Strands Labs) Self-host JevBench 0.762 (own run)
d1-3BLiquid AI Self-host Decision Index 48.57 (self-reported)

Full board and notes →

Video

Arena Text-to-Video
Arena Text-to-Video
Board rankModelBarscore
#1 Gemini Omni 1.1 FlashGoogle 1,516±15
#2 Gemini Omni FlashGoogle 1,513±9
#3 FLUX 3 VideoBlack Forest Labs 1,493±17, early
#4 Grok Imagine Video 1.5 (agent)xAI 1,492±18, early
#5 Seedance 2.0 (720p)ByteDance 1,479±8
#6 Wan 3.0Alibaba 1,476±13
#7 Seedance 2.5 (720p)ByteDance 1,474±9
#8 MiniMax H3MiniMax 1,460±9

Full board and notes →

Research agents

DeepResearch Bench II
DeepResearch Bench II (Mercor)
Board rankModelBar%
#1 Claude Opus 5 (high)Anthropic 56.1
#2 Claude Fable 5.1 (max)Anthropic 55.0
#3 Claude Sonnet 4.6 (high)Anthropic 53.3
#4 Claude Opus 5.5 (max)Anthropic 53.3
#5 DeepSeek V4.1 Flash (max)DeepSeek 53.2
#6 GLM-5.3Z.ai 52.0
#7 Claude Sonnet 5.5Anthropic 51.7
#8 GPT-5.6 SolOpenAI 51.5

Full board and notes →

Latest research

17 studies

All research →

General intelligence

AA Index
Artificial Analysis Intelligence Index, best model for each company
RankCompanyBarIndex
GoogleGemini 4 Carbon (high) 59
AnthropicClaude Opus 5.5 (max) 58
OpenAIGPT-6 Astra (max) 57
MetaMuse Wonder Full (max) 50
KimiKimi K3.1 Pro 46
xAIGrok 4.7 (high) 35
QwenQwen3.8 Max (0902) 34
DeepSeekDeepSeek V4.1 Flash 1017 (max) 32
GLMGLM-5.3 (max) 32
MiMoMiMo-V2.6-Pro 30
MistralMistral Large 4 (high) 26

Source: Artificial Analysis

Drag a panel by its handle (⋮⋮) to change the order, or focus the handle and use the arrow keys. Your order is saved on this device. Each panel shows the top places on a public board. Open the report view for each board's method, notes and sources. Data checked .

Find out what AI says about you.

We ask leading AI answer engines the questions your customers ask. Then we show you who they name, and what to fix first. The check is free.

Get a free AI visibility check

We ask leading AI answer engines the questions your customers ask. Then we send you a short report.

We use your details only to send your report and reply to you. See our privacy policy.