Section
LLM Benchmarks
- Anthropic Published Two Different Scores for Claude Sonnet 5.5. Here's Which Is Right
Claude Sonnet 5.5 Terminal-Bench 4.0: Anthropic reports 70.6%, Artificial Analysis measures 63.6%. What the 7-point gap means and which number to use.
- Opus 5.5 AutomationBench Score: Why Two Labs Report Different Numbers for the Same Model
Opus 5.5 AutomationBench score is 40.0% in Anthropic's launch table and 42.47% on Zapier's leaderboard. The gap comes from how fallbacks are scored.
- Gemini 4 Argon vs GPT-6 Astra: Same Score, but One Hallucinates 3x More
Gemini 4 Argon and GPT-6 Astra tie at 53 on the Artificial Analysis index, but The Batch reports AA-Omniscience hallucination of 15% vs 51%.
- Claude Opus 5.5 on Terminal-Bench 4.0: Anthropic Says 66.4%, Independent Test Says 59.6%
Claude Opus 5.5 Terminal-Bench 4.0: Anthropic reports 66.4%, Artificial Analysis measures 59.6%. Why a 6.8 point gap exists and how far to trust either.