2026-09-22T16:03:50.148Z
- performance:
{"outputTokensPerSecond":43.3,"timeToFirstAnswerTokenSeconds":46.949,"timeToFirstTokenSeconds":0.76}→ {"outputTokensPerSecond":40.872,"timeToFirstAnswerTokenSeconds":49.758,"timeToFirstTokenSeconds":0.825}
SOURCE-LINKED INTELLIGENCE
Hermes 4 - Llama-3.1 405B (Reasoning): mmlu pro
Benchmark data by Artificial Analysis. Current measurement; upstream does not provide a measurement timestamp or benchmark revision here.
Read original source ↗ Open in workspace
- recordType
- observation
- region
- Global
- value
- 0.829
- unit
- score
- dimensions
- {"metric":"mmlu_pro","model":"82b207dd-d285-4a52-b2fc-2cbd27543899","parallel_queries":1,"prompt_length":1000}
Evidence & attribution
Artificial Analysis
First collected: 2026-09-19T21:50:47.018Z. This is not the publication date.
Observed changes
AIIC observation times, not verified publisher revision times. Up to eight recent revisions.
2026-09-20T21:52:07.471Z
- pricing:
Not provided→ {"input":1,"output":3} - performance:
Not provided→ {"outputTokensPerSecond":43.3,"timeToFirstAnswerTokenSeconds":46.949,"timeToFirstTokenSeconds":0.76}