Skip to content

Ember-1

Fireworks·Released Sep 24, 2026

Updated Oct 8, 21:18 ET

Overall score
60.2
Not ranked yet: results from only one evaluator so far
Evidence
12 results
36% of scored kinds covered
Context window
1M tokens
From OpenRouter
API price, USD per 1M tokens
$3 / $15
Input / output · cached input $0.30

The score is on the board's scale (reference average 50, about 15 points per standard deviation), not a percentage.

By domain

Each domain is scored on the same scale as the overall score. Coverage is the share of the domain's kinds of evaluation with a result; it says how much evidence there is, not how good the model is.

Coding
61.4
4 results · 44% coverage
Research and reasoning
56.4
3 results · 38% coverage
Professional work
61.5
5 results · 56% coverage
Knowledge and accuracy
60.1
Not tested yet: shows the overall level
Human preference
60.1
Not tested yet: shows the overall level

Every result behind the score

The result as the evaluator publishes it, and the reading it gives on the board's scale. A hard evaluation can give a high reading for a modest result; results near 95% or 5% only say "at least" or "at most".

Coding

4 results · 61.4

Research and reasoning

3 results · 56.4

Professional work

5 results · 61.5

Shown, not scored

Composite indices, saturated or older evaluations, evaluations still being checked, and vision, writing and multilingual results. They do not move the score.

  • IOIVals AI · CodingReference only46.3%
  • BioMysteryBenchVals AI · Research and reasoningWatching67.0%
  • Vals IndexVals AI · Composite indicesReference only50.8%

No result yet

Scored evaluations this model has not taken. A missing result neither adds nor subtracts.

  • Terminal-Bench 4.0 (AA run) · Artificial Analysis
  • LiveBench Coding · LiveBench
  • ProgramBench · Vals AI
  • Vibe Code Bench 1–100 · Vals AI
  • APEX-SWE · Mercor
  • SciCode · Artificial Analysis
  • FrontierMath Tiers 1–3 · Epoch AI
  • FrontierMath Tier 4 · Epoch AI
  • LiveBench Reasoning · LiveBench
  • Chess Puzzles · Epoch AI
  • Mystery Game Puzzles · Epoch AI
  • Humanity's Last Exam (AA run) · Artificial Analysis
  • APEX-Agents · Mercor
  • MedCode · Vals AI
  • LiveBench Data Analysis · LiveBench
  • τ²-Bench Telecom (AA run) · Artificial Analysis
  • τ-Bench Banking (AA run) · Artificial Analysis
  • SimpleQA Verified · Epoch AI
  • LiveBench Language · LiveBench
  • LiveBench Instruction Following · LiveBench
  • BullshitBench · BullshitBench
  • AA-LCR · Artificial Analysis
  • IFBench (AA run) · Artificial Analysis
  • Arena Text · LMArena
How readings and scores are computed