Skip to content

Qwen3.5 397B A17B

Alibaba·Released Feb 13, 2026Open weights

Updated Oct 8, 9:18 PM ET

Overall score
36.4
Rank #53 overall
Evidence
14 results
39% of scored kinds covered
Context window
262K tokens
From OpenRouter
API price, USD per 1M tokens
$0.55 / $3.50
Input / output · cached input $0.23

The score is on the board's scale (reference average 50, about 15 points per standard deviation), not a percentage.

By domain

Each domain is scored on the same scale as the overall score. Coverage is the share of the domain's kinds of evaluation with a result; it says how much evidence there is, not how good the model is.

Coding#58
33.4
3 results · 33% coverage
Research and reasoning#58
29.5
4 results · 50% coverage
Professional work#54
32.8
3 results · 22% coverage
Knowledge and accuracy#27
57.5
3 results · 50% coverage
Human preference
38.1
1 result · 100% coverage

Every result behind the score

The result as the evaluator publishes it, and the reading it gives on the board's scale. A hard evaluation can give a high reading for a modest result; results near 95% or 5% only say "at least" or "at most".

Coding

3 results · 33.4

Research and reasoning

4 results · 29.5

Professional work

3 results · 32.8

Knowledge and accuracy

3 results · 57.5
  • BullshitBench
    BullshitBench · high effortCapped
    52.7%
    Reading 89.0
  • IFBench (AA run)
    Artificial Analysis · thinking effort
    78.8%
    Reading 62.1
  • AA-LCR
    Artificial Analysis · thinking effort
    77.3%
    Reading 44.8

Human preference

1 result · 38.1

Shown, not scored

Composite indices, saturated or older evaluations, evaluations still being checked, and vision, writing and multilingual results. They do not move the score.

No result yet

Scored evaluations this model has not taken. A missing result neither adds nor subtracts.

  • Terminal-Bench 4.0 · Vals AI
  • LiveBench Coding · LiveBench
  • Code Migration · Vals AI
  • ProgramBench · Vals AI
  • Vibe Code Bench · Vals AI
  • Vibe Code Bench 1–100 · Vals AI
  • CyberBench Patch · Vals AI
  • FrontierMath Tier 4 · Epoch AI
  • LiveBench Reasoning · LiveBench
  • MysteryMechanism · Vals AI
  • Terminal-Bench Science · Vals AI
  • ProofBench · Vals AI
  • Finance Agent · Vals AI
  • Harvey Legal Agent Benchmark · Vals AI
  • MedCode · Vals AI
  • Legal Research Bench · Vals AI
  • Tax Agent Bench · Vals AI
  • EMB · Vals AI
  • LiveBench Data Analysis · LiveBench
  • SimpleQA Verified · Epoch AI
  • LiveBench Language · LiveBench
  • LiveBench Instruction Following · LiveBench
How readings and scores are computed