🧮
AI Model Scoreboard
Independent rankings
SCORESMETHODOLOGY
AI Model Scoreboard
© 2026 · Evidence-first · Open metrics · Community supported
SupportDonateChangelogHealth: Checking

Data is aggregated from public sources; please verify before making critical decisions.

AI Model Scoreboard is informational only and does not provide investment, compliance, or security advice.

← Back to v4

MODEL: nvidia NVIDIA: Llama 3.1 Nemotron Ultra 253B v1

Provider: nvidiaSource: fullmodelKey: nvidia/llama-3.1-nemotron-ultra-253b-v1
Overall
69.1 / 100
Updated Jan 26

Status

adopted

Reasons (from decisions.json):

No published decision record.

A) Absolute Metrics (must exist for all models)

Context length
131,072
Max output tokens
Missing
Missing max output tokens => affects score: performance signals reduced.
Pricing (per 1M tokens)
in: USD 0.00 out: USD 0.00
Modalities
text->text
Tool / JSON support
Missing
Missing tool/JSON support => affects score: tooling capability signals reduced.
Training cutoff (evidence)
Missing
Missing training cutoff => affects score: openness signals reduced. status: ok.
Release date (evidence)
2025-04-08T12:24:19.000Z (status: ok)

Score Summary

Overall: 69 / 100

Category Scores (0–100)

  • performance69
  • safety70
  • adoption83
  • openness33
  • cost100

Top drivers

  • evidence_audit_missing_source_link — Evidence indicates missing/failed; penalty applied per policy. missing_evidence — Evidence indicates missing/failed; penalty applied per policy.
  • missing_minor_incidents — Evidence indicates missing/failed; penalty applied per policy.
  • missing_major_incidents — Evidence indicates missing/failed; penalty applied per policy.
  • missing_critical_incidents — Evidence indicates missing/failed; penalty applied per policy.
  • evidence_paper_not_found — Evidence indicates missing/failed; penalty applied per policy. missing_evidence — Evidence indicates missing/failed; penalty applied per policy.

C) Evidence (4 tiles/cards; reasons required if not ok)

Official Page

✅ ok
refs:
  • https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
extracted:
{
  "url": "https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1"
}
reasons:
  • ok — Evidence indicates missing/failed; penalty applied per policy.
  • Only a model registry page was found; primary sources are missing so transparency score was reduced.
How this affected scoring

Evidence verified => no penalty applied for this signal.

Dev Activity

⚠️ missing source link
refs:
  • missing:github_repo
reasons:
  • A source was referenced but no valid link was provided; penalty applied per policy.
  • No public repository link found; development-activity score reduced.
How this affected scoring

missing source link => dev-activity score capped / penalty applied.

Paper

⚠️ not found
refs:
  • arxiv_query:"NVIDIA: Llama 3.1 Nemotron Ultra 253B v1"
reasons:
  • No known paper source found; transparency score reduced.
  • No verifiable source found; penalty applied per policy.
How this affected scoring

not found => transparency score reduced / penalty applied.

Audit

⚠️ missing source link
refs:
  • missing:audit_link
reasons:
  • A source was referenced but no valid link was provided; penalty applied per policy.
  • No known audit source found; audit score reduced.
How this affected scoring

missing source link => audit and safety scores reduced / penalty applied.

D) Full Breakdown (every item must show score + inputs + used evidence + why)

ItemScoreInputs (raw)Evidence & Why
General benchmarks60

No input data provided.

Why: No reason provided; score derived from available signals.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Coding benchmarks73

No input data provided.

Why: No reason provided; score derived from available signals.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Math & chat benchmarks79

No input data provided.

Why: No reason provided; score derived from available signals.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Safety documentation50

No input data provided.

Why: No reason provided; score derived from available signals.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Alignment disclosure0

No input data provided.

Why: No reason provided; score derived from available signals.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Misuse policy coverage50

No input data provided.

Why: No reason provided; score derived from available signals.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
External audit & red teaming—

No input data provided.

Why: evidence_audit_missing_source_link — Evidence indicates missing/failed; penalty applied per policy. missing_evidence — Evidence indicates missing/failed; penalty applied per policy.

Evidence not provided.

Missing evidence link (spec violation).

Transparency updates100

No input data provided.

Why: No reason provided; score derived from available signals.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Minor incidents100

No input data provided.

Why: missing_minor_incidents — Evidence indicates missing/failed; penalty applied per policy.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Major incidents100

No input data provided.

Why: missing_major_incidents — Evidence indicates missing/failed; penalty applied per policy.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Critical incidents100

No input data provided.

Why: missing_critical_incidents — Evidence indicates missing/failed; penalty applied per policy.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Model documentation33

No input data provided.

Why: No reason provided; score derived from available signals.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Training data disclosure33

No input data provided.

Why: No reason provided; score derived from available signals.

Evidence: Official page: https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1
Paper / technical report—

No input data provided.

Why: evidence_paper_not_found — Evidence indicates missing/failed; penalty applied per policy. missing_evidence — Evidence indicates missing/failed; penalty applied per policy.

Evidence not provided.

Missing evidence link (spec violation).

External review & transparency—

No input data provided.

Why: evidence_audit_missing_source_link — Evidence indicates missing/failed; penalty applied per policy. missing_evidence — Evidence indicates missing/failed; penalty applied per policy.

Evidence not provided.

Missing evidence link (spec violation).

Missing or failed evidence inputs trigger fixed penalties per policy. No placeholder states are hidden.

References (deduped list)

official_page

  • https://openrouter.ai/models/nvidia/llama-3.1-nemotron-ultra-253b-v1

repo/dev

No references recorded.

paper

No references recorded.

audit

No references recorded.

other

No references recorded.