Skip to content

NVIDIA

llama-3.1-nemotron-ultra-253b-v1 benchmarks, ranks and price

Where Artificial Analysis, LiveBench, LMArena and Berkeley BFCL place llama-3.1-nemotron-ultra-253b-v1, what it costs through OpenRouter and Vercel AI Gateway, and the models either side of it on the consensus.

Updated Nov 15, 2026Full leaderboardSources and method

Read Nov 15, 2026

#64of 69

on the LLM leaderboard, with a consensus score of 24 across 2 leaderboards.

Source: Artificial Analysis, LiveBench, LMArena and Berkeley BFCL, combined by Rank.ai.

By leaderboard

Where each leaderboard places llama-3.1-nemotron-ultra-253b-v1

Artificial Analysis

Not measured by Artificial Analysis.

Intelligence Index: a composite of reasoning, knowledge, maths and coding evaluations.

LiveBench

Not measured by LiveBench.

Contamination-limited questions refreshed each release: reasoning, maths, coding, data analysis, language.

LMArena

#51of 66

Score 1347. Best run: llama-3.1-nemotron-ultra-253b-v1.

Blind head-to-head human votes, style controlled.

Berkeley BFCL

#36of 36

Score 10.00%. Best run: Llama-3.1-Nemotron-Ultra-253B-v1 (FC).

Function calling and tool use, single turn to multi turn and web search.

Price and context

–

No gateway lists it.

Nearby

The models either side of llama-3.1-nemotron-ultra-253b-v1

  1. #61gpt-oss-120b25
  2. #62amazon-nova-pro-v1.025
  3. #63granite-3.1-8b-instruct24
  4. #64llama-3.1-nemotron-ultra-253b-v124
  5. #65llama-3.1-8b-instruct24
  6. #66amazon-nova-micro-v1.023
  7. #67gemma-3-4b-it22

Questions about llama-3.1-nemotron-ultra-253b-v1

How good is llama-3.1-nemotron-ultra-253b-v1?
llama-3.1-nemotron-ultra-253b-v1 ranks #64 of 69 models on the Rank.ai LLM leaderboard, with a consensus score of 24 out of 100 across 2 leaderboards.
Is llama-3.1-nemotron-ultra-253b-v1 better than granite-3.1-8b-instruct?
Not on the consensus: granite-3.1-8b-instruct scores 24 to llama-3.1-nemotron-ultra-253b-v1's 24. Compare them source by source below, since the leaderboards test different things.
Is llama-3.1-nemotron-ultra-253b-v1 better than llama-3.1-8b-instruct?
On the consensus, yes: 24 to 24.

Enter your website. In about two minutes, Rank.ai asks ChatGPT, Claude and Gemini 12 questions your customers ask and grades how often they name you.

  • Your grade out of 100How often AI names you, cites your site, and how high it ranks you.
  • Who gets namedEvery competitor in the answers, most named first.
  • The pages AI readsThe sources behind each answer.
  • Three fixesWhat to fix first, with a brief for the first article.