NVIDIA-Nemotron-3-Super-120B-A12B-BF16

Checkpointnvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16Model card indexedModel card

Support summary

NVIDIA-Nemotron-3-Super-120B-A12B-BF16 is a checkpoint published by NVIDIA, built on the NemotronHForCausalLM architecture. Official recipes or cookbooks cover vLLM and SGLang, without pinning a stable release. TensorRT-LLM lists its architecture, but not this exact checkpoint.

Documented hardware
NVIDIA / CUDA
Documented quantization
BF16
Documented features
Reasoning parsers, Tensor parallelism, and Tool calling
Configured context
262,144 tokens
License
nvidia-nemotron-open-model-license

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Hugging Face model card
Publisher
NVIDIA
Task
text generation
Library
transformers
Architecture
NemotronHForCausalLM
Weight tensor elements
123.6B
Tensor types
F32, BF16
Configured context
262,144 tokens
Languages
en, fr, es, it, de, ja, zh
Weight access
Public
Repository created
2026-03-10
Source 1: nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 · publisher model cardSource 2: nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 · Hugging Face metadataSource 3: nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for NVIDIA-Nemotron-3-Super-120B-A12B-BF16
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLMVersion not pinnedRecipe / cookbookDocumented recipe

Official recipe

Source: vllm · models/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16.yamlReviewed
No supported release indexed
Features, dependencies and evidence for vLLM 0.28.0
SGLangVersion not pinnedRecipe / cookbookDocumented recipe

Official recipe

Source 1: sglang · docs/cookbook/autoregressive/NVIDIA/Nemotron3-Super.mdxSource 2: sglang · docs/src/snippets/autoregressive/nemotron3-super-deployment.jsxReviewed
No supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedArchitecture listed; exact checkpoint unknownNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks