Llama-3_3-Nemotron-Super-49B-v1

Checkpointnvidia/Llama-3_3-Nemotron-Super-49B-v1Detailed entryModel card

Support summary

Llama-3_3-Nemotron-Super-49B-v1 is a checkpoint published by NVIDIA, built on the DeciLMForCausalLM and NemotronNASForCausalLM architectures. The newest indexed releases vLLM 0.28.0, SGLang 0.5.19, and TensorRT-LLM 1.2.1 all document support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0. SGLang documents support in 13 of 13 indexed releases, from 0.5.10 to 0.5.19. TensorRT-LLM documents support in 2 of 2 indexed releases, from 1.2.0 to 1.2.1.

Configured context
131,072 tokens
License
nvidia-open-model-license
Hugging Face model card
Publisher
NVIDIA
Task
text generation
Library
transformers
Architecture
DeciLMForCausalLM
Weight tensor elements
49.9B
Tensor types
BF16
Configured context
131,072 tokens
Languages
en
Weight access
Public
Repository created
2025-03-16
Source 1: nvidia/Llama-3_3-Nemotron-Super-49B-v1 · publisher model cardSource 2: nvidia/Llama-3_3-Nemotron-Super-49B-v1 · Hugging Face metadataSource 3: nvidia/Llama-3_3-Nemotron-Super-49B-v1 · publisher configurationReviewed
Model notes and sources

The engines name different native implementations; architecture evidence stays engine-specific.

Engine support

3 engines

Engine support for Llama-3_3-Nemotron-Super-49B-v1
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedCheckpoint evidenceSource: SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdxReviewed 0.5.19This release
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedCheckpoint evidenceSource 1: TensorRT-LLM v1.2.1 · docs/source/models/supported-models.mdSource 2: TensorRT-LLM v1.2.1 · docs/source/legacy/reference/support-matrix.mdReviewed 1.2.1This release
Features, dependencies and evidence for TensorRT-LLM 1.2.1