NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-FP8

Checkpointnvidia/NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-FP8Model card indexedModel card

Support summary

NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-FP8 is a checkpoint published by NVIDIA, built on the NemotronHForCausalLM architecture. vLLM and TensorRT-LLM list its architecture, but not this exact checkpoint.

Configured context: 262,144 tokens
License: nvidia-open-model-license

Hugging Face model card

Publisher: NVIDIA
Task: text generation
License: nvidia-open-model-license
Library: transformers
Architecture: NemotronHForCausalLM
Weight tensor elements: 31.6B
Tensor types: F32, BF16, F8_E4M3
Configured context: 262,144 tokens
Languages: en, es, fr, de, ja, it
Base models: nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16
Weight access: Public
Repository created: 2026-04-01

Source 1 Source 2 Source 3Reviewed 2026-09-05

Model notes and sources

Engine support

3 engines

Engine support for NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-FP8
Engine	Release	Evidence scope	Last known supported
vLLM	`0.28.0`Newest indexed	Architecture listed; exact checkpoint unknown	No supported release indexed
Features, dependencies and evidence for vLLM 0.28.0
SGLang	`0.5.19`Newest indexed	No matching evidence curated	No supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM	`1.2.1`Newest indexed	Architecture listed; exact checkpoint unknown	No supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1