Llama-3.1-Nemotron-Nano-VL-8B-V1

Checkpointnvidia/Llama-3.1-Nemotron-Nano-VL-8B-V1Model card indexedModel card

Support summary

Llama-3.1-Nemotron-Nano-VL-8B-V1 is a checkpoint published by NVIDIA, built on the Llama_Nemotron_Nano_VL architecture. vLLM 0.28.0, the newest indexed vLLM release, documents support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

License
nvidia-open-model-license
Hugging Face model card
Publisher
NVIDIA
Task
image text to text
Library
transformers
Architecture
Llama_Nemotron_Nano_VL
Weight tensor elements
8.7B
Tensor types
BF16
Weight access
Public
Repository created
2025-06-03
Source 1: nvidia/Llama-3.1-Nemotron-Nano-VL-8B-V1 · publisher model cardSource 2: nvidia/Llama-3.1-Nemotron-Nano-VL-8B-V1 · Hugging Face metadataSource 3: nvidia/Llama-3.1-Nemotron-Nano-VL-8B-V1 · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for Llama-3.1-Nemotron-Nano-VL-8B-V1
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1