Inference EngineeringAcademy
HomeFoundations Free
Courses
Pricing
Resources
JobsCoding practiceStart learning

NVIDIA-Nemotron-3-Nano-4B-GGUF

Checkpointnvidia/NVIDIA-Nemotron-3-Nano-4B-GGUFModel card indexedModel card

Support summary

NVIDIA-Nemotron-3-Nano-4B-GGUF is a checkpoint published by NVIDIA. No indexed engine release, recipe, or architecture listing documents support yet. That does not mean the model is incompatible.

License
nvidia-nemotron-open-model-license
Hugging Face model card
Publisher
NVIDIA
Task
text generation
Library
transformers
Languages
en
Base models
nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8
Weight access
Public
Repository created
2026-03-07
Source 1: nvidia/NVIDIA-Nemotron-3-Nano-4B-GGUF · publisher model cardSource 2: nvidia/NVIDIA-Nemotron-3-Nano-4B-GGUF · Hugging Face metadataReviewed
Model notes and sources

Engine support

3 engines

Engine support for NVIDIA-Nemotron-3-Nano-4B-GGUF
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1