NVLM-D-72B

Checkpointnvidia/NVLM-D-72BModel card indexedModel card

Support summary

NVLM-D-72B is a checkpoint published by NVIDIA, built on the NVLM_D_Model and NVLM_D architectures. vLLM 0.28.0, the newest indexed vLLM release, documents support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

License
cc-by-nc-4.0
Hugging Face model card
Publisher
NVIDIA
Task
image text to text
License
cc-by-nc-4.0
Library
transformers
Architecture
NVLM_D
Weight tensor elements
79.4B
Tensor types
F32, BF16
Languages
en
Weight access
Public
Repository created
2024-09-30
Source 1: nvidia/NVLM-D-72B · publisher model cardSource 2: nvidia/NVLM-D-72B · Hugging Face metadataSource 3: nvidia/NVLM-D-72B · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for NVLM-D-72B
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1