deepseek-vl2

Checkpointdeepseek-ai/deepseek-vl2Model card indexedModel card

Support summary

deepseek-vl2 is a checkpoint published by DeepSeek, built on the DeepseekVLV2ForCausalLM architecture. The newest indexed releases vLLM 0.28.0 and SGLang 0.5.19 both document support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0. SGLang documents support in 13 of 13 indexed releases, from 0.5.10 to 0.5.19.

License
deepseek
Hugging Face model card
Publisher
DeepSeek
Task
image text to text
License
deepseek
Library
transformers
Weight tensor elements
27.5B
Tensor types
F32, BF16
Weight access
Public
Repository created
2024-12-13
Source 1: deepseek-ai/deepseek-vl2 · publisher model cardSource 2: deepseek-ai/deepseek-vl2 · Hugging Face metadataSource 3: deepseek-ai/deepseek-vl2 · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for deepseek-vl2
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedCheckpoint evidenceSource: SGLang v0.5.19 · docs/docs/supported-models/multimodal_language_models.mdxReviewed 0.5.19This release
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1