DeepSeek-V3.2

Checkpointdeepseek-ai/DeepSeek-V3.2Detailed entryModel card

Support summary

DeepSeek-V3.2 is a checkpoint published by DeepSeek, built on the DeepseekV32ForCausalLM architecture. The newest indexed releases vLLM 0.28.0 and TensorRT-LLM 1.2.1 both document support.

vLLM documents support in 4 of 20 indexed releases, from 0.26.0 to 0.28.0. TensorRT-LLM documents support in 2 of 2 indexed releases, from 1.2.0 to 1.2.1.

Documented hardware
NVIDIA / CUDA
Documented quantization
FP8
Documented features
Reasoning parsers, Tensor parallelism, and Tool calling
Configured context
163,840 tokens
License
mit

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Hugging Face model card
Publisher
DeepSeek
Task
text generation
License
mit
Library
transformers
Architecture
DeepseekV32ForCausalLM
Weight tensor elements
685.4B
Tensor types
BF16, F8_E4M3, F32
Quantization
fp8
Configured context
163,840 tokens
Base models
deepseek-ai/DeepSeek-V3.2-Exp-Base
Weight access
Public
Repository created
2025-12-01
Source 1: deepseek-ai/DeepSeek-V3.2 · publisher model cardSource 2: deepseek-ai/DeepSeek-V3.2 · Hugging Face metadataSource 3: deepseek-ai/DeepSeek-V3.2 · publisher configurationReviewed
Model notes and sources

A separate architecture from V3; preserve its release-specific feature matrix.

Engine support

3 engines

Engine support for DeepSeek-V3.2
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedCheckpoint evidenceSource: TensorRT-LLM v1.2.1 · docs/source/models/supported-models.mdReviewed 1.2.1This release
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks