Qwen3-32B

CheckpointQwen/Qwen3-32BModel card indexedModel card

Support summary

Qwen3-32B is a checkpoint published by Qwen, built on the Qwen3ForCausalLM architecture. vLLM 0.28.0, the newest indexed vLLM release, documents support. TensorRT-LLM lists its architecture, but not this exact checkpoint.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

Documented hardware
Intel GPU / XPU
Documented quantization
BF16
Documented features
Tensor parallelism
Configured context
40,960 tokens
License
apache-2.0

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Hugging Face model card
Publisher
Qwen
Task
text generation
License
apache-2.0
Library
transformers
Architecture
Qwen3ForCausalLM
Weight tensor elements
32.8B
Tensor types
BF16
Configured context
40,960 tokens
Weight access
Public
Repository created
2025-04-27
Source 1: Qwen/Qwen3-32B · publisher model cardSource 2: Qwen/Qwen3-32B · Hugging Face metadataSource 3: Qwen/Qwen3-32B · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for Qwen3-32B
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLMVersion not pinnedRecipe / cookbookDocumented recipe

Official recipe

Source: vllm · models/Qwen/Qwen3-32B.yamlReviewed
View 0.28.0
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedArchitecture listed; exact checkpoint unknownNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks