Qwen3-Next-80B-A3B-Instruct

CheckpointQwen/Qwen3-Next-80B-A3B-InstructDetailed entryModel card

Support summary

Qwen3-Next-80B-A3B-Instruct is a checkpoint published by Qwen, built on the Qwen3NextForCausalLM architecture. The newest indexed releases vLLM 0.28.0 and SGLang 0.5.19 both document support. TensorRT-LLM lists its architecture, but not this exact checkpoint.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0. SGLang documents support in 13 of 13 indexed releases, from 0.5.10 to 0.5.19.

Documented hardware
NVIDIA / CUDA and AMD / ROCm
Documented quantization
BF16
Documented features
Prefix caching, Speculative decoding, and Tensor parallelism
Configured context
262,144 tokens
License
apache-2.0

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Hugging Face model card
Publisher
Qwen
Task
text generation
License
apache-2.0
Library
transformers
Architecture
Qwen3NextForCausalLM
Weight tensor elements
81.3B
Tensor types
BF16
Configured context
262,144 tokens
Weight access
Public
Repository created
2025-09-09
Source 1: Qwen/Qwen3-Next-80B-A3B-Instruct · publisher model cardSource 2: Qwen/Qwen3-Next-80B-A3B-Instruct · Hugging Face metadataSource 3: Qwen/Qwen3-Next-80B-A3B-Instruct · publisher configurationReviewed
Model notes and sources

Instruct and Thinking are distinct checkpoints. The TensorRT-LLM feature matrix flags limitations for this architecture.

Engine support

3 engines

Engine support for Qwen3-Next-80B-A3B-Instruct
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedCheckpoint evidenceSource: SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdxReviewed 0.5.19This release
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedArchitecture listed; exact checkpoint unknownNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks