Qwen3.8-Flash-Next-FP8

CheckpointQwen/Qwen3.8-Flash-Next-FP8Model card indexedModel card

Support summary

Qwen3.8-Flash-Next-FP8 is a checkpoint published by Qwen, built on the Qwen4ExpForConditionalGeneration architecture. Official recipes or cookbooks cover vLLM and SGLang, without pinning a stable release.

Documented hardware
NVIDIA / CUDA and AMD / ROCm
Documented quantization
FP8
Documented features
Prefix caching, Reasoning parsers, Speculative decoding, Tensor parallelism, and Tool calling
Configured context
262,144 tokens
License
qwen-community-1.0

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Hugging Face model card
Publisher
Qwen
Task
image text to text
Library
transformers
Architecture
Qwen4ExpForConditionalGeneration
Weight tensor elements
180B
Tensor types
BF16, F8_E4M3, I64
Quantization
fp8
Configured context
262,144 tokens
Base models
Qwen/Qwen3.8-Flash-Next
Weight access
Public
Repository created
2026-08-24
Source 1: Qwen/Qwen3.8-Flash-Next-FP8 · publisher model cardSource 2: Qwen/Qwen3.8-Flash-Next-FP8 · Hugging Face metadataSource 3: Qwen/Qwen3.8-Flash-Next-FP8 · publisher configurationReviewed

Publisher deployment guidance

Model notes and sources

Engine support

3 engines

Engine support for Qwen3.8-Flash-Next-FP8
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLMVersion not pinnedRecipe / cookbookDocumented recipe

Official recipe

Source: vllm · models/Qwen/Qwen3.8-Flash-Next.yamlReviewed
No supported release indexed
Features, dependencies and evidence for vLLM 0.28.0
SGLangVersion not pinnedRecipe / cookbookDocumented recipe

Official recipe

Source 1: sglang · docs/cookbook/autoregressive/Qwen/Qwen3.8-Flash-Next.mdxSource 2: sglang · docs/src/snippets/_deployment.jsxSource 3: sglang · docs/src/snippets/configs/Qwen/qwen3.8-flash-next.jsxSource 4: sglang · docs/src/snippets/configs/Qwen/qwen3.8-flash-next-benchmarks.jsxSource 5: sglang · docs/src/snippets/_playground.jsxReviewed
No supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks