Qwen2.5-Omni-3B

CheckpointQwen/Qwen2.5-Omni-3BModel card indexedModel card

Support summary

Qwen2.5-Omni-3B is a checkpoint published by Qwen, built on the Qwen2_5OmniThinkerForConditionalGeneration and Qwen2_5OmniModel architectures. vLLM 0.28.0, the newest indexed vLLM release, documents support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

License
qwen-research
Hugging Face model card
Publisher
Qwen
Task
any to any
Library
transformers
Architecture
Qwen2_5OmniModel
Weight tensor elements
5.5B
Tensor types
F32, BF16
Languages
en
Weight access
Public
Repository created
2025-04-30
Source 1: Qwen/Qwen2.5-Omni-3B · publisher model cardSource 2: Qwen/Qwen2.5-Omni-3B · Hugging Face metadataSource 3: Qwen/Qwen2.5-Omni-3B · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for Qwen2.5-Omni-3B
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1