Qwen-VL-Chat

CheckpointQwen/Qwen-VL-ChatModel card indexedModel card

Support summary

Qwen-VL-Chat is a checkpoint published by Qwen, built on the QwenVLForConditionalGeneration and QWenLMHeadModel architectures. vLLM last documented support in 0.23.0; its newest indexed release does not list it.

vLLM documents support in 13 of 20 indexed releases, from 0.17.0 to 0.23.0.

Configured context
8,192 tokens
Hugging Face model card
Publisher
Qwen
Task
text generation
Library
transformers
Architecture
QWenLMHeadModel
Configured context
8,192 tokens
Languages
zh, en
Weight access
Public
Repository created
2023-08-20
Source 1: Qwen/Qwen-VL-Chat · publisher model cardSource 2: Qwen/Qwen-VL-Chat · Hugging Face metadataSource 3: Qwen/Qwen-VL-Chat · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for Qwen-VL-Chat
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedNo matching evidence curatedView 0.23.0 · checkpoint evidenceSource: vLLM v0.23.0 · docs/models/supported_models.mdReviewed
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1