cogagent-9b-20241220

Checkpointzai-org/cogagent-9b-20241220Model card indexedModel card

Support summary

cogagent-9b-20241220 is a checkpoint published by Z.ai, built on the GLM4VForCausalLM and ChatGLMForConditionalGeneration architectures. vLLM 0.28.0, the newest indexed vLLM release, documents support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

License
other
Hugging Face model card
Publisher
Z.ai
Task
image text to text
License
other
Library
transformers
Architecture
ChatGLMForConditionalGeneration
Weight tensor elements
13.9B
Tensor types
BF16
Languages
zh, en
Base models
THUDM/glm-4v-9b
Weight access
Public
Repository created
2024-12-20
Source 1: zai-org/cogagent-9b-20241220 · publisher model cardSource 2: zai-org/cogagent-9b-20241220 · Hugging Face metadataSource 3: zai-org/cogagent-9b-20241220 · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for cogagent-9b-20241220
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1