GLM-4.5

Checkpointzai-org/GLM-4.5Detailed entryModel card

Support summary

GLM-4.5 is a checkpoint published by Z.ai, built on the Glm4MoeForCausalLM architecture. vLLM 0.28.0, the newest indexed vLLM release, documents support. Official recipes or cookbooks cover SGLang, without pinning a stable release.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

Documented hardware
NVIDIA / CUDA and AMD / ROCm
Documented quantization
BF16
Documented features
Reasoning parsers and Tensor parallelism
Configured context
131,072 tokens
License
mit

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Hugging Face model card
Publisher
Z.ai
Task
text generation
License
mit
Library
transformers
Architecture
Glm4MoeForCausalLM
Weight tensor elements
358.3B
Tensor types
BF16, F32
Configured context
131,072 tokens
Languages
en, zh
Weight access
Public
Repository created
2025-07-20
Source 1: zai-org/GLM-4.5 · publisher model cardSource 2: zai-org/GLM-4.5 · Hugging Face metadataSource 3: zai-org/GLM-4.5 · publisher configurationReviewed
Model notes and sources

GLM MoE checkpoint. Family support is not evidence for every GLM revision.

Engine support

3 engines

Engine support for GLM-4.5
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLangVersion not pinnedRecipe / cookbookDocumented recipe

Official recipe

Source 1: sglang · docs/cookbook/autoregressive/GLM/GLM-4.5.mdxSource 2: sglang · docs/src/snippets/autoregressive/glm-45-deployment.jsxReviewed
No supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks