Hunyuan-A13B-Instruct

Checkpointtencent/Hunyuan-A13B-InstructModel card indexedModel card

Support summary

Hunyuan-A13B-Instruct is a checkpoint published by Tencent, built on the HunYuanMoEV1ForCausalLM architecture. vLLM 0.28.0, the newest indexed vLLM release, documents support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

Documented hardware
AMD / ROCm
Documented quantization
BF16
Documented features
Tensor parallelism
Configured context
32,768 tokens
License
tencent-hunyuan-a13b

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Hugging Face model card
Publisher
Tencent
Task
text generation
Library
transformers
Architecture
HunYuanMoEV1ForCausalLM
Weight tensor elements
80.4B
Tensor types
F32, BF16
Configured context
32,768 tokens
Weight access
Public
Repository created
2025-06-25
Source 1: tencent/Hunyuan-A13B-Instruct · publisher model cardSource 2: tencent/Hunyuan-A13B-Instruct · Hugging Face metadataSource 3: tencent/Hunyuan-A13B-Instruct · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for Hunyuan-A13B-Instruct
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks