Kimi-Linear-48B-A3B-Instruct
Support summary
Kimi-Linear-48B-A3B-Instruct is a checkpoint published by Moonshot AI, built on the KimiLinearForCausalLM architecture. The newest indexed releases vLLM 0.28.0 and SGLang 0.5.19 both document support.
vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0. SGLang documents support in 13 of 13 indexed releases, from 0.5.10 to 0.5.19.
- Documented hardware
- NVIDIA / CUDA and AMD / ROCm
- Documented quantization
- BF16
- Documented features
- Tensor parallelism
- License
- mit
Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.
Hugging Face model card
- Publisher
- Moonshot AI
- Task
- text generation
- License
- mit
- Library
- transformers
- Architecture
- KimiLinearForCausalLM
- Weight tensor elements
- 49.1B
- Tensor types
- BF16, F32
- Weight access
- Public
- Repository created
- 2025-10-30
Model notes and sources
Hybrid linear-attention model. Do not apply Kimi K2 or ordinary attention assumptions.
- vLLM v0.28.0 · docs/models/supported_models.md · 20 indexed revisions, v0.17.0 to v0.28.0
- SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdx · 3 indexed revisions, v0.5.17 to v0.5.19
- moonshotai/Kimi-Linear-48B-A3B-Instruct publisher metadata
- SGLang v0.5.16 · docs_new/docs/supported-models/generative_models.mdx · 8 indexed revisions, v0.5.11 to v0.5.16
- SGLang v0.5.15.post1 · docs/supported_models/text_generation/generative_models.md · 9 indexed revisions, v0.5.10 to v0.5.15.post1
- moonshotai/Kimi-Linear-48B-A3B-Instruct · publisher model card
- moonshotai/Kimi-Linear-48B-A3B-Instruct · Hugging Face metadata
- moonshotai/Kimi-Linear-48B-A3B-Instruct · publisher configuration
- vllm · models/moonshotai/Kimi-Linear-48B-A3B-Instruct.yaml
- sglang · docs/src/snippets/autoregressive/kimi-linear-deployment.jsx
- sglang · docs/cookbook/autoregressive/Moonshotai/Kimi-Linear.mdx
- vllm · moonshotai/Kimi-Linear.md
- Reviewed
Engine support
3 engines
| Engine | Release | Checkpoint support | Evidence scope | Last known supported |
|---|---|---|---|---|
| vLLM | 0.28.0Newest indexed | Checkpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed | 0.28.0This release | |
Features, dependencies and evidence for vLLM 0.28.0 | ||||
| SGLang | 0.5.19Newest indexed | Checkpoint evidenceSource: SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdxReviewed | 0.5.19This release | |
Features, dependencies and evidence for SGLang 0.5.19 | ||||
| TensorRT-LLM | 1.2.1Newest indexed | No matching evidence curated | No supported release indexed | |
Features, dependencies and evidence for TensorRT-LLM 1.2.1 | ||||