Kimi-K2.6
Support summary
Kimi-K2.6 is a checkpoint published by Moonshot AI, built on the KimiK25ForConditionalGeneration architecture. Official recipes or cookbooks cover vLLM and SGLang, without pinning a stable release.
- Documented hardware
- NVIDIA / CUDA and AMD / ROCm
- Documented quantization
- int4
- Documented features
- Reasoning parsers, Speculative decoding, Tensor parallelism, and Tool calling
- Configured context
- 262,144 tokens
- License
- modified-mit
Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.
Hugging Face model card
- Publisher
- Moonshot AI
- Task
- image text to text
- License
- modified-mit
- Library
- transformers
- Architecture
- KimiK25ForConditionalGeneration
- Weight tensor elements
- 1T
- Tensor types
- F32, I32, BF16
- Quantization
- compressed-tensors · pack-quantized
- Configured context
- 262,144 tokens
- Weight access
- Public
- Repository created
- 2026-04-14
Model notes and sources
- moonshotai/Kimi-K2.6 · publisher model card
- moonshotai/Kimi-K2.6 · Hugging Face metadata
- moonshotai/Kimi-K2.6 · publisher configuration
- vllm · models/moonshotai/Kimi-K2.6.yaml
- sglang · docs/src/snippets/autoregressive/kimi-k26-deployment.jsx
- sglang · docs/cookbook/autoregressive/Moonshotai/Kimi-K2.6.mdx
- Reviewed
Engine support
3 engines
| Engine | Release | Checkpoint support | Evidence scope | Last known supported |
|---|---|---|---|---|
| vLLM | Version not pinnedRecipe / cookbook | Documented recipeSource: vllm · models/moonshotai/Kimi-K2.6.yamlReviewed | No supported release indexed | |
Features, dependencies and evidence for vLLM 0.28.0 | ||||
| SGLang | Version not pinnedRecipe / cookbook | Documented recipeSource 1: sglang · docs/cookbook/autoregressive/Moonshotai/Kimi-K2.6.mdxSource 2: sglang · docs/src/snippets/autoregressive/kimi-k26-deployment.jsxReviewed | No supported release indexed | |
Features, dependencies and evidence for SGLang 0.5.19 | ||||
| TensorRT-LLM | 1.2.1Newest indexed | No matching evidence curated | No supported release indexed | |
Features, dependencies and evidence for TensorRT-LLM 1.2.1 | ||||