Mistral-Small-3.1-24B-Instruct-2503
Support summary
Mistral-Small-3.1-24B-Instruct-2503 is a checkpoint published by Mistral AI, built on the Mistral3ForConditionalGeneration and PixtralForConditionalGeneration architectures. The newest indexed releases vLLM 0.28.0, SGLang 0.5.19, and TensorRT-LLM 1.2.1 all document support.
vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0. SGLang documents support in 13 of 13 indexed releases, from 0.5.10 to 0.5.19. TensorRT-LLM documents support in 2 of 2 indexed releases, from 1.2.0 to 1.2.1.
- Configured context
- 131,072 tokens
- License
- apache-2.0
Hugging Face model card
- Publisher
- Mistral AI
- License
- apache-2.0
- Library
- vllm
- Architecture
- Mistral3ForConditionalGeneration
- Weight tensor elements
- 24B
- Tensor types
- BF16
- Configured context
- 131,072 tokens
- Languages
- en, fr, de, es, pt, it, ja, ko, ru, zh, ar, fa, id, ms, ne, pl, ro, sr, sv, tr, uk, vi, hi, bn
- Base models
- mistralai/Mistral-Small-3.1-24B-Base-2503
- Weight access
- Public
- Repository created
- 2025-03-11
Model notes and sources
Engines may use different implementations for Mistral-format and Transformers-format paths.
- vLLM v0.28.0 · docs/models/supported_models.md · 20 indexed revisions, v0.17.0 to v0.28.0
- SGLang v0.5.19 · docs/docs/supported-models/multimodal_language_models.mdx · 3 indexed revisions, v0.5.17 to v0.5.19
- TensorRT-LLM v1.2.1 · docs/source/legacy/reference/support-matrix.md · 2 indexed revisions, v1.2.0 to v1.2.1
- mistralai/Mistral-Small-3.1-24B-Instruct-2503 publisher metadata
- SGLang v0.5.16 · docs_new/docs/supported-models/multimodal_language_models.mdx · 8 indexed revisions, v0.5.11 to v0.5.16
- SGLang v0.5.15.post1 · docs/supported_models/text_generation/multimodal_language_models.md · 9 indexed revisions, v0.5.10 to v0.5.15.post1
- mistralai/Mistral-Small-3.1-24B-Instruct-2503 · publisher model card
- mistralai/Mistral-Small-3.1-24B-Instruct-2503 · Hugging Face metadata
- mistralai/Mistral-Small-3.1-24B-Instruct-2503 · publisher configuration
- Reviewed
Engine support
3 engines
| Engine | Release | Checkpoint support | Evidence scope | Last known supported |
|---|---|---|---|---|
| vLLM | 0.28.0Newest indexed | Checkpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed | 0.28.0This release | |
Features, dependencies and evidence for vLLM 0.28.0 | ||||
| SGLang | 0.5.19Newest indexed | Checkpoint evidenceSource: SGLang v0.5.19 · docs/docs/supported-models/multimodal_language_models.mdxReviewed | 0.5.19This release | |
Features, dependencies and evidence for SGLang 0.5.19 | ||||
| TensorRT-LLM | 1.2.1Newest indexed | Checkpoint evidenceSource: TensorRT-LLM v1.2.1 · docs/source/legacy/reference/support-matrix.mdReviewed | 1.2.1This release | |
Features, dependencies and evidence for TensorRT-LLM 1.2.1 | ||||