Pixtral-12B-2409

Checkpointmistralai/Pixtral-12B-2409Model card indexedModel card

Support summary

Pixtral-12B-2409 is a checkpoint published by Mistral AI, built on the PixtralForConditionalGeneration architecture. vLLM 0.28.0, the newest indexed vLLM release, documents support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

License
apache-2.0
Hugging Face model card
Publisher
Mistral AI
License
apache-2.0
Library
vllm
Languages
en, fr, de, es, it, pt, ru, zh, ja
Base models
mistralai/Pixtral-12B-Base-2409
Weight access
Public
Repository created
2024-09-11
Source 1: mistralai/Pixtral-12B-2409 · publisher model cardSource 2: mistralai/Pixtral-12B-2409 · Hugging Face metadataReviewed
Model notes and sources

Engine support

3 engines

Engine support for Pixtral-12B-2409
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1