Phi-4-multimodal-instruct
Support summary
Phi-4-multimodal-instruct is a checkpoint published by Microsoft, built on the Phi4MMForCausalLM architecture. The newest indexed releases vLLM 0.28.0, SGLang 0.5.19, and TensorRT-LLM 1.2.1 all document support.
vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0. SGLang documents support in 13 of 13 indexed releases, from 0.5.10 to 0.5.19. TensorRT-LLM documents support in 2 of 2 indexed releases, from 1.2.0 to 1.2.1.
- Documented hardware
- CPU
- Documented quantization
- BF16
- Configured context
- 131,072 tokens
- License
- mit
Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.
Hugging Face model card
- Publisher
- Microsoft
- Task
- automatic speech recognition
- License
- mit
- Library
- transformers
- Architecture
- Phi4MMForCausalLM
- Weight tensor elements
- 5.6B
- Tensor types
- BF16
- Configured context
- 131,072 tokens
- Languages
- multilingual, ar, zh, cs, da, nl, en, fi, fr, de, he, hu, it, ja, ko, no, pl, pt, ru, es, sv, th, tr, uk
- Weight access
- Public
- Repository created
- 2025-02-24
Model notes and sources
Image and audio handling depend on the documented engine path and preprocessing.
- vLLM v0.28.0 · docs/models/supported_models.md · 20 indexed revisions, v0.17.0 to v0.28.0
- SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdx · 3 indexed revisions, v0.5.17 to v0.5.19
- SGLang v0.5.19 · docs/docs/supported-models/multimodal_language_models.mdx · 3 indexed revisions, v0.5.17 to v0.5.19
- TensorRT-LLM v1.2.1 · docs/source/legacy/reference/support-matrix.md · 2 indexed revisions, v1.2.0 to v1.2.1
- microsoft/Phi-4-multimodal-instruct publisher metadata
- vLLM v0.28.0 · docs/models/hardware_supported_models/cpu.md · 10 indexed revisions, v0.22.0 to v0.28.0
- SGLang v0.5.16 · docs_new/docs/supported-models/generative_models.mdx · 8 indexed revisions, v0.5.11 to v0.5.16
- SGLang v0.5.16 · docs_new/docs/supported-models/multimodal_language_models.mdx · 8 indexed revisions, v0.5.11 to v0.5.16
- SGLang v0.5.15.post1 · docs/supported_models/text_generation/generative_models.md · 9 indexed revisions, v0.5.10 to v0.5.15.post1
- SGLang v0.5.15.post1 · docs/supported_models/text_generation/multimodal_language_models.md · 9 indexed revisions, v0.5.10 to v0.5.15.post1
- microsoft/Phi-4-multimodal-instruct · publisher model card
- microsoft/Phi-4-multimodal-instruct · Hugging Face metadata
- microsoft/Phi-4-multimodal-instruct · publisher configuration
- vllm · models/microsoft/Phi-4-mini-instruct.yaml
- vllm · models/microsoft/Phi-4-multimodal-instruct.yaml
- vllm · Microsoft/Phi-4.md
- Reviewed
Engine support
3 engines
| Engine | Release | Checkpoint support | Evidence scope | Last known supported |
|---|---|---|---|---|
| vLLM | Version not pinnedRecipe / cookbook | Documented recipeSource: vllm · models/microsoft/Phi-4-mini-instruct.yamlReviewed | View 0.28.0 | |
Features, dependencies and evidence for vLLM 0.28.0 | ||||
| SGLang | 0.5.19Newest indexed | Checkpoint evidenceSource 1: SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdxSource 2: SGLang v0.5.19 · docs/docs/supported-models/multimodal_language_models.mdxReviewed | 0.5.19This release | |
Features, dependencies and evidence for SGLang 0.5.19 | ||||
| TensorRT-LLM | 1.2.1Newest indexed | Checkpoint evidenceSource: TensorRT-LLM v1.2.1 · docs/source/legacy/reference/support-matrix.mdReviewed | 1.2.1This release | |
Features, dependencies and evidence for TensorRT-LLM 1.2.1 | ||||