Llama-4-Scout-17B-16E-Instruct
Support summary
Llama-4-Scout-17B-16E-Instruct is a checkpoint published by Meta, built on the Llama4ForConditionalGeneration architecture. The newest indexed releases vLLM 0.28.0, SGLang 0.5.19, and TensorRT-LLM 1.2.1 all document support.
vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0. SGLang documents support in 13 of 13 indexed releases, from 0.5.10 to 0.5.19. TensorRT-LLM documents support in 2 of 2 indexed releases, from 1.2.0 to 1.2.1.
- Documented hardware
- CPU, NVIDIA / CUDA, and AMD / ROCm
- Documented quantization
- BF16
- Documented features
- Tensor parallelism
- License
- llama4
Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.
Hugging Face model card
- Publisher
- Meta
- Task
- image text to text
- License
- llama4
- Library
- transformers
- Architecture
- Llama4ForConditionalGeneration
- Weight tensor elements
- 108.6B
- Tensor types
- BF16
- Languages
- ar, de, en, es, fr, hi, id, it, pt, th, tl, vi
- Base models
- meta-llama/Llama-4-Scout-17B-16E
- Weight access
- Publisher approval or terms required
- Repository created
- 2025-04-02
Model notes and sources
Check text and multimodal paths separately; TensorRT-LLM documents different cache and disaggregation support.
- vLLM v0.28.0 · docs/models/supported_models.md · 20 indexed revisions, v0.17.0 to v0.28.0
- SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdx · 3 indexed revisions, v0.5.17 to v0.5.19
- TensorRT-LLM v1.2.1 · docs/source/models/supported-models.md · 2 indexed revisions, v1.2.0 to v1.2.1
- TensorRT-LLM v1.2.1 · docs/source/legacy/reference/support-matrix.md · 2 indexed revisions, v1.2.0 to v1.2.1
- meta-llama/Llama-4-Scout-17B-16E-Instruct publisher metadata
- vLLM v0.28.0 · docs/models/hardware_supported_models/cpu.md · 10 indexed revisions, v0.22.0 to v0.28.0
- SGLang v0.5.16 · docs_new/docs/supported-models/generative_models.mdx · 8 indexed revisions, v0.5.11 to v0.5.16
- SGLang v0.5.15.post1 · docs/supported_models/text_generation/generative_models.md · 9 indexed revisions, v0.5.10 to v0.5.15.post1
- meta-llama/Llama-4-Scout-17B-16E-Instruct · publisher model card
- meta-llama/Llama-4-Scout-17B-16E-Instruct · Hugging Face metadata
- vllm · models/meta-llama/Llama-4-Scout-17B-16E-Instruct.yaml
- sglang · docs/cookbook/autoregressive/Meta/Llama4.mdx
- Reviewed
Engine support
3 engines
| Engine | Release | Checkpoint support | Evidence scope | Last known supported |
|---|---|---|---|---|
| vLLM | Version not pinnedRecipe / cookbook | Documented recipeSource: vllm · models/meta-llama/Llama-4-Scout-17B-16E-Instruct.yamlReviewed | View 0.28.0 | |
Features, dependencies and evidence for vLLM 0.28.0 | ||||
| SGLang | 0.5.19Newest indexed | Checkpoint evidenceSource: SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdxReviewed | 0.5.19This release | |
Features, dependencies and evidence for SGLang 0.5.19 | ||||
| TensorRT-LLM | 1.2.1Newest indexed | Checkpoint evidenceSource 1: TensorRT-LLM v1.2.1 · docs/source/models/supported-models.mdSource 2: TensorRT-LLM v1.2.1 · docs/source/legacy/reference/support-matrix.mdReviewed | 1.2.1This release | |
Features, dependencies and evidence for TensorRT-LLM 1.2.1 | ||||