Llama-4-Maverick-17B-128E-Instruct

Checkpointmeta-llama/Llama-4-Maverick-17B-128E-InstructModel card indexedModel card

Support summary

Llama-4-Maverick-17B-128E-Instruct is a checkpoint published by Meta, built on the Llama4ForConditionalGeneration architecture. vLLM 0.28.0, the newest indexed vLLM release, documents support. Official recipes or cookbooks cover SGLang, without pinning a stable release. TensorRT-LLM lists its architecture, but not this exact checkpoint.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

Documented features
Tensor parallelism
License
llama4

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Hugging Face model card
Publisher
Meta
Task
image text to text
License
llama4
Library
transformers
Architecture
Llama4ForConditionalGeneration
Weight tensor elements
401.6B
Tensor types
BF16
Languages
ar, de, en, es, fr, hi, id, it, pt, th, tl, vi
Base models
meta-llama/Llama-4-Maverick-17B-128E
Weight access
Publisher approval or terms required
Repository created
2025-04-01
Source 1: meta-llama/Llama-4-Maverick-17B-128E-Instruct · publisher model cardSource 2: meta-llama/Llama-4-Maverick-17B-128E-Instruct · Hugging Face metadataReviewed
Model notes and sources

Engine support

3 engines

Engine support for Llama-4-Maverick-17B-128E-Instruct
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLangVersion not pinnedRecipe / cookbookDocumented recipe

Official recipe

Source 1: sglang · docs/cookbook/autoregressive/Meta/Llama4.mdxSource 2: sglang · docs/src/snippets/autoregressive/llama4-scout-deployment.jsxSource 3: sglang · docs/src/snippets/autoregressive/llama4-maverick-deployment.jsxReviewed
No supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedArchitecture listed; exact checkpoint unknownNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks