gemma-4-E4B-it-FP8-dynamic

CheckpointRedHatAI/gemma-4-E4B-it-FP8-dynamicBroad indexModel card

Support summary

gemma-4-E4B-it-FP8-dynamic is a checkpoint. Official recipes or cookbooks cover vLLM, without pinning a stable release.

Documented quantization
FP8

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Model notes and sources

Engine support

3 engines

Engine support for gemma-4-E4B-it-FP8-dynamic
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLMVersion not pinnedRecipe / cookbookDocumented recipe

Official recipe

Source: vllm · models/Google/gemma-4-E4B-it.yamlReviewed
No supported release indexed
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks