gemma-4-E4B-it-qat-mobile-ct

Checkpointgoogle/gemma-4-E4B-it-qat-mobile-ctModel card indexedModel card

Support summary

gemma-4-E4B-it-qat-mobile-ct is a checkpoint published by Google, built on the Gemma4ForConditionalGeneration architecture. Official recipes or cookbooks cover vLLM, without pinning a stable release.

Documented quantization
int2/4/8
Configured context
131,072 tokens
License
apache-2.0

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Hugging Face model card
Publisher
Google
Task
any to any
License
apache-2.0
Library
transformers
Architecture
Gemma4ForConditionalGeneration
Weight tensor elements
8.7B
Tensor types
I64, F32, I32, BF16, I8
Quantization
compressed-tensors · pack-quantized
Configured context
131,072 tokens
Base models
google/gemma-4-E4B-it-qat-mobile-transformers
Weight access
Public
Repository created
2026-06-01
Source 1: google/gemma-4-E4B-it-qat-mobile-ct · publisher model cardSource 2: google/gemma-4-E4B-it-qat-mobile-ct · Hugging Face metadataSource 3: google/gemma-4-E4B-it-qat-mobile-ct · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for gemma-4-E4B-it-qat-mobile-ct
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLMVersion not pinnedRecipe / cookbookDocumented recipe

Official recipe

Source: vllm · models/Google/gemma-4-E4B-it.yamlReviewed
No supported release indexed
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks