paligemma-3b-mix-224

Checkpointgoogle/paligemma-3b-mix-224Model card indexedModel card

Support summary

paligemma-3b-mix-224 is a checkpoint published by Google, built on the PaliGemmaForConditionalGeneration architecture. vLLM 0.28.0, the newest indexed vLLM release, documents support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

License
gemma
Hugging Face model card
Publisher
Google
Task
image text to text
License
gemma
Library
transformers
Architecture
PaliGemmaForConditionalGeneration
Weight tensor elements
2.9B
Tensor types
F32
Weight access
Publisher approval or terms required
Repository created
2024-05-12
Source 1: google/paligemma-3b-mix-224 · publisher model cardSource 2: google/paligemma-3b-mix-224 · Hugging Face metadataReviewed
Model notes and sources

Engine support

3 engines

Engine support for paligemma-3b-mix-224
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1