aya-vision-8b

CheckpointCohereLabs/aya-vision-8bModel card indexedModel card

Support summary

aya-vision-8b is a checkpoint published by Cohere, built on the AyaVisionForConditionalGeneration architecture. vLLM last documented support in 0.24.0; its newest indexed release does not list it.

vLLM documents support in 14 of 20 indexed releases, from 0.17.0 to 0.24.0.

License
cc-by-nc-4.0
Hugging Face model card
Publisher
Cohere
Task
image text to text
License
cc-by-nc-4.0
Library
transformers
Architecture
AyaVisionForConditionalGeneration
Weight tensor elements
8.6B
Tensor types
F16
Languages
en, fr, de, es, it, pt, ja, ko, zh, ar, el, fa, pl, id, cs, he, hi, nl, ro, ru, tr, uk, vi
Weight access
Publisher approval or terms required
Repository created
2025-03-02
Source 1: CohereLabs/aya-vision-8b · publisher model cardSource 2: CohereLabs/aya-vision-8b · Hugging Face metadataReviewed
Model notes and sources

Engine support

3 engines

Engine support for aya-vision-8b
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedNo matching evidence curatedView 0.24.0 · checkpoint evidenceSource: vLLM v0.24.0 · docs/models/supported_models.mdReviewed
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1