MiniCPM-Llama3-V-2_5

Checkpointopenbmb/MiniCPM-Llama3-V-2_5Model card indexedModel card

Support summary

MiniCPM-Llama3-V-2_5 is a checkpoint published by OpenBMB, built on the MiniCPMV architecture. vLLM 0.28.0, the newest indexed vLLM release, documents support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

Configured context
8,192 tokens
Hugging Face model card
Publisher
OpenBMB
Task
image text to text
Library
transformers
Architecture
MiniCPMV
Weight tensor elements
8.5B
Tensor types
F16
Configured context
8,192 tokens
Languages
multilingual
Weight access
Public
Repository created
2024-05-19
Source 1: openbmb/MiniCPM-Llama3-V-2_5 · publisher model cardSource 2: openbmb/MiniCPM-Llama3-V-2_5 · Hugging Face metadataSource 3: openbmb/MiniCPM-Llama3-V-2_5 · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for MiniCPM-Llama3-V-2_5
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1