persimmon-8b-chat
Support summary
persimmon-8b-chat is a checkpoint built on the PersimmonForCausalLM architecture. SGLang 0.5.19, the newest indexed SGLang release, documents support. vLLM last documented support in 0.25.1; its newest indexed release does not list it.
vLLM documents support in 16 of 20 indexed releases, from 0.17.0 to 0.25.1. SGLang documents support in 13 of 13 indexed releases, from 0.5.10 to 0.5.19.
Model notes and sources
- SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdx · 3 indexed revisions, v0.5.17 to v0.5.19
- vLLM v0.25.1 · docs/models/supported_models.md · 16 indexed revisions, v0.17.0 to v0.25.1
- SGLang v0.5.16 · docs_new/docs/supported-models/generative_models.mdx · 8 indexed revisions, v0.5.11 to v0.5.16
- SGLang v0.5.15.post1 · docs/supported_models/text_generation/generative_models.md · 9 indexed revisions, v0.5.10 to v0.5.15.post1
- Reviewed
Engine support
3 engines
| Engine | Release | Checkpoint support | Evidence scope | Last known supported |
|---|---|---|---|---|
| vLLM | 0.28.0Newest indexed | No matching evidence curated | View 0.25.1 · checkpoint evidenceSource: vLLM v0.25.1 · docs/models/supported_models.mdReviewed | |
Features, dependencies and evidence for vLLM 0.28.0 | ||||
| SGLang | 0.5.19Newest indexed | Checkpoint evidenceSource: SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdxReviewed | 0.5.19This release | |
Features, dependencies and evidence for SGLang 0.5.19 | ||||
| TensorRT-LLM | 1.2.1Newest indexed | No matching evidence curated | No supported release indexed | |
Features, dependencies and evidence for TensorRT-LLM 1.2.1 | ||||