AI21-Jamba-1.5-Large
Support summary
AI21-Jamba-1.5-Large is a checkpoint published by AI21 Labs, built on the JambaForCausalLM architecture. vLLM 0.28.0, the newest indexed vLLM release, documents support.
vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.
- License
- jamba-open-model-license
Hugging Face model card
- Publisher
- AI21 Labs
- Task
- text generation
- License
- jamba-open-model-license
- Architecture
- JambaForCausalLM
- Weight tensor elements
- 398.6B
- Tensor types
- BF16
- Languages
- en, fr, de, nl, es, pt, it, ar, he
- Weight access
- Publisher approval or terms required
- Repository created
- 2024-08-19
Model notes and sources
- vLLM v0.28.0 · docs/models/supported_models.md · 20 indexed revisions, v0.17.0 to v0.28.0
- ai21labs/AI21-Jamba-Large-1.5 · publisher model card
- ai21labs/AI21-Jamba-Large-1.5 · Hugging Face metadata
- Reviewed
Engine support
3 engines
| Engine | Release | Checkpoint support | Evidence scope | Last known supported |
|---|---|---|---|---|
| vLLM | 0.28.0Newest indexed | Checkpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed | 0.28.0This release | |
Features, dependencies and evidence for vLLM 0.28.0 | ||||
| SGLang | 0.5.19Newest indexed | No matching evidence curated | No supported release indexed | |
Features, dependencies and evidence for SGLang 0.5.19 | ||||
| TensorRT-LLM | 1.2.1Newest indexed | No matching evidence curated | No supported release indexed | |
Features, dependencies and evidence for TensorRT-LLM 1.2.1 | ||||