internlm-7b

Checkpointinternlm/internlm-7bModel card indexedModel card

Support summary

internlm-7b is a checkpoint published by InternLM, built on the InternLMForCausalLM architecture. vLLM last documented support in 0.23.0; its newest indexed release does not list it.

vLLM documents support in 13 of 20 indexed releases, from 0.17.0 to 0.23.0.

Configured context
2,048 tokens
Hugging Face model card
Publisher
InternLM
Task
text generation
Library
transformers
Architecture
InternLMForCausalLM
Configured context
2,048 tokens
Weight access
Public
Repository created
2023-07-06
Source 1: internlm/internlm-7b · publisher model cardSource 2: internlm/internlm-7b · Hugging Face metadataSource 3: internlm/internlm-7b · publisher configurationReviewed
Model notes and sources

Engine support

3 engines

Engine support for internlm-7b
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedNo matching evidence curatedView 0.23.0 · checkpoint evidenceSource: vLLM v0.23.0 · docs/models/supported_models.mdReviewed
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1