Seed-OSS-36B-Instruct

CheckpointByteDance-Seed/Seed-OSS-36B-InstructBroad indexModel card

Support summary

Seed-OSS-36B-Instruct is a checkpoint built on the SeedOssForCausalLM architecture. vLLM 0.28.0, the newest indexed vLLM release, documents support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0.

Documented quantization
BF16
Documented features
Tensor parallelism and Tool calling

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Model notes and sources

Engine support

3 engines

Engine support for Seed-OSS-36B-Instruct
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedCheckpoint evidenceSource: vLLM v0.28.0 · docs/models/supported_models.mdReviewed 0.28.0This release
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks