gpt-oss-120b

Checkpointopenai/gpt-oss-120bDetailed entryModel card

Support summary

gpt-oss-120b is a checkpoint published by OpenAI, built on the GptOssForCausalLM architecture. The newest indexed releases vLLM 0.28.0, SGLang 0.5.19, and TensorRT-LLM 1.2.1 all document support.

vLLM documents support in 20 of 20 indexed releases, from 0.17.0 to 0.28.0. SGLang documents support in 13 of 13 indexed releases, from 0.5.10 to 0.5.19. TensorRT-LLM documents support in 2 of 2 indexed releases, from 1.2.0 to 1.2.1.

Documented hardware
NVIDIA / CUDA, AMD / ROCm, and Intel GPU / XPU
Documented quantization
MXFP4
Documented features
Reasoning parsers and Tensor parallelism
Configured context
131,072 tokens
License
apache-2.0

Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.

Hugging Face model card
Publisher
OpenAI
Task
text generation
License
apache-2.0
Library
transformers
Architecture
GptOssForCausalLM
Weight tensor elements
116.8B
Tensor types
BF16, U8
Quantization
mxfp4
Configured context
131,072 tokens
Weight access
Public
Repository created
2025-08-04
Source 1: openai/gpt-oss-120b · publisher model cardSource 2: openai/gpt-oss-120b · Hugging Face metadataSource 3: openai/gpt-oss-120b · publisher configurationReviewed
Model notes and sources

TensorRT-LLM’s two-engine EAGLE-3 path has an overlap-scheduler restriction.

Engine support

3 engines

Engine support for gpt-oss-120b
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLMVersion not pinnedRecipe / cookbookDocumented recipe

Official recipe

Source: vllm · models/openai/gpt-oss-120b.yamlReviewed
View 0.28.0
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedCheckpoint evidenceSource: SGLang v0.5.19 · docs/docs/supported-models/generative_models.mdxReviewed 0.5.19This release
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedCheckpoint evidenceSource: TensorRT-LLM v1.2.1 · docs/source/models/supported-models.mdReviewed 1.2.1This release
Features, dependencies and evidence for TensorRT-LLM 1.2.1

Recipes and cookbooks