granite-4.2-8b
Support summary
granite-4.2-8b is a checkpoint published by IBM, built on the GraniteForCausalLM architecture. Official recipes or cookbooks cover SGLang, without pinning a stable release. vLLM lists its architecture, but not this exact checkpoint.
- Documented hardware
- NVIDIA / CUDA
- Documented quantization
- BF16
- Documented features
- Reasoning parsers and Tool calling
- Configured context
- 131,072 tokens
- License
- apache-2.0
Hardware, quantization and features count only statements about this checkpoint; engine-wide capabilities are listed with each release.
Hugging Face model card
- Publisher
- IBM
- Task
- text generation
- License
- apache-2.0
- Library
- transformers
- Architecture
- GraniteForCausalLM
- Weight tensor elements
- 8.8B
- Tensor types
- BF16
- Configured context
- 131,072 tokens
- Languages
- en, de, es, fr, ja, pt, ar, cs, it, ko, nl, zh
- Base models
- ibm-granite/granite-4.1-8b-base
- Weight access
- Public
- Repository created
- 2026-08-07
Publisher deployment guidance
- SGLang>=0.5.18
Publisher serving guidance; use the documented reasoning and tool parsers.
Source: ibm-granite/granite-4.2-8b · publisher model cardReviewed - vLLMVersion unspecified
The publisher gives a serving command. Its custom granite_thinking_parser specifically requires vLLM 0.20+; this is a parser requirement, not a general model-support floor.
Source: ibm-granite/granite-4.2-8b · publisher model cardReviewed
Model notes and sources
Engine support
3 engines
| Engine | Release | Checkpoint support | Evidence scope | Last known supported |
|---|---|---|---|---|
| vLLM | 0.28.0Newest indexed | Architecture listed; exact checkpoint unknown | No supported release indexed | |
Features, dependencies and evidence for vLLM 0.28.0 | ||||
| SGLang | Version not pinnedRecipe / cookbook | Documented recipeSource 1: sglang · docs/cookbook/autoregressive/IBM/Granite-4.2.mdxSource 2: sglang · docs/src/snippets/_deployment.jsxSource 3: sglang · docs/src/snippets/configs/ibm-granite/granite-4.2.jsxSource 4: sglang · docs/src/snippets/configs/ibm-granite/granite-4.2-benchmarks.jsxSource 5: sglang · docs/src/snippets/_playground.jsxReviewed | No supported release indexed | |
Features, dependencies and evidence for SGLang 0.5.19 | ||||
| TensorRT-LLM | 1.2.1Newest indexed | No matching evidence curated | No supported release indexed | |
Features, dependencies and evidence for TensorRT-LLM 1.2.1 | ||||