Inference EngineeringAcademy
HomeFoundations Free
Courses
Pricing
Resources
JobsCoding practiceStart learning

granite-4.1-3b-GGUF

Checkpointibm-granite/granite-4.1-3b-GGUFModel card indexedModel card

Support summary

granite-4.1-3b-GGUF is a checkpoint published by IBM. No indexed engine release, recipe, or architecture listing documents support yet. That does not mean the model is incompatible.

License
apache-2.0
Hugging Face model card
Publisher
IBM
Task
text generation
License
apache-2.0
Library
transformers
Base models
ibm-granite/granite-4.1-3b
Weight access
Public
Repository created
2026-04-16
Source 1: ibm-granite/granite-4.1-3b-GGUF · publisher model cardSource 2: ibm-granite/granite-4.1-3b-GGUF · Hugging Face metadataReviewed
Model notes and sources

Engine support

3 engines

Engine support for granite-4.1-3b-GGUF
EngineReleaseCheckpoint supportEvidence scopeLast known supported
vLLM0.28.0Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for vLLM 0.28.0
SGLang0.5.19Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for SGLang 0.5.19
TensorRT-LLM1.2.1Newest indexedNo matching evidence curatedNo supported release indexed
Features, dependencies and evidence for TensorRT-LLM 1.2.1