Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,463

Base only

Active filters: granite

royleibov/granite-3b-code-base-128k-ZipNN-Compressed

Text Generation • Updated Oct 3, 2024 • 20 • 2

ibm-granite/granite-3.0-2b-base

Text Generation • 3B • Updated Dec 19, 2024 • 2.12k • 25

ibm-granite/granite-3.0-2b-instruct

Text Generation • 3B • Updated Dec 19, 2024 • 8.11k • 48

ibm-granite/granite-guardian-3.0-8b

Text Generation • 8B • Updated Jan 3, 2025 • 522 • 40

ibm-granite/granite-guardian-3.0-2b

Text Generation • 3B • Updated Jan 3, 2025 • 3.64k • 22

onnx-community/granite-3.0-2b-instruct

Text Generation • Updated Mar 6, 2025 • 41 • 1

royleibov/granite-3.0-8b-instruct-ZipNN-Compressed

Text Generation • Updated Oct 22, 2024 • 23

takumar24/granite-3.0-8b-instruct-gptq

8B • Updated Oct 23, 2024 • 4

tjake/granite-3.0-2b-instruct-JQ4

Text Generation • 3B • Updated Oct 27, 2024 • 19

pingel/granite-3.0-2b-instruct-pirate

Text Generation • 3B • Updated Oct 28, 2024 • 11

tensorblock/granite-8b-code-instruct-4k-GGUF

Text Generation • 8B • Updated Jan 27 • 138

atrokhym/granite-3.0-2b-instruct-pirate

Text Generation • 3B • Updated Nov 7, 2024 • 6

tensorblock/granite-7b-lab-GGUF

Text Generation • 7B • Updated Jan 27 • 81

tensorblock/granite-7b-instruct-GGUF

Text Generation • 7B • Updated Jan 27 • 101

tensorblock/granite-8b-code-base-4k-GGUF

Text Generation • 8B • Updated Jan 27 • 23

tensorblock/granite-20b-code-base-8k-GGUF

Text Generation • 20B • Updated Jan 27 • 100 • 1

tensorblock/granite-3b-code-instruct-2k-GGUF

Text Generation • 3B • Updated Jan 27 • 87

tensorblock/granite-3b-code-base-2k-GGUF

Text Generation • 3B • Updated Jan 27 • 63

Dshimen/slay_model-2b

3B • Updated Nov 11, 2024 • 3

NewGoldDream/granite-3.0-2b-instruct-ft-2

3B • Updated Nov 11, 2024 • 3

Qiskit/granite-8b-qiskit

Text Generation • 8B • Updated Dec 11, 2024 • 89 • 11

Qiskit/granite-8b-qiskit-GGUF

Text Generation • 8B • Updated Nov 3, 2025 • 27 • 5

tensorblock/granite-34b-code-instruct-8k-GGUF

Text Generation • 34B • Updated Jan 27 • 92

rh-rad-ai-roadshow/granite-3-parasol-instruct

8B • Updated Nov 13, 2024 • 3

rh-rad-ai-roadshow/parasol-chat

8B • Updated Nov 13, 2024 • 3

tensorblock/granite-8b-code-instruct-128k-GGUF

Text Generation • 8B • Updated Jan 27 • 120 • 2

tensorblock/granite-34b-code-base-8k-GGUF

Text Generation • 34B • Updated Jan 27 • 59

tensorblock/granite-3b-code-instruct-128k-GGUF

Text Generation • 3B • Updated Jan 27 • 32

RichardErkhov/ibm-granite_-_granite-3.0-2b-instruct-4bits

3B • Updated Nov 19, 2024 • 2

RichardErkhov/ibm-granite_-_granite-3.0-2b-instruct-8bits

3B • Updated Nov 19, 2024 • 3