Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,459

Base only

Active filters: granite

mradermacher/granite-3b-code-base-2k-GGUF

3B • Updated Sep 3, 2024 • 812

mradermacher/granite-3b-code-instruct-2k-GGUF

3B • Updated Sep 4, 2024 • 1.32k

mradermacher/granite-3b-code-base-2k-i1-GGUF

3B • Updated Sep 3, 2024 • 1.87k

mradermacher/granite-8b-code-base-128k-GGUF

8B • Updated Sep 3, 2024 • 1.4k

mradermacher/granite-8b-code-base-128k-i1-GGUF

8B • Updated Sep 4, 2024 • 2.74k • 1

mradermacher/granite-8b-code-base-4k-GGUF

8B • Updated Sep 4, 2024 • 584

mradermacher/granite-8b-code-instruct-4k-GGUF

8B • Updated Feb 3, 2025 • 1.19k

mradermacher/granite-20b-code-base-8k-GGUF

20B • Updated Sep 4, 2024 • 1.22k

mradermacher/granite-20b-code-instruct-8k-GGUF

20B • Updated Sep 3, 2024 • 1.11k

mradermacher/granite-20b-code-instruct-8k-i1-GGUF

20B • Updated Sep 6, 2024 • 2.25k

mradermacher/granite-34b-code-base-8k-GGUF

34B • Updated Sep 4, 2024 • 1.02k

mradermacher/granite-3b-code-base-128k-i1-GGUF

3B • Updated Sep 4, 2024 • 1.26k

mradermacher/granite-8b-code-instruct-4k-i1-GGUF

8B • Updated Sep 4, 2024 • 1.24k • 1

mradermacher/granite-3b-code-instruct-2k-i1-GGUF

3B • Updated Sep 4, 2024 • 2.03k

mradermacher/granite-20b-code-base-8k-i1-GGUF

20B • Updated Sep 4, 2024 • 1.17k

mradermacher/granite-8b-code-base-4k-i1-GGUF

8B • Updated Sep 5, 2024 • 824

mradermacher/granite-34b-code-base-8k-i1-GGUF

34B • Updated Sep 4, 2024 • 1.7k

QuantFactory/granite-7b-instruct-GGUF

Text Generation • 7B • Updated Sep 5, 2024 • 666 • 2

royleibov/granite-7b-instruct-ZipNN-Compressed

Text Generation • Updated Sep 15, 2024 • 12 • 2

QuantFactory/granite-3b-code-base-2k-GGUF

Text Generation • 3B • Updated Sep 7, 2024 • 550 • 2

QuantFactory/granite-3b-code-base-128k-GGUF

Text Generation • 3B • Updated Sep 7, 2024 • 546 • 2

QuantFactory/granite-8b-code-instruct-128k-GGUF

Text Generation • 8B • Updated Sep 7, 2024 • 251 • 3

QuantFactory/granite-8b-code-instruct-4k-GGUF

Text Generation • 8B • Updated Sep 7, 2024 • 584 • 2

mradermacher/granite-34b-code-instruct-8k-GGUF

34B • Updated Sep 9, 2024 • 401 • 1

mradermacher/granite-34b-code-instruct-8k-i1-GGUF

34B • Updated Sep 9, 2024 • 258

ethangoh/granite-7b-instruct-Q4_K_M-GGUF

Text Generation • 7B • Updated Sep 17, 2024 • 11

rh-rad-ai-roadshow/parasol-instruct

8B • Updated Nov 13, 2024 • 2

royleibov/granite-3b-code-base-128k-ZipNN-Compressed

Text Generation • Updated Oct 3, 2024 • 18 • 2

ibm-granite/granite-3.0-2b-base

Text Generation • 3B • Updated Dec 19, 2024 • 2.01k • 25

ibm-granite/granite-3.0-2b-instruct

Text Generation • 3B • Updated Dec 19, 2024 • 8.39k • 48