Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

36

Base only

Active filters: distil-labs

distil-labs/distil-gemma3-270m-SHELLper

Text Generation • 0.3B • Updated Feb 17 • 67 • 5

distil-labs/Distil-PII-Llama-3.2-1B-Instruct

Text Generation • 1B • Updated Dec 21, 2025 • 42 • 6

distil-labs/Distil-PII-Llama-3.2-1B-Instruct-gguf

Text Generation • 1B • Updated Dec 21, 2025 • 14 • 1

distil-labs/Distil-PII-Llama-3.2-3B-Instruct

Text Generation • 3B • Updated Dec 21, 2025 • 25 • 3

distil-labs/Distil-PII-Llama-3.2-3B-Instruct-gguf

Text Generation • 3B • Updated Dec 21, 2025 • 12 • 2

distil-labs/Distil-PII-gemma-3-270m-it

Text Generation • 0.3B • Updated Dec 21, 2025 • 28 • 2

distil-labs/Distil-PII-gemma-3-270m-it-gguf

Text Generation • 0.3B • Updated Dec 21, 2025 • 8 • 3

distil-labs/Distil-PII-SmolLM2-135M-Instruct

Text Generation • 0.1B • Updated Oct 13, 2025 • 11 • 1

distil-labs/Distil-PII-SmolLM2-135M-Instruct-gguf

Text Generation • 0.1B • Updated Dec 21, 2025 • 17

mradermacher/Distil-PII-SmolLM2-135M-Instruct-GGUF

0.1B • Updated Oct 15, 2025 • 106

mradermacher/Distil-PII-Llama-3.2-3B-Instruct-GGUF

3B • Updated Oct 15, 2025 • 202

mradermacher/Distil-PII-gemma-3-270m-it-GGUF

0.3B • Updated Oct 15, 2025 • 150

mradermacher/Distil-PII-Llama-3.2-1B-Instruct-GGUF

1B • Updated Oct 15, 2025 • 241 • 1

distil-labs/Distil-NPC-gemma-3-270m

Text Generation • 0.3B • Updated Dec 21, 2025 • 12 • 4

distil-labs/Distil-NPC-gemma-3-1b-it

Text Generation • 1.0B • Updated Dec 21, 2025 • 17 • 5

Otilde/Distil-PII-Llama-3.2-3B-Instruct-mxfp4-MLX

Text Generation • 3B • Updated Oct 25, 2025 • 10

Novaciano/Distil-NPC-gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated Oct 30, 2025 • 7 • 1

Novaciano/Distil-NPC-gemma-3-1b-it-iMatrix-GGUF

Text Generation • 1.0B • Updated Oct 30, 2025 • 19

distil-labs/distil-qwen3-0.6b-voice-assistant-banking

Text Generation • 0.6B • Updated Feb 14 • 15 • 2

distil-labs/distil-qwen3-0.6b-voice-assistant-banking-gguf

Text Generation • 0.6B • Updated Feb 14 • 7

distil-labs/distil-home-assistant-qwen3

Text Generation • 0.6B • Updated Feb 14 • 17 • 2

distil-labs/distil-home-assistant-qwen3-gguf

Text Generation • 0.6B • Updated Feb 14 • 46

distil-labs/distil-home-assistant-functiongemma

Text Generation • 0.3B • Updated Feb 15 • 736 • 23

distil-labs/distil-home-assistant-functiongemma-gguf

Text Generation • 0.3B • Updated Feb 15 • 37 • 1

megabytes/distil-home-assistant-functiongemma-GGUF

Text Generation • 0.3B • Updated Feb 21 • 22

distil-labs/distil-lfm25-shellper

Text Generation • 0.4B • Updated Mar 30 • 45 • 11

distil-labs/distil-lfm25-home-assistant

Text Generation • 0.4B • Updated Mar 30 • 20 • 2

distil-labs/distil-lfm25-voice-assistant

Text Generation • 0.4B • Updated Mar 30 • 32 • 1

distil-labs/distil-qwen3-1.7b-customer-support-deferral

Text Generation • 2B • Updated Jun 15 • 19

distil-labs/distil-qwen3-1.7b-customer-support-deferral-gguf

Text Generation • 2B • Updated Jun 15 • 18