Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

95

Base only

Active filters: lmstudio

sangwon1472/Gemma-MLX-Studio

8B • Updated Apr 12 • 28

xlr8harder/aria-gemma4-31b-v1-GGUF

Text Generation • 31B • Updated Apr 15 • 54 • 1

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 3.41k • 31

Goro64/qwen2.5-coder-14b-instruct-ai-workshop-poc-gguf

Text Generation • 15B • Updated Apr 18 • 128

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 20 • 1.14k • 32

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-Q5_K_M-GGUF

Text Generation • 35B • Updated Apr 23 • 732 • 17

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-Q8_0-GGUF

Text Generation • 35B • Updated Apr 23 • 705 • 8

lordx64/Qwen3.6-35B-A3B-Kimi-K2.6-Reasoning-Distilled-GGUF

Text Generation • 35B • Updated Apr 26 • 3.81k • 7

PJRM/Nomi-1-Creative-Q4_0-GGUF

Text Generation • 3B • Updated Apr 27 • 5

kasimat/Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 27B • Updated May 5 • 16.3k • 1

apol/gemma4-e2b-social-spain-v12-q4-k-m-gguf-public

Text Generation • 5B • Updated May 5 • 18

KartoffelToby/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-Q8_0-GGUF

Text Generation • 35B • Updated May 6 • 16

HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-12B-A2B-GGUF

Text Generation • 12B • Updated Jul 4 • 360 • 2

muralcode/How-To-Use-Reasoning-Thinking-Models-and-Create-Them

Text Generation • Updated May 14

jmarianodc/health_food_demo

Text Generation • 1B • Updated May 22 • 43

RemySkye/rwkv7-g1g-7.2b-GGUF

Text Generation • 7B • Updated May 24 • 62 • 1

v102ss/Alice-Qwen3-4B-Instruct-2507-Heretic-Light-GGUF

Text Generation • 4B • Updated May 23 • 92

RemySkye/rwkv7-g1g-13.3b-GGUF

Text Generation • 13B • Updated May 24 • 221 • 1

RemySkye/rwkv7-g1g-7.2b-i1-GGUF

Text Generation • 7B • Updated May 24 • 252

RemySkye/rwkv7-g1g-13.3b-i1-GGUF

Text Generation • 13B • Updated May 24 • 74

wazimondo/Qwen3.6-27B-AEON-Ultimate-Uncensored_2-GGUF

Text Generation • 27B • Updated May 26 • 114

alwaysgood/qwen35_sft_023_dpo-GGUF

Image-Text-to-Text • 4B • Updated Jun 3 • 28

alwaysgood/TranslateQwen_v1-GGUF

Image-Text-to-Text • 4B • Updated Jun 3 • 24

alwaysgood/TranslateQwen_v2-GGUF

Image-Text-to-Text • 4B • Updated Jun 3 • 62

ledgergap/Pollux-4B-Judge-GGUF

Text Generation • 4B • Updated Jun 8 • 26

Noah-H309/Qwen3-0.6B-BF16

0.8B • Updated Jun 11 • 74

lordx64/Qwable-v2-GGUF

Text Generation • 35B • Updated Jun 27 • 4.21k • 8

pankajpandey-dev/qwen3.5-9b-hindi-instruct-GGUF

Text Generation • 9B • Updated Jul 4 • 4.74k • 1

alexokita/mistral-nemo-style-step2000-GGUF

Text Generation • 12B • Updated Jul 12 • 18

wazimondo/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters