Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

676

Base only

Active filters: AWQ

ticoAg/Qwen3-VL-30B-A3B-Instruct-AWQ

Text Generation • 31B • Updated Oct 16, 2025 • 16 • 1

QuantTrio/Qwen3-VL-32B-Instruct-AWQ

Image-Text-to-Text • 33B • Updated Oct 22, 2025 • 188k • 12

QuantTrio/Qwen3-VL-32B-Thinking-AWQ

Image-Text-to-Text • 33B • Updated Dec 3, 2025 • 544 • 7

QuantTrio/MiniMax-M2-AWQ

Text Generation • 229B • Updated Dec 3, 2025 • 1.64k • 10

a2s-ai/MiniMax-M2-AWQ

Text Generation • 229B • Updated Dec 3, 2025 • 21

ELVISIO/SenseNova-SI-InternVL3-8B-AWQ

1B • Updated Nov 13, 2025 • 6

ogulcanakca/Kumru-2B-EPDK-Instruct-AWQ-4bit

Text Generation • 2B • Updated Nov 19, 2025 • 14

QuantTrio/MiniMax-M2-REAP-162B-A10B-AWQ

Text Generation • 162B • Updated Jan 5 • 20 • 3

remodlai/Qwen3-VL-30B-A3B-Instruct-AWQ

Text Generation • 31B • Updated Nov 22, 2025 • 17

QuantTrio/DeepSeek-V3.2-AWQ

Text Generation • 685B • Updated Dec 3, 2025 • 254 • 11

QuantTrio/DeepSeek-V3.2-Speciale-AWQ

Text Generation • 685B • Updated Dec 29, 2025 • 28 • 4

QuantTrio/GLM-4.7-AWQ

Text Generation • 358B • Updated May 18 • 1.01k • 28

QuantTrio/MiniMax-M2.1-AWQ

Text Generation • 229B • Updated Dec 30, 2025 • 40 • 10

a2s-ai/MiniMax-M2.1-AWQ

Text Generation • 229B • Updated Jan 1 • 19

QuantTrio/GLM-4.7-Flash-AWQ

Text Generation • 31B • Updated Jan 21 • 145k • 12

QuantTrio/Step3-VL-10B-AWQ

Image-Text-to-Text • 10B • Updated Feb 2 • 190 • 5

QuantTrio/MiniMax-M2.5-AWQ

Text Generation • 229B • Updated Feb 16 • 624 • 15

a2s-ai/MiniMax-M2.5-AWQ

Text Generation • 229B • Updated Feb 27 • 15

QuantTrio/Qwen3.5-35B-A3B-AWQ

Image-Text-to-Text • 36B • Updated Feb 26 • 30.7k • 18

QuantTrio/Qwen3.5-122B-A10B-AWQ

Image-Text-to-Text • 125B • Updated Feb 26 • 5.55k • 29

QuantTrio/Qwen3.5-397B-A17B-AWQ

Image-Text-to-Text • Updated Mar 2 • 5.48k • 9

QuantTrio/Qwen3.5-27B-AWQ

Image-Text-to-Text • 28B • Updated Mar 2 • 287k • 44

QuantTrio/GLM-5-AWQ

Text Generation • 754B • Updated Feb 28 • 183 • 6

QuantTrio/Qwen3.5-9B-AWQ

Image-Text-to-Text • 10B • Updated Mar 4 • 1.23M • 26

QuantTrio/Qwen3.5-4B-AWQ

Image-Text-to-Text • 5B • Updated Mar 4 • 235k • 9

CYF200127/Qwen3-VL-32B-Instruct-AWQ

Image-Text-to-Text • 33B • Updated Mar 10 • 11

xxxSHADOWxxx/Qwen3-VL-30B-A3B-Instruct-AWQ

Text Generation • 31B • Updated Mar 20 • 28

ThomasYn/GenomeOcean-100M-v1.2-AWQ

0.1B • Updated Mar 22 • 4

ThomasYn/GenomeOcean-500M-v1.2-AWQ

0.5B • Updated Mar 22 • 4

Explyt/GLM-5-AWQ

Text Generation • 754B • Updated Mar 26 • 13