Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

350

Base only

Active filters: quark

amd/Qwen3.8-27B-Quark-AWQ-INT4-W4A16

Image-Text-to-Text • 6B • Updated 2 days ago • 87k • 13

amd/Qwen3.8-27B-Quark-AWQ-MXFP4

Image-Text-to-Text • 16B • Updated 5 days ago • 4.07k • 7

magiccodingman/Qwen3.8-27B-MXFP4-MagicQuant-GGUF

Image-Text-to-Text • 27B • Updated 4 days ago • 3.02k • 3

amd/gpt-oss-120b-w-mxfp4-a-fp8

59B • Updated Jun 4 • 13.7k • 10

nameistoken/Gemma-4-31B-it-Quark-W8A8-INT8

Image-Text-to-Text • 31B • Updated Apr 23 • 2.01k • 7

amd/DeepSeek-V4-Flash-MXFP4

Text Generation • 158B • Updated Jul 24 • 1.3k • 1

amd/DeepSeek-V4-Pro-NVFP4

Text Generation • 812B • Updated 5 days ago • 259 • 2

OneNexus/GLM-5.3-MXFP4

Text Generation • 390B • Updated about 9 hours ago • 256 • 1

just1moremodel/Qwen3.8-27B-Uncensored-MXFP4-awq

Text Generation • 16B • Updated about 10 hours ago • 20 • 1

fxmarty/llama-tiny-testing-quark-indev

1.03M • Updated Oct 3, 2024 • 8

fxmarty/llama-tiny-int4-per-group-sym

1.03M • Updated Oct 25, 2024 • 9

fxmarty/llama-tiny-w-fp8-a-fp8

1.03M • Updated Oct 22, 2024 • 7

fxmarty/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Oct 22, 2024 • 8

fxmarty/llama-tiny-w-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 11

fxmarty/llama-small-int4-per-group-sym-awq

16.7M • Updated Oct 29, 2024 • 17

fxmarty/quark-legacy-int8

1.03M • Updated Oct 10, 2024 • 10

fxmarty/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Oct 22, 2024 • 6

fxmarty/llama-small-int4-per-group-sym-awq-old

16.7M • Updated Oct 25, 2024 • 8

amd-quark/llama-tiny-w-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 16

amd-quark/llama-tiny-w-int8-b-int8-per-tensor

1.03M • Updated Dec 18, 2024 • 16

amd-quark/llama-tiny-w-fp8-a-fp8

1.03M • Updated Dec 18, 2024 • 13

amd-quark/llama-tiny-w-fp8-a-fp8-o-fp8

1.03M • Updated Dec 18, 2024 • 13

amd-quark/llama-tiny-int4-per-group-sym

1.03M • Updated Dec 18, 2024 • 10

amd-quark/llama-small-int4-per-group-sym-awq

16.7M • Updated Dec 18, 2024 • 16

amd-quark/quark-legacy-int8

1.03M • Updated Dec 18, 2024 • 8

amd/Llama-3.1-8B-Instruct-FP8-KV-Quark-test

8B • Updated Jun 18 • 8.16k

amd/Llama-3.1-8B-Instruct-w-int8-a-int8-sym-test

8B • Updated Jun 18 • 5.13k

EmbeddedLLM/Llama-3.1-8B-Instruct-w_fp8_per_channel_sym

Text Generation • 8B • Updated Jan 22, 2025 • 18

amd/DeepSeek-R1-Distill-Llama-8B-awq-asym-uint4-g128-lmhead

Text Generation • 2B • Updated Jan 30, 2025 • 20

amd-quark/llama-tiny-fp8-quark-quant-method

17.1M • Updated Feb 7, 2025 • 5.05k