AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4
Image-Text-to-Text • 21B • Updated • 219k • 60
Edit Models filters
Model Tree
Apps
Inference Providers
Models
458
Active filters: llmcompressor
ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g
Image-Text-to-Text • 28B • Updated • 143k • 45
AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4
Text Generation • 15B • Updated • 75.6k • 22
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4
Text Generation • 19B • Updated • 115k • 83
Alennnndy/Qwen3.6-27B-AWQ-4bit
Text Generation • 28B • Updated • 1.35k • 2
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation • 8B • Updated • 76.6k • 9
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 34k • 20
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
Text Generation • 8B • Updated • 72.4k • 30
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation • 1B • Updated • 43.9k • 8
RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation • 4B • Updated • 3.85k • 1
RedHatAI/Llama-3.2-1B-Instruct-FP8
Text Generation • 1B • Updated • 863k • 4
RedHatAI/Llama-3.2-3B-Instruct-FP8
Text Generation • 4B • Updated • 1.77k • 6
RedHatAI/Qwen2.5-0.5B-quantized.w8a8
Text Generation • 0.6B • Updated • 488
RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8
Text Generation • 0.6B • Updated • 50
RedHatAI/Qwen2.5-1.5B-quantized.w8a8
Text Generation • 2B • Updated • 1.03M • 4
RedHatAI/Qwen2.5-7B-quantized.w8a8
Text Generation • 8B • Updated • 12 • 1
RedHatAI/Qwen2.5-72B-quantized.w8a8
Text Generation • 73B • Updated • 6
RedHatAI/Qwen2.5-7B-quantized.w4a16
Text Generation • 8B • Updated • 22
RedHatAI/Qwen2.5-0.5B-FP8-dynamic
Text Generation • 0.6B • Updated • 147
RedHatAI/Qwen2.5-1.5B-FP8-dynamic
Text Generation • 2B • Updated • 33
RedHatAI/Qwen2.5-3B-FP8-dynamic
Text Generation • 3B • Updated • 375
RedHatAI/Qwen2.5-7B-FP8-dynamic
Text Generation • 8B • Updated • 31
RedHatAI/Qwen2.5-72B-FP8-dynamic
Text Generation • 73B • Updated • 42 • 1
RedHatAI/Qwen2.5-14B-FP8-dynamic
Text Generation • 15B • Updated • 142 • 2
GusPuffy/Llama-3.1-70B-ArliAI-RPMax-v1.3-GPTQ
71B • Updated • 3
RedHatAI/Qwen2.5-14B-quantized.w8a8
Text Generation • 15B • Updated • 7 • 2
RedHatAI/Qwen2.5-3B-quantized.w8a8
Text Generation • 3B • Updated • 7 • 1
RedHatAI/Qwen2.5-14B-Instruct-quantized.w8a8
Text Generation • 15B • Updated • 103
RedHatAI/Qwen2.5-0.5B-quantized.w4a16
Text Generation • 0.6B • Updated • 68
RedHatAI/Qwen2.5-1.5B-quantized.w4a16
Text Generation • 2B • Updated • 15