Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,462

Base only

Active filters: auto-round

OPEA/Qwen2.5-7B-Instruct-int4-sym-inc

2B • Updated Apr 30, 2025 • 13 • 1

OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc

3B • Updated Jun 5, 2025 • 1.15k • 2

OPEA/llava-v1.5-7b-int4-sym-inc

1B • Updated Jul 18, 2025 • 16 • 1

OPEA/Qwen2.5-72B-Instruct-int4-sym-inc

12B • Updated Apr 30, 2025 • 11 • 1

OPEA/Llama-3.2-90B-Vision-Instruct-int4-sym-inc

14B • Updated Jul 18, 2025 • 16

OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc

0.2B • Updated Sep 11, 2025 • 16.9k

OPEA/Qwen2.5-1.5B-Instruct-int4-sym-inc

0.4B • Updated Sep 23, 2025 • 588

OPEA/Qwen2.5-3B-Instruct-int4-sym-inc

0.7B • Updated Apr 30, 2025 • 8

OPEA/QwQ-32B-Preview-int4-sym-mixed-inc

6B • Updated Apr 30, 2025 • 11 • 8

OPEA/glm-4-9b-chat-int4-sym-inc

2B • Updated Apr 30, 2025 • 11

OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc

11B • Updated Apr 24, 2025 • 16 • 1

OPEA/glm-4-9b-chat-int4-sym-lm-head-inc

2B • Updated Apr 30, 2025 • 11

OPEA/internlm2_5-7b-chat-int4-sym-inc

2B • Updated Apr 30, 2025 • 12

OPEA/Marco-o1-int4-sym-inc

2B • Updated Apr 30, 2025 • 8

OPEA/SmolVLM-Instruct-int4-sym-inc

0.9B • Updated Jul 18, 2025 • 17 • 3

OPEA/Phi-3.5-vision-instruct-qvision-int4-sym-inc

Updated Apr 30, 2025 • 34 • 1

OPEA/Llama-3.2-11B-Vision-Instruct-qvision-int4-sym-inc

2B • Updated Jul 18, 2025 • 129 • 1

OPEA/cogvlm2-llama3-chat-19B-qvision-int4-sym-inc

4B • Updated Jul 18, 2025 • 10 • 1

OPEA/DeepSeek-V2-Lite-int4-sym-inc

3B • Updated Apr 30, 2025 • 306 • 1

OPEA/glm-4v-9b-int4-sym-inc

7B • Updated Jul 18, 2025 • 8

OPEA/OLMo-2-1124-13B-Instruct-int4-sym-inc

3B • Updated Apr 30, 2025 • 19

OPEA/OLMo-2-1124-7B-Instruct-int4-sym-inc

2B • Updated Apr 30, 2025 • 11

OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc

11B • Updated Apr 24, 2025 • 12

OPEA/Llama-3.2V-11B-cot-int4-sym-inc

3B • Updated Jul 18, 2025 • 12 • 1

OPEA/llama-joycaption-alpha-two-hf-llava-int4-sym-inc

2B • Updated Jul 18, 2025 • 27 • 4

OPEA/Llama-3.3-70B-Instruct-int4-sym-inc

11B • Updated Apr 30, 2025 • 123

OPEA/Qwen2-VL-72B-Instruct-int4-sym-inc

13B • Updated Jul 18, 2025 • 13

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_awq-int4-gs128-asym

Text Generation • 2B • Updated Jan 4, 2025 • 8

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_awq-int4-gs128-sym

Text Generation • 2B • Updated Jan 4, 2025 • 24

OPEA/Falcon3-3B-Base-int4-sym-inc

1B • Updated Apr 24, 2025 • 9