Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

255

Base only

Active filters: exllamav3

0xSero/deepseek-v4-flash-0731-spark

Text Generation • 60B • Updated 9 days ago • 113k • 46

0xSero/Ornith-1.5-35B-A3B-EXL3-2.75bpw

Text Generation • 9B • Updated 4 days ago • 107 • 3

malaiwah/GLM-5.3-Flash-TR3-6bpw

Image-Text-to-Text • 127B • Updated about 8 hours ago • 142 • 3

malaiwah/GLM-5.3-Flash-TR3-8bpw

Image-Text-to-Text • 166B • Updated about 8 hours ago • 65 • 2

darkbit1001/Qwen-3.8-27B-exl3-4.500bpw-hb6

Text Generation • 9B • Updated 16 days ago • 242 • 2

Honkware/Qwen3.8-27B-heretic-ara-exl3-5.0bpw

Text Generation • 10B • Updated 15 days ago • 336 • 2

Honkware/Qwen3.8-27B-exl3-4.5bpw

Text Generation • 9B • Updated 10 days ago • 262 • 1

Honkware/Qwen3.8-27B-heretic-ara-exl3-4.0bpw

Text Generation • 9B • Updated 15 days ago • 266 • 1

malaiwah/Qwen3.8-27B-EXL3-K5K6-hydrated

Image-Text-to-Text • 11B • Updated 3 days ago • 12k • 10

darkbit1001/Qwen3.8-27B-exl3-4.00bpw-hb8

Text Generation • 9B • Updated 11 days ago • 208 • 3

anoane/DeepSeek-V4-Flash-0731-exl3-hybrid-2.72bpw

Text Generation • 52B • Updated 6 days ago • 705 • 3

writetoasik/Qwen3.8-27B-Uncensored-exl3-4.0bpw

Image-Text-to-Text • 8B • Updated 6 days ago • 51 • 1

Blackfrost-Research/GLM-5.3-DERISKED-EXL3-2.0bpw-HQ

Text Generation • 99B • Updated 1 day ago • 18 • 1

unsignedchad/GLM-5.3-Flash-ablit-exl3-4bpw

Image-Text-to-Text • 82B • Updated about 19 hours ago • 46 • 1

MikeRoz/Qwen3-235B-A22B-exl3

Text Generation • Updated May 14, 2025 • 10 • 4

patf82/Absolute_Zero_Reasoner-Coder-14b-5.0bpw-exl3

5B • Updated May 14, 2025 • 8 • 4

MikeRoz/QwQ-32B-ArliAI-RpR-v4-exl3

Text Generation • Updated May 23, 2025 • 22

MikeRoz/DS-R1-Distill-70B-ArliAI-RpR-v4-Large-exl3

Text Generation • Updated Jun 10, 2025

Minthy/Qwen3-235B-A22B-5.0bpw-h6-exl3

Text Generation • 74B • Updated Jun 24, 2025 • 6

MikeRoz/Strawberrylemonade-L3-70B-v1.2-exl3

Text Generation • Updated Jul 10, 2025 • 1 • 1

MikeRoz/Strawberrylemonade-L3-70B-v1.1-exl3

Text Generation • Updated Jul 11, 2025

cgus/Lucy-128k-exl3

Text Generation • 0.8B • Updated Jul 20, 2025 • 8

MikeRoz/Qwen3-235B-A22B-Instruct-2507-exl3

Text Generation • Updated Jan 30 • 6

MikeRoz/Qwen3-Coder-480B-A35B-Instruct-exl3

Text Generation • Updated Oct 8, 2025 • 1 • 1

grimjim/Modicum-of-Doubt-v1-24B-4bpw-h6-exl3

Text Generation • 6B • Updated Jul 25, 2025 • 4

MikeRoz/Qwen3-235B-A22B-Thinking-2507-exl3

Text Generation • Updated Jul 27, 2025 • 1 • 4

Doctor-Shotgun/Qwen3-235B-A22B-Instruct-2507-exl3_3.07bpw-h6-custom

Text Generation • 46B • Updated Jul 29, 2025 • 8 • 6

Doctor-Shotgun/GLM-4.5-Air-exl3_5.0bpw-h6

Text Generation • 34B • Updated Aug 4, 2025 • 10 • 2

MikeRoz/GLM-4.5-Air-exl3

Text Generation • Updated Aug 6, 2025 • 1 • 7

MikeRoz/GLM-4.5-exl3

Text Generation • Updated Jan 29 • 10 • 7