Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

380

Base only

Active filters: Llama-3

NousResearch/Hermes-3-Llama-3.1-70B

Text Generation • 71B • Updated Sep 8, 2024 • 3.15k • • 137

NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF

8B • Updated May 3, 2024 • 1.95k • 164

bartowski/Pantheon-RP-1.0-8b-Llama-3-GGUF

Text Generation • 8B • Updated May 12, 2024 • 578 • 11

bartowski/Hermes-3-Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Aug 16, 2024 • 13k • 19

mlx-community/Hermes-3-Llama-3.1-8B-4bit

1B • Updated Aug 16, 2024 • 1.49k • 7

WhiteRabbitNeo/Llama-3.1-WhiteRabbitNeo-2-70B

Updated Aug 19, 2024 • 2.37k • 45

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Text Generation • 8B • Updated Apr 10, 2025 • 1.26k • • 370

corneille97/Llama-3-8B-4bits-turbo

Text Generation • 8B • Updated Apr 18, 2024 • 5

NousResearch/Hermes-2-Pro-Llama-3-8B

Text Generation • 8B • Updated Sep 14, 2024 • 4.18k • • 456

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw2.25-exl2

Text Generation • Updated May 3, 2024 • 7

solidrust/Hermes-2-Pro-Llama-3-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 9.89k • 11

mgoin/Hermes-2-Pro-Llama-3-8B-Marlin

Text Generation • Updated May 2, 2024 • 11 • 1

mlx-community/Hermes-2-Pro-Llama-3-8B-4bit

1B • Updated May 2, 2024 • 79 • 1

mlx-community/Hermes-2-Pro-Llama-3-8B-8bit

2B • Updated May 2, 2024 • 19 • 1

qwp4w3hyb/Hermes-2-Pro-Llama-3-8B-iMat-GGUF

8B • Updated May 2, 2024 • 459 • 2

bartowski/Hermes-2-Pro-Llama-3-8B-exl2

Text Generation • Updated May 2, 2024 • 7 • 7

bartowski/Hermes-2-Pro-Llama-3-8B-GGUF

Text Generation • 8B • Updated May 2, 2024 • 888 • 8

fakezeta/Hermes-2-Pro-Llama-3-8B-ov-int8

Text Generation • Updated Jun 24, 2024 • 7 • 1

codys12/Hermes-2-Pro-Llama-3-8B

Text Generation • 8B • Updated May 2, 2024 • 15

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw3-exl2

Text Generation • Updated May 3, 2024 • 6

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4-exl2

Text Generation • Updated May 3, 2024 • 5

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4.4-exl2

Text Generation • Updated May 3, 2024 • 6

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4.8-exl2

Text Generation • Updated May 3, 2024 • 5

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw5-exl2

Text Generation • Updated May 3, 2024 • 4

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw5.5-exl2

Text Generation • Updated May 3, 2024 • 8

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw6-exl2

Text Generation • Updated May 3, 2024 • 6

batmac/Hermes-2-Pro-Llama-3-8B-mlx-4bit

1B • Updated May 3, 2024 • 18

QuantFactory/Hermes-2-Pro-Llama-3-8B-GGUF

Text Generation • 8B • Updated May 4, 2024 • 480

alejandrovil/llama3-AWQ

Text Generation • 8B • Updated May 23, 2024 • 10

MoMonir/Hermes-2-Pro-Llama-3-8B-GGUF

8B • Updated May 3, 2024 • 26 • 1