Models

moonshotai/Kimi-K2-Thinking

Text Generation • Updated Nov 8 • 420k • • 1.54k

mistralai/Mistral-Large-3-675B-Instruct-2512

Updated 16 days ago • 829 • 190

cyankiwi/Devstral-2-123B-Instruct-2512-AWQ-4bit

22B • Updated 7 days ago • 2.61k • 14

mistralai/Mistral-Large-3-675B-Instruct-2512-NVFP4

Updated 16 days ago • 1.37k • 42

RedHatAI/gemma-3-4b-it-FP8-dynamic

Any-to-Any • 4B • Updated Jun 9 • 417 • 2

zai-org/GLM-4.5-Air-FP8

Text Generation • 111B • Updated Aug 12 • 73.6k • • 73

cpatonn/Qwen3-4B-Thinking-2507-AWQ-4bit

Text Generation • 1B • Updated Aug 6 • 889 • 4

RedHatAI/Devstral-Small-2507-FP8-Dynamic

Text Generation • 24B • Updated Aug 29 • 546 • 4

zai-org/GLM-4.6-FP8

Text Generation • 358B • Updated Oct 16 • 190k • • 92

allenai/olmOCR-2-7B-1025-FP8

Image-to-Text • 8B • Updated 10 days ago • 1.46M • 159

RESMP-DEV/GLM-4.6-NVFP4

Text Generation • 199B • Updated Oct 9 • 206 • 5

RedHatAI/Qwen3-VL-235B-A22B-Instruct-NVFP4

Text Generation • 133B • Updated 15 days ago • 4.15k • 5

aisingapore/Qwen-SEA-LION-v4-32B-IT-4BIT

Text Generation • 6B • Updated 18 days ago • 673 • 4

jiangchengchengNLP/qwen3-4b-fp8-scaled

Updated 22 days ago • 165 • 20

cyankiwi/Ministral-3-14B-Instruct-2512-AWQ-4bit

4B • Updated 10 days ago • 1.19k • 4

cyankiwi/Apriel-1.6-15b-Thinker-AWQ-4bit

Image-Text-to-Text • 4B • Updated 9 days ago • 395 • 2

Firworks/Devstral-Small-2-24B-Instruct-2512-nvfp4

14B • Updated 8 days ago • 1.69k • 2

RedHatAI/Qwen3-Next-80B-A3B-Instruct-NVFP4

Text Generation • Updated 7 days ago • 697 • 3

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation • 8B • Updated 7 days ago • 38.5k • 9

RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

Text Generation • 89B • Updated Oct 2, 2024 • 4.64k • 11

RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8

Text Generation • 8B • Updated Feb 27 • 4.64k • 5

RedHatAI/Qwen2.5-VL-72B-Instruct-FP8-dynamic

Image-to-Text • 73B • Updated Apr 25 • 8.82k • 15

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16

Image-to-Text • 3B • Updated Apr 3 • 684 • 8

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Mar 20 • 13.3k • 43

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • 109B • Updated Sep 22 • 26.8k • 28

RedHatAI/gemma-3-12b-it-FP8-dynamic

Any-to-Any • 12B • Updated Jun 9 • 1.91k • 5

RedHatAI/Qwen3-0.6B-FP8-dynamic

Text Generation • 0.8B • Updated May 12 • 4.66k • 1

RedHatAI/Qwen3-30B-A3B-NVFP4

Text Generation • 17B • Updated 15 days ago • 1.69k • 2

RedHatAI/Qwen3-32B-NVFP4

Text Generation • 19B • Updated 28 days ago • 307 • 4

cpatonn/Qwen3-30B-A3B-Instruct-2507-AWQ-4bit

Text Generation • 5B • Updated 18 days ago • 169k • 22