OPEN SOURCE MODELS

Free & Open Source

High-quality models you can run locally or access for free.

Llama 3.3 70B

Meta · 70B

128K ctx

MEDIUM TO HOST40GB VRAMLlama Community License

MMLU86%

HUMANEVAL88.4%

RUN WITH

OllamaHuggingFacevLLM

CodingResearchGeneral use

Llama 3.2 3B

Meta · 3B

128K ctx

EASY TO HOST4GB VRAMLlama Community License

MMLU60.1%

HUMANEVAL48.2%

RUN WITH

OllamaLM Studiollama.cpp

Devices with limited VRAMExperimentation

Mistral 7B Instruct

Mistral AI · 7B

32K ctx

EASY TO HOST8GB VRAMApache 2.0

MMLU64.2%

HUMANEVAL38%

RUN WITH

OllamaLM StudioHuggingFace

General useExperimentationPrivacy

Phi-3 Mini

Microsoft · 3.8B

128K ctx

EASY TO HOST4GB VRAMMIT

MMLU69.9%

HUMANEVAL58.1%

RUN WITH

OllamaLM Studio

Devices with limited VRAMExperimentation

DeepSeek V3

DeepSeek · 671B (MoE)

128K ctx

HARD TO HOST80GB+ VRAMMIT

MMLU88.5%

HUMANEVAL92.6%

RUN WITH

HuggingFacevLLMTogether AI

CodingResearchCutting-edge

Qwen 2.5 7B

Alibaba · 7B

131K ctx

EASY TO HOST8GB VRAMApache 2.0

MMLU72.4%

HUMANEVAL72.6%

RUN WITH

OllamaLM StudioHuggingFace

General useCoding