Runners Like GPT4All

Ollama

Runner

9.05 Excellent

Text Generation WebUI

Runner

8.13 Great

llamafile

Software

7.85 Good

Phi-3 Mini (Local)

Runner

6.93 Fair

LM Studio (itself as an alternative runner variant)

Runner

8.63 Great

vLLM (Local Deployment)

Runner

8.38 Great

Continue (Local Backend)

Runner

8.00 Great

llama.cpp-mac

Runner

7.90 Good

ExLlamaV2

Machine Learning

7.62 Good

Phi-3 Mini

LLM

7.59 Good

Amberscript

Speech To Text

7.36 Good

OpenHermes 2.5 Mistral

LLM

7.34 Good

koboldcpp

Coding

7.28 Good

Phi-3 Mini via Ollama

Self Hosted

6.78 Fair

Cursor IDE (Local LLM Mode)

LLM

6.59 Fair

Aphrodite Engine

Machine Learning

6.53 Fair

KoboldAI

Runner

6.42 Fair

PocketTranscriber

Speech To Text

5.68 Mediocre

RWKV Runner

Deep Learning

4.80 Poor

LM Studio

Runner

8.75 Great

Hugging Face Transformers (Local Inference)

Runner

8.25 Great

Jan AI

Runner

7.80 Good

llama.cpp-python Bindings

Runner

7.69 Good

DeepSeek Coder

Runner

7.59 Good