Runners Like LocalMind Runner
Ollama
Runner
9.05
Excellent
LocalAI
Self Hosted
8.33
Great
ExLlamaV2
Machine Learning
7.62
Good
Zephyr 7B
Jetbrains Self Hosted AI
7.53
Good
Solara AI
Runner
7.49
Good
Phi-3 Mini (Local)
Runner
6.93
Fair
Synapse AI Runner
Runner
6.68
Fair
LM Studio
Runner
8.75
Great
LM Studio (itself as an alternative runner variant)
Runner
8.63
Great
vLLM (Local Deployment)
Runner
8.38
Great
Hugging Face Transformers (Local Inference)
Runner
8.25
Great
Text Generation WebUI
Runner
8.13
Great
Continue (Local Backend)
Runner
8.00
Great
llama.cpp-mac
Runner
7.90
Good
Jan AI
Runner
7.80
Good
llama.cpp-python Bindings
Runner
7.69
Good
DeepSeek Coder
Runner
7.59
Good
GPT4All
Runner
7.38
Good
StarCoder2
Runner
7.18
Good
GPT-3.5 Turbo (Local Emulation)
Runner
7.07
Good
KoboldAI
Runner
6.42
Fair
Code Llama (Local)
Runner
6.17
Fair
StreamMind Runner
Runner
5.77
Mediocre
NanoRunner
Runner
4.80
Poor
