Runners Like Text Generation WebUI
Ollama
Runner
9.05
Excellent
GPT4All
Runner
7.38
Good
OpenWrt Build Scripts v5.7
Router Firmware
8.48
Great
Codestral via Ollama
Self Hosted
7.82
Good
Solara AI
Runner
7.49
Good
PromptlyAI
AI Content Generation
7.42
Good
Synapse AI Runner
Runner
6.68
Fair
LM Studio
Runner
8.75
Great
LM Studio (itself as an alternative runner variant)
Runner
8.63
Great
vLLM (Local Deployment)
Runner
8.38
Great
Hugging Face Transformers (Local Inference)
Runner
8.25
Great
Continue (Local Backend)
Runner
8.00
Great
llama.cpp-mac
Runner
7.90
Good
Jan AI
Runner
7.80
Good
llama.cpp-python Bindings
Runner
7.69
Good
DeepSeek Coder
Runner
7.59
Good
LocalMind Runner
Runner
7.28
Good
StarCoder2
Runner
7.18
Good
GPT-3.5 Turbo (Local Emulation)
Runner
7.07
Good
Phi-3 Mini (Local)
Runner
6.93
Fair
KoboldAI
Runner
6.42
Fair
Code Llama (Local)
Runner
6.17
Fair
StreamMind Runner
Runner
5.77
Mediocre
NanoRunner
Runner
4.80
Poor
