Runners Like KoboldAI
Continue
Coding Assistant
8.52
Great
vLLM (Local Deployment)
Runner
8.38
Great
GPT4All
Runner
7.38
Good
Phi-3 Mini (Local)
Runner
6.93
Fair
Code Llama (via Local Frameworks)
Coding Assistant
5.50
Mediocre
GPT-Engineer (Local Adaptation)
Coding Assistant
5.50
Mediocre
Ollama
Runner
9.05
Excellent
LM Studio
Runner
8.75
Great
LM Studio (itself as an alternative runner variant)
Runner
8.63
Great
Hugging Face Transformers (Local Inference)
Runner
8.25
Great
Text Generation WebUI
Runner
8.13
Great
Continue (Local Backend)
Runner
8.00
Great
llama.cpp-mac
Runner
7.90
Good
Jan AI
Runner
7.80
Good
llama.cpp-python Bindings
Runner
7.69
Good
DeepSeek Coder
Runner
7.59
Good
Solara AI
Runner
7.49
Good
LocalMind Runner
Runner
7.28
Good
StarCoder2
Runner
7.18
Good
GPT-3.5 Turbo (Local Emulation)
Runner
7.07
Good
Synapse AI Runner
Runner
6.68
Fair
Code Llama (Local)
Runner
6.17
Fair
StreamMind Runner
Runner
5.77
Mediocre
NanoRunner
Runner
4.80
Poor
