swap_horiz Ollama Alternatives

1

LM Studio (itself as an alternative runner variant)

LM Studio is a desktop application designed to run large language models locally on your computer. It’s notable for its...

Modern Performance All In One Offline

9.5 Brilliant

2

LM Studio

LM Studio is a revolutionary desktop application that simplifies running large language models locally. It provides a us...

Productivity Privacy AI Offline

9.5 Brilliant

3

Jan AI

Jan AI aims to provide a polished, standalone desktop application experience for running local LLMs. It balances the eas...

Desktop App User Friendly Privacy First Intuitive Interface

8.8 Great

4

Hugging Face Transformers (Local Inference)

While not a dedicated IDE plugin, utilizing the Hugging Face Transformers library directly within a Python script allows...

Research Machine Learning Local Dev Model Access

8.5 Great

5

Text Generation WebUI

Text Generation WebUI is a highly popular open-source LLM inference web interface built around the llama.cpp library. It...

Community Driven Local Web UI Artificial Intelligence

8.5 Great

6

llama.cpp-mac

llama.cpp-mac is a highly optimized port of the llama.cpp library specifically tailored for Apple Silicon Macs. Its desi...

Low Latency Command Line Cpp MAC OS

8.5 Great

7

vLLM (Local Deployment)

vLLM is primarily a high-throughput serving engine, but its ability to run models locally makes it invaluable for develo...

Research Experimental High Throughput Local Dev

8.2 Great

8

Continue (Local Backend)

Continue is a powerful VS Code/JetBrains extension that excels at providing a chat-like interface directly within the ID...

IDE Integration Context Aware Chat Interface Multi Model

8.0 Great

9

StarCoder2

StarCoder2, trained by DeepMind and Hugging Face, is a highly respected, academically validated model for code generatio...

Multi Language Self Hosted Academic Code Completion

8.0 Great

10

KoboldAI

While often marketed for creative writing and roleplaying, KoboldAI provides a robust local inference engine that can be...

Experimental Coding Assistant Local Inference Storytelling Focus

7.8 Good

11

GPT4All

GPT4All is a software application enabling users to run large language models locally on their computers. It’s notable f...

Accessibility Easy To Use Offline Artificial Intelligence

7.8 Good

12

llama.cpp-python Bindings

This package provides Python bindings directly to the highly optimized llama.cpp core. It is the preferred method for de...

Performance Optimization Advanced Scripting

7.2 Good

13

GPT-Engineer (Local Adaptation)

GPT-Engineer is an agentic framework designed to take a high-level prompt and generate a complete, multi-file project st...

Engineering Automation AI Development Planning

7.0 Good

14

DeepSeek Coder

DeepSeek Coder models are specifically trained on massive, high-quality code datasets, giving them a distinct edge in co...

Professional Multi Language Academic Code Generation

6.2 Fair

15

Phi-3 Mini (Local)

Microsoft's Phi-3 Mini is celebrated for achieving surprisingly high performance on complex tasks despite its relatively...

Efficiency Offline Research Academic

5.8 Mediocre

16

Code Llama (Local)

Code Llama, Meta's dedicated coding model, remains a foundational and highly stable choice for local development. It ben...

Meta Code Generation Python Stable

5.5 Mediocre