swap_horiz Phi-3 Mini (Local) Alternatives

1

Ollama

Ollama is a command-line tool that simplifies the process of running LLMs locally. It focuses on ease of use and rapid d...

Command Line Developer Tool Artificial Intelligence Apple Silicon

9.05 Excellent

2

LM Studio

LM Studio is a revolutionary desktop application that simplifies running large language models locally. It provides a us...

Productivity Privacy AI Offline

8.75 Great

3

LM Studio (itself as an alternative runner variant)

LM Studio is a desktop application designed to run large language models locally on your computer. It’s notable for its...

Modern Performance All In One Offline

8.63 Great

4

Mistral AI Local Inference

Mistral models are renowned for their exceptional reasoning capabilities relative to their size. When running these mode...

Performance Open Source Reasoning Model Quality

8.50 Great

5

vLLM (Local Deployment)

vLLM is primarily a high-throughput serving engine, but its ability to run models locally makes it invaluable for develo...

Research Experimental High Throughput Local Dev

8.38 Great

6

Hugging Face Transformers (Local Inference)

While not a dedicated IDE plugin, utilizing the Hugging Face Transformers library directly within a Python script allows...

Research Machine Learning Local Dev Model Access

8.25 Great

7

Text Generation WebUI

Text Generation WebUI is a highly popular open-source LLM inference web interface built around the llama.cpp library. It...

Community Driven Local Web UI Artificial Intelligence

8.13 Great

8

Continue (Local Backend)

Continue is a powerful VS Code/JetBrains extension that excels at providing a chat-like interface directly within the ID...

IDE Integration Context Aware Chat Interface Multi Model

8.00 Great

9

llama.cpp-mac

llama.cpp-mac is a highly optimized port of the llama.cpp library specifically tailored for Apple Silicon Macs. Its desi...

Low Latency Command Line Cpp MAC OS

7.90 Good

10

Jan AI

Jan AI aims to provide a polished, standalone desktop application experience for running local LLMs. It balances the eas...

Desktop App User Friendly Privacy First Intuitive Interface

7.80 Good

11

llama.cpp-python Bindings

This package provides Python bindings directly to the highly optimized llama.cpp core. It is the preferred method for de...

Performance Optimization Advanced Scripting

7.69 Good

12

DeepSeek Coder

DeepSeek Coder models are specifically trained on massive, high-quality code datasets, giving them a distinct edge in co...

Professional Multi Language Academic Code Generation

7.59 Good

13

Solara AI

Solara AI stands out for its exceptional GPU acceleration capabilities, particularly when utilizing NVIDIA GPUs. It boas...

Web UI Inference Engine Quantization Lm Studio Local Runner

7.49 Good

14

GPT4All

GPT4All is a software application enabling users to run large language models locally on their computers. It’s notable f...

Accessibility Easy To Use Offline Artificial Intelligence

7.38 Good

15

LocalMind Runner

LocalMind Runner is a cutting-edge local LLM runner built for speed and efficiency. It leverages advanced GPU accelerati...

Community Docker Quantization Fast Inference

7.28 Good

16

StarCoder2

StarCoder2, trained by DeepMind and Hugging Face, is a highly respected, academically validated model for code generatio...

Multi Language Self Hosted Academic Code Completion

7.18 Good

17

GPT-3.5 Turbo (Local Emulation)

This entry represents the capability level of older, highly capable models that are now being emulated or benchmarked lo...

General Purpose Fallback Lm Studio Local Runner Legacy Benchmark

7.07 Good

18

Synapse AI Runner

Synapse AI Runner is a powerful and intuitive local LLM runner built around a streamlined web UI. It excels at quickly d...

Web UI Python Quantization Lm Studio Local Runner

6.68 Fair

19

KoboldAI

While often marketed for creative writing and roleplaying, KoboldAI provides a robust local inference engine that can be...

Experimental Coding Assistant Local Inference Lm Studio Local Runner

6.42 Fair

20

Code Llama (Local)

Code Llama, Meta's dedicated coding model, remains a foundational and highly stable choice for local development. It ben...

Meta Code Generation Python Stable

6.17 Fair