swap_horiz LocalAI Alternatives

1

Text Generation WebUI (oobabooga)

The oobabooga WebUI is a massive, community-driven platform that supports nearly every major LLM format and model archit...

All In One Community Driven Flexible Web Interface

8.3 Very Good

2

Codestral via Ollama

Run Codestral locally using Ollama. Provides excellent code generation and completion for JetBrains through the Continue...

Code Completion Ollama Mistral

9.0 Excellent

3

Tabby (Self-Hosted)

Open-source self-hosted AI code completion server. Supports multiple models and integrates directly with JetBrains via i...

Server Code Completion Tabby

9.0 Excellent

4

Ollama (General Platform)

Easiest way to run various local LLMs. Works with JetBrains via Continue, Tabby, or custom scripts for code completion a...

Local Platform Ollama

9.0 Excellent

5

StarCoder2 via Ollama

The StarCoder2 model fine-tuned for code. Deploy locally via Ollama and connect to JetBrains with Continue or Tabby.

Code Completion Ollama Starcoder

8.5 Very Good

6

Qwen2.5-Coder via Ollama

Alibaba's Qwen2.5-Coder model provides strong code generation. Run locally and use with JetBrains through Continue or Ta...

Code Completion Ollama Qwen

8.5 Very Good

7

Aider (Local Pair Programming)

AI pair programming tool that can use local models. Integrates with JetBrains via the terminal or can be adapted with cu...

CLI Pair Programming Aider

8.5 Very Good

8

CodeGemma

Google's lightweight code model designed for local deployment and integration into IDEs like JetBrains.

Google Code Model

8.3 Very Good

9

Text Generation Inference

Hugging Face's high-performance inference server for LLMs, easily deployable and compatible with JetBrains plugins.

Huggingface

8.2 Very Good

10

CodeGemma via Ollama

Google's CodeGemma model optimized for code tasks. Run locally and integrate with JetBrains using the Continue extension...

Code Completion Ollama Gemma

8.0 Very Good

11

Phi-3

Microsoft's efficient small language model that runs well on consumer hardware and can power JetBrains AI features.

Microsoft Local Small Model

7.9 Good

12

DeepSeek-V2

A powerful general-purpose LLM that can be self-hosted and integrated into JetBrains for code assistance.

Local Model Deepseek

7.8 Good

13

Phi-3 Mini via Ollama

Microsoft's compact Phi-3 Mini model. Efficient for local deployment and works well with JetBrains via Ollama and Contin...

Code Completion Ollama Phi 3

7.5 Good

14

Jan

Open-source ChatGPT alternative that runs local models. Exposes an API that can be harnessed by JetBrains AI plugins.

Open Source Local Desktop Jan

7.5 Good

15

Open WebUI (Ollama WebUI)

Self-hosted web interface for Ollama. Can be used as a backend for JetBrains via API endpoints for code help and chat.

Chat Ollama Webui

7.0 Good