swap_horiz llamafile Alternatives

1

GitHub: Where the world builds software · GitHub

GitHub is a web-based platform and version control service that utilizes Git. It is primarily known as a central hub for...

Github Build

9.2 Excellent

2

SourceTree

Sourcetree, maintained by Atlassian, is a veteran in the Git GUI space. It is a robust, free client that provides a comp...

Free Windows User Friendly Git Client

8.8 Very Good

3

Preact

Preact is a fast, 3kB alternative to React with the same modern API. It is designed for developers who want the React de...

Lightweight React Small Size Jsx

8.5 Very Good

4

Ubuntu

Linux distribution with guided graphical installer. Detects hardware automatically and installs drivers.

User Friendly Linux Operating System

8.5 Very Good

5

Candle (by Hugging Face)

A minimalistic ML framework for Rust with support for running LLMs. Good for embedded or edge deployments alongside LM S...

Rust Minimal LLM Runner

7.0 Good

6

Capterra Reviews

Capterra Reviews is a component of Capterra that focuses on providing detailed reviews and ratings for business software...

Small Business Enterprise Software Software Review Comparison

5.6 Average

7

koboldcpp

A single-file executable for llama.cpp with a focus on storytelling and roleplay. Works well as a lightweight alternativ...

Storytelling Single File LLM Runner Cursor

8.1 Very Good

8

LM Studio (itself as an alternative runner variant)

The premier all-in-one local LLM runner with built-in model download, management, and inference. The benchmark for local...

All In One User Friendly LLM Runner

9.5 Brilliant

9

LocalAI

Self-hosted OpenAI-compatible API server. Deploy any model and use with JetBrains via the Continue plugin or custom scri...

Docker API Server Localai LLM Runner

8.5 Very Good

10

Ollama Web UI (Open WebUI)

A feature-rich web interface for Ollama, providing a ChatGPT-like experience. Can be paired with LM Studio for model man...

Web Interface Ollama Integration LLM Runner

8.5 Very Good

11

Text Generation WebUI (oobabooga)

The oobabooga WebUI is a massive, community-driven platform that supports nearly every major LLM format and model archit...

All In One Community Driven Flexible Web Interface

8.3 Very Good

12

EX

ExLlamaV2

A high-performance inference engine for LLMs, especially optimized for LLaMA architectures. Used by many LM Studio users...

Local GPU Inference Engine Quantization

8.0 Very Good

13

Aphrodite Engine

An advanced inference engine with support for tensor parallelism and PagedAttention. Suitable for running large models l...

Self Hosted Inference Engine LLM Runner

7.7 Good

14

TA

TabbyAPI

A lightweight OpenAI-compatible API server for local LLMs. Ideal for developers who want to connect external tools to LM...

API Server LLM Runner Openai Compatible

7.5 Good

15

Jan

Open-source ChatGPT alternative that runs local models. Exposes an API that can be harnessed by JetBrains AI plugins.

Open Source Local Desktop Jan

7.5 Good

16

MI

Mistral.rs

Fast Rust-based inference engine for Mistral models. Supports OpenAI API format for Cursor integration.

Rust Cursor

7.3 Good

17

RWKV Runner

A dedicated runner for RWKV models, offering efficient inference on CPU and GPU. Complements LM Studio for RWKV enthusia...

Cross Platform LLM Runner Rwkv

7.0 Good

18

TiddlyWiki

TiddlyWiki is a unique, non-linear personal web notebook. It is a single HTML file that contains the entire application...

Software Customizable Open Source Plugin

6.8 Fair

19

TabbyML

Self-hosted code completion server. Directly designed for IDE integration, including Cursor, via its API.

Self Hosted Cursor

6.5 Fair