Machine Learnings Like ExLlamaV2

Aphrodite Engine

87% match · Experimental, Inference Engine

6.53 Fair

Quantum Machine Learning Frameworks (e.g., PennyLane)

66% match · Experimental

7.54 Good

PyTorch

64% match · GPU

9.17 Excellent

Modal

64% match · GPU

8.29 Great

llamafile

Software

7.85 Good

RWKV Runner

Deep Learning

4.80 Poor

llama.cpp (CLI Framework)

Jetbrains AI Local

8.73 Great

LM Studio (itself as an alternative runner variant)

Runner

8.63 Great

LM Studio (Local Model Runner)

Jetbrains AI Local

8.46 Great

llama.cpp (CLI for Inference)

Jetbrains AI Local

7.70 Good

koboldcpp

Coding

7.28 Good

Whisper.cpp

Speech To Text Software

9.12 Excellent

SQLite

Database

9.11 Excellent

llama.cpp

Continue AI Extension

9.00 Excellent

NVIDIA TensorRT

Deep Learning

8.54 Great

LocalAI

Self Hosted

8.33 Great

vLLM (API Serving)

Jetbrains AI Local

8.19 Great

Phi-3 Mini

LLM

7.59 Good

Solara AI

Runner

7.49 Good

GPT4All

Runner

7.38 Good

Guerilla Render

3D Rendering

7.37 Good

OpenHermes 2.5 Mistral

LLM

7.34 Good

LocalMind Runner

Runner

7.28 Good

Phi-3

Self Hosted

7.27 Good