Continue AI Extensions Like Llama 3 (Meta)
Llama 3 70B
Accuracy
8.77
Great
StarCoder2 (via Local Inference)
Jetbrains Local LLM
7.94
Good
AutoGen
Programming And Tech Skill
7.88
Good
Mistral AI (via local deployment)
Continue AI Extension
7.59
Good
Zephyr 7B
Jetbrains Self Hosted AI
7.53
Good
Mistral Large (via LM Studio)
Jetbrains Local LLM
7.14
Good
Code Llama (Original)
Jetbrains Self Hosted AI
7.05
Good
WizardLM 7B
Jetbrains Self Hosted AI
6.54
Fair
RedPajama-INCITE-3B-Instruct
Jetbrains Self Hosted AI
4.80
Poor
GPT-4o Interface
Artificial Intelligence
8.71
Great
Gemini 1.5 Pro
Technology
8.71
Great
GPT-4
LLM Chatbot
8.68
Great
Mistral 7B Instruct
Self Hosted
8.55
Great
Llama 3 8B (via Ollama)
Jetbrains Local LLM
8.38
Great
Ollama with CodeLlama
Jetbrains Self Hosted AI
8.37
Great
Mistral-Instruct-7B (via LM Studio)
Jetbrains Local LLM
8.15
Great
Copilot Chat
Github Copilot Chat
8.13
Great
DeepSeek Coder (via Ollama)
Jetbrains Local LLM
8.13
Great
Phi-3 Mini
Jetbrains Local LLM
8.05
Great
OpenAI
Creator
7.93
Good
OpenHermes 2.5 Mistral
Jetbrains Local LLM
7.89
Good
Anthropic Claude API
Atomic Redster
7.75
Good
BinderHub
Jupyter Notebook
7.66
Good
Mistral Large
Self Hosted
7.64
Good