Dolly 2.0 vs DBRX
psychology AI Verdict
description Overview
Dolly 2.0
Dolly 2.0 is an instruction-following large language model released by the software company Databricks in April 2023. Built upon the open-source Pythia-12B architecture, the model is distinguished by being fine-tuned exclusively on the 'databricks-dolly-15k' dataset, a collection of over 15,000 human-generated records created by Databricks employees. Released under a commercially permissive open-s...
Read more
DBRX
DBRX is an open-weight mixture-of-experts (MoE) language model released by Databricks in March 2024. It has 132 billion total parameters with 36 billion active per token, utilizing 16 expert groups in a fine-grained routing architecture. Databricks trained the model on its own infrastructure and reported that it surpassed other open MoE models on standard benchmarks at the time of release. The mod...
Read more
leaderboard Similar Items
info Details
swap_horiz Compare With Another Item
Compare Dolly 2.0 with...
Compare DBRX with...