Yi-1.5 vs DBRX

Yi-1.5 is an open-weight series of large language models developed by the Chinese AI startup 01.AI and released in May 2024. Serving as a direct upgrade to the original Yi models, the Yi-1.5 series was built using continuous pre-training and extensive fine-tuning on high-quality datasets. The models are available in several parameter sizes, including 6B, 9B, and 34B, offering improved performance...

DBRX is an open-weight mixture-of-experts (MoE) language model released by Databricks in March 2024. It has 132 billion total parameters with 36 billion active per token, utilizing 16 expert groups in a fine-grained routing architecture. Databricks trained the model on its own infrastructure and reported that it surpassed other open MoE models on standard benchmarks at the time of release. The mod...