description Grok-1 Overview
Grok-1 is a large language model developed by xAI, the artificial intelligence company founded by Elon Musk. Released as open weights in March 2024, it features a massive 314 billion parameters configured in a mixture-of-experts architecture. The model was trained on a custom cluster and is integrated into the X platform to power conversational chatbot features for premium subscribers. By releasing the weights under the Apache 2.0 license, xAI provided researchers access to one of the largest open-source mixture-of-experts models available at the time.
help Grok-1 FAQ
What is Grok-1?
Grok-1 is a large language model developed by xAI, the company founded by Elon Musk. It was released as open weights in March 2024.
How large is Grok-1?
Grok-1 has 314 billion parameters in a mixture-of-experts architecture. Its total parameter count is much larger than the active portion used for any single token.
What does mixture of experts mean in Grok-1?
A mixture-of-experts model contains multiple specialized neural sub-networks and routes each token through selected experts. Grok-1 uses this architecture to reach a 314-billion-parameter total without activating every parameter for every token.
Who released the Grok-1 weights?
xAI released the Grok-1 weights and architecture in March 2024. The release made the model available for researchers and developers to examine and run under its published terms.
explore Explore More
Reviews & Comments
Write a Review
Be the first to review
Share your thoughts with the community and help others make better decisions.
