Aleph Alpha has announced the release of Kolibri, a groundbreaking AI model that features a mixture-of-experts architecture with 78 billion parameters. Notably, around three billion of these parameters are activated per token, with over 21 percent of the training data derived from German sources. This initiative is part of a broader movement to bolster AI sovereignty in Europe.
Trained on 768 B200 GPUs located in Germany and Finland, Kolibri’s weights are made publicly available under the Apache 2.0 license. This move not only promotes accessibility but also encourages innovation within the European AI landscape, positioning Aleph Alpha as a key player in the ongoing global AI competition.
Compiled automatically by the Tech AI Newsdesk from public AI-news sources and summarised in our own words.
