Danish Foundation Models
Kenneth Enevoldsen Lasse Hansen Dan S. Nielsen Rasmus A. F. Egebæk Søren V. Holm Martin C. Nielsen Martin Bernstorff Rasmus Larsen Peter B. Jørgensen Malte Højmark-Bertelsen Peter B. Vahlstrup Per Møldrup-Dalum Kristoffer Nielbo
Large language models, sometimes referred to as foundation models, have
transformed multiple fields of research. However, smaller languages risk
falling behind due to high training costs and small incentives for large
companies to train these models. To combat this, the Danish Foundation Models
project seeks to provide and maintain open, well-documented, and high-quality
foundation models for the Danish language. This is achieved through broad
cooperation with public and private institutions, to ensure high data quality
and applicability of the trained models. We present the motivation of the
project, the current status, and future perspectives.