SOURCE-LINKED INTELLIGENCE

Multilingual Assets and Resources for Modular Translation

CORDIS · observation · Publication date unknown

Multilingual Assets and Resources for Modular Translation Recent innovations in language technologies have introduced large language models that industry players often pitch as one-size-fit-all solutions. These systems are however rarely reusable in novel contexts, nor sustainable given their massive parameter counts, nor scalable across the thousands of languages spoken in the world. In response, we intend to build upon the findings of ERC funded project FoTran, and develop modular architectures in which parts of a network are designed to be specialized for a given task, and specialized components can be added throughout the lifetime of a model. This approach has the potential to significantly reduce the growing carbon footprint of generative AI, and will allow us to reach a broad language coverage and target under-served languages. Our MARMoT projects focuses more specifically on two goals: (i) converting our research prototypes of scalable modular architectures for language modeling and translation

Read original source ↗ Open in workspace

recordType

award

status

SIGNED

region

EU

value

150000

unit

EUR