SOURCE-LINKED INTELLIGENCE

PersonalAI: Efficient and Private Text Personalization with Large Language Models

CORDIS · observation · Publication date unknown

PersonalAI: Efficient and Private Text Personalization with Large Language Models The rapid adoption of Large Language Models (LLMs) for text generation has created a critical tension between functionality and privacy: while users increasingly rely on services like ChatGPT for personal and business communications, such cloud-based systems require surrendering control of sensitive data to third-party companies, often outside EU jurisdiction. The PersonalAI project addresses this fundamental challenge by enabling fully private, on-device personalization of open-source LLMs, leveraging breakthrough compression and fine-tuning techniques developed in the PI's ERC Starting Grant ScaleML project. Our preliminary PanzaMail study showed that models fine-tuned on as few as 50-100 user emails can generate text closely following genuine user writing, while our novel RoSA method enables this personalization on commodity hardware—reducing computational requir

Read original source ↗ Open in workspace

recordType

award

status

SIGNED

region

EU

value

150000

unit

EUR