SOURCE-LINKED INTELLIGENCE

Multilingual in Name Only? Cultural and Linguistic Weaknesses of LLMs in Urdu

arXiv · AI, language, vision and robotics · article · Sep 9, 2026 · UTC

Multilingual large language models (LLMs) are increasingly used for open-ended text generation, yet their behaviour in low-resource languages remains poorly understood. In this work, we question how correct and reliable is the generation of multilingual LLMs when used for the task of story generation. We consider Urdu language as a representative low-resource language. We generate Urdu-Stories, a corpus of 93 stories generated using three contemporary LLMs (GPT-5.1, Qwen-3-Max, DeepSeek-3.1). We manually annotate the errors present in them under a nine-label linguistic, semantic, and cultural

Read original source ↗ Open in workspace

recordType

paper

region

Global