SOURCE-LINKED INTELLIGENCE

VākQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answering

arXiv · AI, language, vision and robotics · article · Sep 17, 2026 · UTC

Question answering has advanced rapidly with large language models, but predominantly for high-resource languages, in both text and spoken settings. Spoken question answering (SQA) benchmark for Telugu remains unexplored, and the reliability of automatic evaluation in this setting remains unquantified. We introduce VākQA, a Telugu SQA benchmark of 2,001 factoid question-answer pairs across six domains, with 2.53 hours of speech audio, bilingual transcriptions, and human-verified reference answers. We first validate evaluation methods against human judgements: Gemini-as-a-judge best approximate

Read original source ↗ Open in workspace

recordType

paper

region

Global