SOURCE-LINKED INTELLIGENCE

Mo' Models, Mo' Problems: How to best select model pools when designing Multi-Agent Systems

arXiv · AI, language, vision and robotics · article · Sep 15, 2026 · UTC

Multi-agent Systems (MAS) combine multiple model outputs to solve complex reasoning tasks. However, despite rapid growth of available open-source models, there is limited research on how to select optimal model candidates out of this massive pool. We systematically evaluate 8 model selection strategies (including model size, accuracy and answer diversity) across before-generation (routing) and after-generation (majority-voting, LLM-as-a-judge) MAS architectures on challenging scientific benchmarks. Our findings show a significant gap between theoretical oracle potential and actual performance:

Read original source ↗ Open in workspace

recordType

paper

region

Global