SOURCE-LINKED INTELLIGENCE

Carbon-Aware Routing for Function Calling in Edge-Cloud LLM Systems

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

Large Language Models (LLMs) with function-calling capabilities are becoming critical for modern agentic AI systems. Nevertheless, current deployments typically route inferences to powerful cloud-based models, incurring significant energy use and carbon emissions. We address this sustainability challenge with a carbon-aware routing framework that distributes function-calling queries across a three-tier edge-cloud architecture, combining edge and cloud LLMs on heterogeneous hardware. At its core, a lightweight k-NN predictor operating in a unified semantic-lexical embedding space estimates quer

Read original source ↗ Open in workspace

recordType

paper

region

Global