SOURCE-LINKED INTELLIGENCE

Decoupling Readiness from Release for Tail-Aware Scheduling of Agentic LLM Workflows

arXiv · AI, language, vision and robotics · article · Sep 10, 2026 · UTC

Agentic LLM workflows consist of sequences of model turns interleaved with tool interactions, so their end-to-end completion time depends not only on inference speed but also on when ready turns are released. Most runtimes release each turn immediately upon readiness. Under contention, this eager release policy can accumulate released but unfinished work; once submitted, those turns can no longer be reordered by the workflow-level policy, increasing tail latency. We present a tail-risk-aware turn release scheduling method that jointly decides which ready turn to release next and how much relea

Read original source ↗ Open in workspace

recordType

paper

region

Global