SOURCE-LINKED INTELLIGENCE

Partition-Aware Scheduling for Mobile Heterogeneous Inference Co-Execution

arXiv · AI, language, vision and robotics · article · Sep 13, 2026 · UTC

Modern mobile inference runs on heterogeneous platforms combining mobile GPUs with multiple CPU core clusters. Existing optimizations typically exploit either inter-operator parallelism, by assigning entire operators to CPU cores or to the GPU, or intra-operator parallelism, by partitioning each operator for CPU-GPU co-execution. We consider these two forms of parallelism together, to improve inference latency of tasks that can be represented by a static DAG of operators with predefined input/output tensor shapes (e.g., CNNs or vision transformers). We define the problem of partition-aware DAG

Read original source ↗ Open in workspace

recordType

paper

region

Global