SOURCE-LINKED INTELLIGENCE

Enhanced Knowledge Distillation for Detection Transformer via Teacher Prediction Refinement

arXiv · AI, language, vision and robotics · article · Sep 17, 2026 · UTC

Detection Transformers (DETRs) achieve strong performance in object detection but remain challenging to deploy on edge devices due to their high computational cost. Existing DETR distillation methods mainly focus on aligning distillation points, while largely overlooking the quality of the teacher's supervision itself. We observe that due to stage-wise non-monotonic prediction behavior in DETRs, well-localized or correctly classified predictions from earlier stages may degrade in later ones, and some negative predictions become increasingly overconfident. As a result, relying solely on the cur

Read original source ↗ Open in workspace

recordType

paper

region

Global