SOURCE-LINKED INTELLIGENCE

ProbPlug: A Plugin Uncertainty Network for Reliable Confidence in LLM Binary Classification

arXiv · AI, language, vision and robotics · article · Sep 9, 2026 · UTC

Large language models (LLMs) have achieved strong performance across a broad range of classification settings, yet the reliability of their predictions remains a major obstacle to deployment in high-stakes scenarios. Although confidence estimation for LLMs has been widely studied, confidence calibration for LLM-based classification remains underexplored. We introduce ProbPlug, a lightweight confidence estimation framework for LLM-based binary classification, which predicts whether an output is correct using internal token features extracted from a frozen LLM. ProbPlug employs a self-attention

Read original source ↗ Open in workspace

recordType

paper

region

Global