SOURCE-LINKED INTELLIGENCE

Vibe Patenting: Evaluating LLM Judges for Professional Patent-Drafting Agents

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

LLM judges are increasingly used to evaluate and improve AI-generated outputs, yet their reliability for complex professional work remains unclear. We study this problem through Vibe Patenting, an end-to-end patent-drafting testbed for AI-agent evaluation. A separately-invoked LLM judge evaluates generated patent drafts and provides structured feedback for iterative revision. Across multiple inventions and drafting-agent configurations, judge-guided revision consistently improves judge-assessed quality, while unguided revision tends to saturate. Notably, iterative judge feedback enables a low-

Read original source ↗ Open in workspace

recordType

paper

region

Global