SOURCE-LINKED INTELLIGENCE

Controllable Image Captioning with Prompt-Conditioned Scene Rewards

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Large Vision-Language Models produce fluent image descriptions but offer limited semantic control: users cannot reliably specify whether captions should emphasize attributes, relations, or particular image regions. We present Fine-grained Captioning Control Using Scene Rewards (FoCUS), a controllable image captioning method that lets users steer captions toward specific semantic emphases through natural-language control prompts. The core idea is a prompt-conditioned control objective based on scene-graph-aligned component scores. Generated captions are parsed and aligned to scene-graph compone

Read original source ↗ Open in workspace

recordType

paper

region

Global