SOURCE-LINKED INTELLIGENCE

HarvestBench: Measuring Whether LLM Agents Will Pay to Avoid Killing Animals

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

HarvestBench is the first benchmark to 1) put a price on avoiding a side effect and 2) name the side effect as a living creature. Nine LLMs each drive a crew of two tractors to gather a corn harvest. The animals in their path are not part of the goal function. When an animal blocks the route the autopilot pauses and asks the agent whether to drive over it for free or swerve for a given fuel cost. All scoring is programmatic and does not involve LLM judges. Kill rates range between 0.4% and 98.8%, though the kill rate is not ordered by capability. Every model competently avoids damaging rock hi

Read original source ↗ Open in workspace

recordType

paper

region

Global