英文标题:When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurors
作者:Cho-Ying Wu
arXiv ID:2609.09887 | 分类:cs.CL | 发表:2026-09-09
许可:CC-BY-SA
摘要 大语言模型(LLM)已被用于在专业场景中模拟人类决策,但其在普通法陪审团审判中的行为仍未被探索。我们研究被告的法庭陈述何时以及如何影响LLM模拟的陪审员,重点关注说服、意识形态偏见以及基于背景的亲和性。为支持该分析,我们提出了JuryBench,一个包含美国刑法中有争议刑事案件基准测试。{{NL}}在每个案件中,被告可以提出各种看似合理的正当理由,以支持无罪判决或减轻责任。{{NL}}我们固定基础案件,并设计具有不同背景的被告,他们作出带有不同情感诉求或反驳的法庭陈述。{{NL}}我们模拟了具有不同意识形态谱系的陪审员。{{NL}}我们考察了20个前沿LLM,共产生432K项裁决与理由,
LLMs have been used to simulate human decision-making in professional settings, yet their behaviors in common-law jury trials remain unexplored. We study when and how a defendant's courtroom statement affects LLM-simulated jurors, focusing on persuasion, ideological bias, and background-based affinity. To support the analysis, we introduce JuryBench, a benchmark containing controversial criminal cases in U.S. criminal law. In each case, a defendant can claim various plausible justifications to support acquittal or reduced liability. We fix the base case and design defendants of different backgrounds, who give courtroom statements with varying emotional appeal or rebuttal. Jurors with diverse ideological profiles across the spectrum are simulated. We examine 20 frontier LLMs, resulting in a total of 432K decisions and rationales, and quantify changes in verdict severity. Our findings show that LLM-jury simulation echoes many human-jury findings. First, emotional persuasion can be detrimental, since jurors may perceive it as evidence of guilt or inconsistency. Next, we show that background fit between jurors and defendants is a stronger and significant factor than other isolated factors, and that jurors are in general harsher toward opposite-background defendants and lenient toward same-background ones. Finally, we find that juror ideology also strongly shapes severity judgments. These findings highlight both the promise and risks of using LLMs to model jury reasoning and call for careful evaluation. The data and code are available at https://github.com/choyingw/JuryBench
查看完整双语翻译 →
正在跳转到翻译阅读页… 如果没有自动跳转,请点击这里。