英文标题：Can AI Agents Detect and Repair Artifact Drift in Network Experiments?
作者：Tianzhu Zhang, Weichen Tao, Changgang Zheng, Yusheng Zheng, Long Chen, Xiaoyi Fan, Meikang Qiu
arXiv ID：2609.09849 | 分类：cs.NI | 发表：2026-09-09
许可：CC-BY
摘要。 近年来，AI 智能体已发展为能够在数字环境中执行多步骤任务的有能力的助手。网络系统社区正开始在运维与实验环境中探索这些能力。然而，在网络系统中运行的智能体不应仅以其是否完成当前任务来评判。它所修改的实验记录也必须保持可信。我们将这一性质称为制品完整性：记录中的主张必须始终得到现有证据的支持，限定在该证据所确立的范围内，并可通过编码其支持依据的制品进行追溯。 为使这一性质可度量，我们提出了 NetArtifactBench，它测试 AI 智能体能否修复源自公开网络系统制品的不一致记录，同时保留那些仍然得到支持的主张。该基准包含 52 个实例，注入的不一致性从直接矛盾到散布于多个制品中的未
In recent years, AI agents have evolved into capable assistants that carry out multi-step tasks in digital environments. The network systems community is beginning to explore these capabilities in operational and experimental settings. However, an agent operating in network systems should not be judged solely by whether it completes the immediate task. The experiment record it modifies must also remain trustworthy. We call this property artifact integrity: the record's claims must remain supported by the available evidence, confined to the scope established by that evidence, and traceable through the artifacts that encode their support. To make this property measurable, we introduce NetArtifactBench, which tests whether AI agents can repair inconsistent records derived from public network-system artifacts while preserving claims that remain supported. The benchmark contains 52 instances with injected inconsistencies ranging from direct contradictions to unstated relations spread across several artifacts. We evaluate 23 agent configurations across three general-purpose AI agent runtimes using deterministic scoring. The average contract pass rate is 65.3 % across 5,980 outputs, but no agent runtime exceeds 30 % when repair requires recovering implicit relations and propagating changes across artifacts. These results reveal a sharp boundary between local correction and complete record-level repair. Therefore, we argue that artifact integrity should become a first-class design and evaluation requirement for AI agents operating on network systems.
查看完整双语翻译 →
正在跳转到翻译阅读页… 如果没有自动跳转，请点击这里。