英文标题：EVIS: Real-Time Event Camera Simulation with Multimodal Supervision in NVIDIA Isaac Sim
作者：Linli Shi, Ruijun Zhang, Ziyun Wang
arXiv ID：2607.08098 | 分类：cs.CV | 发表：2026-09-11
许可：CC-BY
摘要 事件相机具有微秒级时间分辨率、低延迟和高动态范围，使其在机器人领域具有吸引力。然而，针对特定机器人和场景的带标签事件相机数据稀缺且收集成本高昂，这阻碍了基于事件的感知与控制的发展。我们提出EVIS：一个面向NVIDIA Isaac Sim的物理基础事件相机插件，它直接在物理模拟器内部生成高帧率、完全标注的事件流。该插件实现了一个保真的对数强度对比事件模型，具有逐像素异步参考更新；它只需少量更改即可从普通RGB相机迁移，并集成到任何Isaac Sim / Isaac Lab场景中，继承模拟器的物理特性和逐帧完美真值。该插件完全可配置，并提供一种插值选项，仅渲染稀疏关键帧，并通过双向运动矢量
Event cameras are increasingly adopted in embodied perception for their microsecond temporal resolution, high dynamic range, and resilience to motion blur. However, training event-based models for robotics requires large-scale, action-conditioned data with dense physical annotations that are difficult to collect in the real world. We introduce EVIS, an open-source physics-grounded event simulator integrated into NVIDIA Isaac Sim that generates events from linear-HDR radiance from a closed-loop robot training episode. Rather than relying on learning-based video interpolation or expensive dense rendering, EVIS exploits renderer-provided motion vectors and depth maps through bi-directional warping and depth-based splatting. This enables high throughput, real-time, and high-fidelity event generation. We evaluate EVIS across runtime efficiency, sim-to-real transfer, and zero-shot model compatibility. A rotation-speed estimator trained solely on EVIS events achieves 2.75 rad/s MAE on real sensor data. Pretrained models for reconstruction, matching, and tracking perform competitively on EVIS events without any fine-tuning. EVIS sustains real-time generation across GPU-parallel environments on a single GPU. Code repository: https://github.com/spikelab-jhu/isaac-sim-event-camera-plugin.
查看完整双语翻译 →
正在跳转到翻译阅读页… 如果没有自动跳转，请点击这里。