触觉神经场:将触觉交互引入三维渲染场景
Haptic Neural Fields: Bringing Tactile Interactions to 3D Rendered Scenes
将神经场从纯视觉渲染扩展到触觉信号合成,为视觉研究者提供了一种以几何与交互动态为条件的隐式场建模思路,可用于多模态场景表示与交互式渲染。
原文依据 leverages a neural field representation conditioned on geometry information and interaction dynamics to synthesize material-specific vibrotactile signals
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论我们研究如何让三维场景具备交互性,并追问:在虚拟环境中触摸物体时,它们会有什么样的感觉?尽管神经场景表示已能实现很高的视觉真实感,但它们在建模物理交互方面仍显不足,例如用不同动作探索表面时所产生的振动模式。我们提出一个框架,学习场景、用户动作与触觉响应之间的对应关系,从而能够从三维场景中的模拟交互生成触觉信号。我们的方法利用以几何信息和交互动态为条件的神经场表示,合成与材质相关的振动触觉信号。实验表明,生成的信号能够可靠地传达材质属性与用户动作。这为实现具有真实触觉反馈的交互式、具备触觉感知的虚拟环境铺平了道路。项目主页见此处。
英文原文摘要 932 字符
We address the problem of making 3D scenes interactive by asking: what would objects feel like if touched in a virtual environment? While neural scene representations achieve high visual realism, they fall short in modeling physical interactions, such as the vibration patterns produced when surfaces are explored with different actions. We propose a framework that learns the correspondence between scene, user action, and haptic response, enabling the generation of tactile signals from simulated interactions in 3D scenes. Our approach leverages a neural field representation conditioned on geometry information and interaction dynamics to synthesize material-specific vibrotactile signals. Experiments show that the generated signals reliably convey both material properties and the user action. This paves the way toward interactive, touch-aware virtual environments with realistic haptic feedback. Project page available here.