基于事件的视觉形变测量
Event-based Visual Deformation Measurement
将事件流的时间稠密运动线索与帧的空间稠密估计融合,并用分片线性化(AIS)与邻域贪心优化抑制稀疏噪声事件带来的运动歧义和长期跟踪误差累积,为高动态场景下的稠密对应与形变跟踪提供了可复用范式。
原文依据 We propose an event-frame fusion framework that exploits events for temporally dense motion cues and frames for spatially dense precise estimation.
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论视觉形变测量(VDM)旨在通过跟踪相机观测中的表面运动来恢复稠密形变场。传统基于图像的方法依赖较小的帧间运动来约束对应搜索空间,这限制了其在高动态场景中的适用性,或需要以高昂的存储与计算开销为代价使用高速相机。我们提出一种事件-帧融合框架,利用事件提供时间上稠密的运动线索,利用帧提供空间上稠密的精确估计。重新审视固体弹性建模先验,我们提出仿射不变单纯形(AIS)框架。它将形变场划分为具有低参数表示的线性化子区域,有效缓解由稀疏且含噪事件引起的运动歧义。为加速优化并减少误差累积,引入邻域贪心优化策略,使已良好收敛的子区域引导其收敛较差的邻居,从而有效抑制长期稠密跟踪中的局部误差累积。为评估所提方法,建立了一个时间对齐的事件流与帧的基准数据集,涵盖超过120个序列,跨越多种形变场景。实验结果表明,我们的方法在存活率上比最优基线高出1.6倍。值得注意的是,它仅使用高速视频方法18.9%的数据存储与处理资源即实现了这一结果。
英文原文摘要 1520 字符
Visual Deformation Measurement (VDM) aims to recover dense deformation fields by tracking surface motion from camera observations. Traditional image-based methods rely on minimal inter-frame motion to constrain the correspondence search space, which limits their applicability to highly dynamic scenes or necessitates high-speed cameras at the cost of prohibitive storage and computational overhead. We propose an event-frame fusion framework that exploits events for temporally dense motion cues and frames for spatially dense precise estimation. Revisiting the solid elastic modeling prior, we propose an Affine Invariant Simplicial (AIS) framework. It partitions the deformation field into linearized sub-regions with low-parametric representation, effectively mitigating motion ambiguities arising from sparse and noisy events. To speed up optimization and reduce error accumulation, a neighborhood-greedy optimization strategy is introduced, enabling well-converged sub-regions to guide their poorly-converged neighbors, effectively suppress local error accumulation in long-term dense tracking. To evaluate the proposed method, a benchmark dataset with temporally aligned event streams and frames is established, encompassing over 120 sequences spanning diverse deformation scenarios. Experimental results show that our method outperforms the state-of-the-art baseline by 1.6x in survival rate. Remarkably, it achieves this using only 18.9% of the data storage and processing resources of high-speed video methods.