雷达引导的多项式拟合用于度量深度估计
Radar-Guided Polynomial Fitting for Metric Depth Estimation
对做单目深度估计的人,这篇给出一个轻量后处理思路:用廉价雷达预测多项式系数,把无尺度 MDE 输出非均匀地映射到度量深度,并用一阶导数正则保证局部单调,可直接替换常见的线性 scale-shift 对齐。
原文依据 we use polynomial coefficients predicted from cheap, ubiquitous radar data to adaptively adjust predictions non-uniformly across depth ranges
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论我们提出 POLAR,一种新的雷达引导深度估计方法,引入多项式拟合,将预训练单目深度估计(MDE)模型输出的无尺度深度预测高效地转换为度量深度图。与依赖复杂架构或昂贵传感器的现有方法不同,我们的方法基于一个基本观察:MDE 模型通常能在每个物体或局部区域内推断出合理的局部深度结构,但这些区域之间的相对位置可能发生错位,当这类区域达到三个或更多时,仅靠线性缩放与平移(仿射)变换不足以校正。为解决这一局限,我们利用由廉价且广泛可得的雷达数据预测出的多项式系数,在不同深度范围内对预测进行自适应的非均匀调整。由此,POLAR 超越了仿射变换,能够通过引入拐点来校正上述错位。重要的是,我们的多项式拟合框架通过一种新的训练目标保持结构一致性,该目标借助一阶导数正则强制局部单调性。POLAR 在三个数据集上取得最优性能,MAE 平均优于现有方法 24.9%,RMSE 平均优于 33.2%,同时在延迟和计算开销方面也达到最优效率。
英文原文摘要 1360 字符
We propose POLAR, a novel radar-guided depth estimation method that introduces polynomial fitting to efficiently transform scaleless depth predictions from pretrained monocular depth estimation (MDE) models into metric depth maps. Unlike existing approaches that rely on complex architectures or expensive sensors, our method is grounded in a fundamental insight: although MDE models often infer reasonable local depth structure within each object or local region, they may misalign these regions relative to one another, making a linear scale and shift (affine) transformation insufficient given three or more of these regions. To address this limitation, we use polynomial coefficients predicted from cheap, ubiquitous radar data to adaptively adjust predictions non-uniformly across depth ranges. In this way, POLAR generalizes beyond affine transformations and is able to correct such misalignments by introducing inflection points. Importantly, our polynomial fitting framework preserves structural consistency through a novel training objective that enforces local monotonicity via first-derivative regularization. POLAR achieves state-of-the-art performance across three datasets, outperforming existing methods by an average of 24.9% in MAE and 33.2% in RMSE, while also achieving state-of-the-art efficiency in terms of latency and computational cost.