TIGeR:时间、图像与地理位置检索的统一框架
TIGER: A Unified Framework for Time, Images and Geo-location Retrieval
TIGeR 用同一套表征同时完成地理定位、拍摄时间预测与「同地异时」图像检索,其核心思路是在外观剧烈变化下保持地点身份不变——这对做跨视角/跨季节地点识别、以及需要把时间作为检索条件的视觉检索系统,提供了一个可复用的多模态查询接口与训练范式。
原文依据 By preserving the underlying location identity despite large appearance changes, TIGeR enables retrieval based on where and when a scene was captured
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论数字取证、城市监测与环境分析中的许多现实应用需要联合推理视觉外观、位置与时间。除标准的地理定位与拍摄时间预测之外,这些应用日益需要更复杂的能力,例如检索与查询图像拍摄于同一地点、但处于指定目标时间的图像。我们将该问题形式化为地理-时间感知图像检索,并提出 TIGeR——一个用于时间、图像与地理位置检索的统一框架。TIGeR 支持灵活的输入配置(单模态与多模态查询),并使用同一表征执行 (i) 地理定位、(ii) 拍摄时间预测与 (iii) 地理-时间感知检索。通过在外观剧烈变化下仍保持底层地点身份,TIGeR 使检索能够基于场景被拍摄的地点与时间,而非仅基于视觉相似性。为支撑该任务,我们设计了多阶段数据整理流程,并提出一个新的多样化数据集,包含 450 万对用于训练的图像-位置-时间三元组,以及 8.6 万条用于评估的高质量三元组。大量实验表明,TIGeR 一致优于强基线方法与最优方法,在年内时间预测上最高提升 16%、在日内时间预测上最高提升 8%、在地理-时间感知检索召回上最高提升 14%,凸显了统一地理-时间建模的优势。
英文原文摘要 1440 字符
Many real-world applications in digital forensics, urban monitoring, and environmental analysis require jointly reasoning about visual appearance, location, and time. Beyond standard geo-localization and time-of-capture prediction, these applications increasingly demand more complex capabilities, such as retrieving an image captured at the same location as a query image but at a specified target time. We formalize this problem as Geo-Time Aware Image Retrieval and propose TIGeR, a unified framework for Time, Images and Geo-location Retrieval. TIGeR supports flexible input configurations (single-modality and multi-modality queries) and uses the same representation to perform (i) geo-localization, (ii) time-of-capture prediction, and (iii) geo-time-aware retrieval. By preserving the underlying location identity despite large appearance changes, TIGeR enables retrieval based on where and when a scene was captured, rather than purely on visual similarity. To support this task, we design a multistage data curation pipeline and propose a new diverse dataset of 4.5M paired image-location-time triplets for training and 86k high-quality triplets for evaluation. Extensive experiments show that TIGeR consistently outperforms strong baselines and state-of-the-art methods by up to 16% on time-of-year, 8% time-of-day prediction, and 14% in geo-time aware retrieval recall, highlighting the benefits of unified geo-temporal modeling.