底层视觉与图像复原 · CVPR2026 ·2026.06.03

Lumosaic:基于主动照明与编码曝光像素的高光谱视频

Lumosaic: Hyperspectral Video via Active Illumination and Coded-Exposure Pixels

Dhruv Verma、Andrew Qiu、Roberto Rangel、Ayandev Barman、Hao Yang、Chenjia Hu 等 11 人

与你有关的部分

把可编程窄带 LED 阵列与编码曝光像素(CEP)相机同步,在单帧内联合编码空间-时间-光谱信息,再用学习式重建恢复 31 通道高光谱视频;这套「主动照明 + 亚帧曝光编码 + 学习重建」的采集-重建联合设计,可为快照式光谱成像、动态场景计算成像提供可复用的硬件编码与重建思路。

原文依据 combines a programmable narrowband LED array with a coded-exposure-pixel (CEP) camera capable of high-speed pixel-wise exposure
可迁移到 高光谱图像重建快照式光谱成像计算成像视频复原

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

本文提出 Lumosaic,一种面向动态场景实时采集的紧凑型主动高光谱视频系统。该方法将可编程窄带 LED 阵列与具备高速逐像素曝光能力的编码曝光像素(CEP)相机相结合,从而在每一视频帧内实现场景信息在空间、时间与波长上的联合编码。与被动快照系统不同——后者将光同时分配到多个光谱通道,并假设一帧曝光期间场景无运动——Lumosaic 主动同步照明与亚帧曝光,以提升光子利用率并在运动条件下保持光谱保真度。随后,基于学习的重建流程可恢复 30 fps、VGA 分辨率的 31 通道(400–700 nm)高光谱视频,产生时序连贯且光谱准确的重建结果。在合成基准与真实动态场景上的实验表明,相较于现有快照式高光谱成像系统,Lumosaic 显著提升了重建保真度与时序稳定性,可在多种材料与运动条件下实现稳健的高光谱视频采集。

英文原文摘要 1159 字符

We present Lumosaic, a compact active hyperspectral video system designed for real-time capture of dynamic scenes. Our approach combines a programmable narrowband LED array with a coded-exposure-pixel (CEP) camera capable of high-speed pixel-wise exposure, thereby enabling joint encoding of scene information across space, time, and wavelength within each video frame. Unlike passive snapshot systems that divide light across multiple spectral channels simultaneously and assume no motion during a frame's exposure, Lumosaic actively synchronizes illumination and sub-frame exposures to improve photon utilization and preserve spectral fidelity under motion. A learning-based reconstruction pipeline then recovers 31-channel hyperspectral (400-700 nm) video at 30 fps and VGA resolution, producing temporally coherent and spectrally accurate reconstructions. Experiments on synthetic benchmarks and real-world dynamic scenes demonstrate that Lumosaic significantly improves reconstruction fidelity and temporal stability over existing snapshot hyperspectral imaging systems, enabling robust hyperspectral video across diverse materials and motion conditions.

标签

会议 CVPR2026
页码 26761-26771
Bibkey
来源 CVF Open Access