SGI:面向高效紧凑大图像表示的结构化二维高斯
SGI: Structured 2D Gaussians for Efficient and Compact Large Image Representation
将2D高斯泼溅从无结构基元转为种子驱动的结构化隐式表示,配合多尺度由粗到细拟合与种子级熵压缩,为高分辨率图像表示提供可复用的紧凑化与加速优化范式。
原文依据 SGI achieves up to 7.5xcompression over prior non-quantized 2D Gaussian methods and 1.6xover quantized ones, while also delivering 1.6xand 6.5xfaster optimization
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论二维高斯泼溅已成为一种新颖的图像表示技术,能够在低端设备上支持高效渲染。然而,扩展到高分辨率图像需要独立优化和存储数百万个无结构高斯基元,导致收敛缓慢和参数冗余。为此,我们提出结构化高斯图像(SGI),一种用于表示高分辨率图像的紧凑高效框架。SGI将复杂图像分解为由一组种子定义的多尺度局部空间。每个种子对应一个空间连贯区域,并与轻量级多层感知机(MLP)一起生成结构化的隐式二维神经高斯。这种基于种子的公式为原本无结构的高斯基元施加了结构规律性,有助于在种子级别进行基于熵的压缩以减少总存储。然而,直接在高分辨率图像上优化种子参数是一项具有挑战性且非平凡的任务。因此,我们设计了一种多尺度拟合策略,以由粗到细的方式细化种子表示,大幅加速收敛。定量和定性评估表明,SGI相比先前非量化二维高斯方法实现了高达7.5倍的压缩,相比量化方法实现了1.6倍的压缩,同时分别带来1.6倍和6.5倍的优化加速,且不降低图像保真度,通常还有所提升。代码见 https://github.com/zx-pan/SGI。
英文原文摘要 1521 字符
2D Gaussian Splatting has emerged as a novel image representation technique that can support efficient rendering on low-end devices. However, scaling to high-resolution images requires optimizing and storing millions of unstructured Gaussian primitives independently, leading to slow convergence and redundant parameters. To address this, we propose Structured Gaussian Image (SGI), a compact and efficient framework for representing high-resolution images. SGI decomposes a complex image into multi-scale local spaces defined by a set of seeds. Each seed corresponds to a spatially coherent region and, together with lightweight multi-layer perceptrons (MLPs), generates structured implicit 2D neural Gaussians. This seed-based formulation imposes structural regularity on otherwise unstructured Gaussian primitives, which facilitates entropy-based compression at the seed level to reduce the total storage. However, optimizing seed parameters directly on high-resolution images is a challenging and non-trivial task. Therefore, we designed a multi-scale fitting strategy that refines the seed representation in a coarse-to-fine manner, substantially accelerating convergence. Quantitative and qualitative evaluations demonstrate that SGI achieves up to 7.5xcompression over prior non-quantized 2D Gaussian methods and 1.6xover quantized ones, while also delivering 1.6xand 6.5xfaster optimization, respectively, without degrading, and often improving, image fidelity. Code is available at https://github.com/zx-pan/SGI.