Robust3DGSW:面向量化感知3D高斯泼溅的鲁棒水印
Robust3DGSW: Toward Robust Watermarking for Quantization-Aware 3D Gaussian Splatting
针对量化后的3DGS模型,提出将水印嵌入3D高斯参数与2D渲染图像的中频带,并利用多尺度对抗扰动训练2D/3D解码器,为3DGS版权保护提供可复用方案。
原文依据 By properly embedding watermarks into the mid-frequency bands of both the 3D Gaussian parameters and 2D rendered images
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论当前针对3D高斯泼溅(3DGS)的水印技术虽然在保护3DGS模型及其渲染图像的版权方面展现出潜力,但当对大型3DGS模型进行量化以适应资源受限设备时,这些技术面临水印鲁棒性低和渲染质量差的严重问题。为解决这些问题,本文提出了一种新颖的两阶段量化感知3DGS水印方法Robust3DGSW。通过将水印恰当地嵌入到3D高斯参数和2D渲染图像的中频带,Robust3DGSW的第一阶段能够有效抵消量化引起的信号损失,并减轻水印对渲染图像的不利影响。在第二阶段,Robust3DGSW利用我们提出的多尺度对抗扰动方法,结合渐进量化过程,训练2D和3D解码器,从而即使在过度量化下也能实现鲁棒的水印提取。在著名的Blender、LLFF和MipNeRF-360数据集上获得的全面实验结果表明,与领先的3DGS水印技术相比,Robust3DGSW不仅减轻了量化对水印的负面影响,还实现了高质量快速渲染。
英文原文摘要 1304 字符
Although current watermarking techniques for 3D Gaussian Splatting (3DGS) are promising in protecting the copyrights of both 3DGS models and their rendered images, they greatly suffer from low watermark robustness and poor rendering quality when applying quantization to large 3DGS models to accommodate resource-limited devices. To address these problems, this paper introduces a novel two-stage quantization-aware 3DGS watermarking approach called Robust3DGSW. By properly embedding watermarks into the mid-frequency bands of both the 3D Gaussian parameters and 2D rendered images, the first stage of Robust3DGSW can effectively counteract the quantization-induced signal loss and mitigate the adverse effects of watermarks on rendered images. In the second stage, Robust3DGSW trains both 2D and 3D decoders using our proposed multi-scale adversarial perturbation approach, alongside a gradual quantization process, which enables robust watermark extraction even under excessive quantization. Comprehensive experimental results obtained from the well-known Blender, LLFF, and MipNeRF-360 datasets demonstrate that, when compared to leading 3DGS watermarking techniques, Robust3DGSW not only mitigates the negative effects of quantization on watermarks but also enables fast rendering with high quality.