Particle.news
Download on the App Store

New 3D Gaussian Splatting Papers Advance Tracking, Expose Adversarial Weaknesses

Together the results spotlight training fixes alongside fresh security risks for real-time 3D reconstruction.

Overview

  • Two arXiv preprints on 3D Gaussian Splatting, posted Thursday, introduce a frequency-based tracking objective and reveal practical adversarial threats to feed-forward models.
  • SpectralSplats supervises renders in the frequency domain with global sinusoidal “Spectral Moments” and uses Frequency Annealing to shift from coarse alignment to fine detail.
  • By moving away from pixel-overlap losses that produce zero gradients when scenes are misaligned, the approach recovers stable updates even when the render and target do not overlap.
  • AdvSplat shows that pretrained, single-pass 3DGS can be derailed by imperceptible pixel changes using white-box attacks and two query-efficient black-box methods that optimize frequency-parameterized noise.
  • The authors present these as preprint results that need peer review, and the findings press for robustness research as fast 3D capture spreads to AR/VR, robotics, and commercial pipelines; a separate Apple study the same day reported a new perceptual loss preferred by human raters for crisper 3DGS renders.