BiGS: Bidirectional Gaussian Primitives for Relightable 3D Gaussian Splatting

Teaser
Liu Zhenyuan1,3 Yu Guo2 Xinyuan Li1 Bernd Bickel3,4 Ran Zhang1
1Tencent PCG, USA 2George Mason University, USA 3ETH Zurich, Switzerland 4ISTA, Austria
Arxiv (to appear at 3D Vision 2025)

BiGS can relight objects with both near-field lights and distant light, and applies to objects of both surface-based and volumetric materials including subsurface scattering, iridescent reflection, and fuzzy surface.

Intrinsic Decomposition

diffuse scattering directional scattering direct light indirect light reference rendering

The radiance is intrinsically decomposed into four components, from left to right, diffuse scattering, directional scattering, direct light transport, and indirect light transport. OLAT datasets are used to optimize the components for physical plausible decomposition results.

Point Light Relighting

translucency fur iridescence

Relight with a point light with varying distance, and view with a moving camera. When the light gets nearer, the object gets more lit.

Environment Map Relighting

BiGS also supports relighting using an environment map.

We demonstrate our method on capture data as well.

Acknowledgments

We thank the authors and contributors of gsplat and nerfstudio for developing these open-source projects; Jeremy Chew and Rafael Bischof for their feedback on the manuscript; Sergej Majboroda, Andreas Mischok, Oliksiy Yakovlyev, Jarod Guest and Dimitrios Savva for releasing their HDRI images into public domain which are used as environment maps in this project.

Citation

@misc{zhenyuan2024bigs,
     title={BiGS: Bidirectional Gaussian Primitives for Relightable 3D Gaussian Splatting}, 
     author={Liu Zhenyuan and Yu Guo and Xinyuan Li and Bernd Bickel and Ran Zhang},
     year={2024},
     eprint={2408.13370},
     url={https://arxiv.org/abs/2408.13370}
 }