BiGS can relight objects with both near-field lights and distant light, and applies to objects of both surface-based and volumetric materials including subsurface scattering, iridescent reflection, and fuzzy surface.
The radiance is intrinsically decomposed into four components, from left to right, diffuse scattering, directional scattering, direct light transport, and indirect light transport. OLAT datasets are used to optimize the components for physical plausible decomposition results.
Relight with a point light with varying distance, and view with a moving camera. When the light gets nearer, the object gets more lit.
BiGS also supports relighting using an environment map.
We demonstrate our method on capture data as well.
We thank the authors and contributors of gsplat
and nerfstudio
for developing these open-source projects; Jeremy Chew and Rafael Bischof for their feedback on the manuscript;
Sergej Majboroda, Andreas Mischok, Oliksiy Yakovlyev, Jarod Guest and Dimitrios Savva for releasing their HDRI images into public domain which are used as environment maps in this project.
@misc{zhenyuan2024bigs,
title={BiGS: Bidirectional Gaussian Primitives for Relightable 3D Gaussian Splatting},
author={Liu Zhenyuan and Yu Guo and Xinyuan Li and Bernd Bickel and Ran Zhang},
year={2024},
eprint={2408.13370},
url={https://arxiv.org/abs/2408.13370}
}