- ✅ Single-image input only
- 🎨 BRDF and visibility-aware relighting
- ⚡ Fast, compact and accurate
- 📊 Evaluated with real users
TL;DR
Creating realistic lighting in 3D virtual environments is key to making scenes feel immersive and lifelike. However, many current techniques depend on having multiple camera views or using complex neural rendering, which isn’t ideal for real-time or interactive settings. In this project, we introduce SV-GaSRelight, a new method that brings realistic lighting effects to 3D scenes using only a single image. Our main idea is to use people in the scene as natural "light detectors." Since modern AI models can accurately rebuild a 3D human body from just one photo, we take advantage of that to understand how light behaves in the scene. Once we have the 3D human model, we generate synthetic camera views and simulate how light interacts with surfaces using physics-inspired techniques. To capture lighting more effectively, we also use a neural-based light field representation. We tested our method against other techniques that need multiple camera views and found that our approach delivers similar visual results. We also ran a user study to check how realistic the relit scenes looked, and the feedback confirmed our method works well — all from just a single input image.
Step 1: Reconstruct 3D human from a single image using PSHuman model.
Step 2: Generate synthetic views with camera poses.
Step 3: Apply Relightable 3D Gaussian Splatting using BRDF + ray tracing + NeILF.
Overall User Preference
User preference distribution in the pairwise comparison study.
| Model | User Preference [%] |
|---|---|
|
Relightable 3DGaussian
[Gao et al. 2024] |
44.5% |
| SV-GaSRelight | 55.5% |
This study was carried out as part of the PREMIERE project ``Performing Arts in a new Area'', https://premiere-project.eu/, funded by HORIZON-CL2-2021-HERITAGE-000201-04 (grant number 101061303-PREMIERE).
@inproceedings{jamil2025sv,
title={SV-GaSRelight: Single-View Gaussian Splatting for 3D Human Relighting},
author={Jamil, Sonain and Muselet, Damien and Tr{\'e}meau, Alain and Colantoni, Philippe},
booktitle={Advanced Concepts for Intelligent Vision Systems: 22nd International Conference, ACIVS 2025, Tokyo, Japan, July 28--30, 2025, Proceedings},
organization={Springer Nature},
year={2025},
note={To appear}
}