SV-GaSRelight: Single-View Gaussian Splatting for 3D Human Relighting

Université Jean Monnet Saint-Etienne, CNRS, Institut d'Optique Graduate School, Laboratoire Hubert Curien UMR 5516, F-42023, SAINT-ETIENNE, France
ACIVS 2025
⚠️ The experiment may take up to a minute to load if it's been idle.

TL;DR

  • ✅ Single-image input only
  • 🎨 BRDF and visibility-aware relighting
  • ⚡ Fast, compact and accurate
  • 📊 Evaluated with real users

Abstract

Creating realistic lighting in 3D virtual environments is key to making scenes feel immersive and lifelike. However, many current techniques depend on having multiple camera views or using complex neural rendering, which isn’t ideal for real-time or interactive settings. In this project, we introduce SV-GaSRelight, a new method that brings realistic lighting effects to 3D scenes using only a single image. Our main idea is to use people in the scene as natural "light detectors." Since modern AI models can accurately rebuild a 3D human body from just one photo, we take advantage of that to understand how light behaves in the scene. Once we have the 3D human model, we generate synthetic camera views and simulate how light interacts with surfaces using physics-inspired techniques. To capture lighting more effectively, we also use a neural-based light field representation. We tested our method against other techniques that need multiple camera views and found that our approach delivers similar visual results. We also ran a user study to check how realistic the relit scenes looked, and the feedback confirmed our method works well — all from just a single input image.

Relighting Demo

Relighting results across five scenes with different environment maps.

How It Works

SV-GaSRelight Pipeline

Step 1: Reconstruct 3D human from a single image using PSHuman model.

Step 2: Generate synthetic views with camera poses.

Step 3: Apply Relightable 3D Gaussian Splatting using BRDF + ray tracing + NeILF.

User Study Results

Overall User Preference

User preference distribution in the pairwise comparison study.

Model User Preference [%]
Relightable 3DGaussian
[Gao et al. 2024]
44.5%
SV-GaSRelight 55.5%

Acknowledgement

This study was carried out as part of the PREMIERE project ``Performing Arts in a new Area'', https://premiere-project.eu/, funded by HORIZON-CL2-2021-HERITAGE-000201-04 (grant number 101061303-PREMIERE).

BibTeX

@inproceedings{jamil2025sv,
  title={SV-GaSRelight: Single-View Gaussian Splatting for 3D Human Relighting},
  author={Jamil, Sonain and Muselet, Damien and Tr{\'e}meau, Alain and Colantoni, Philippe},
  booktitle={Advanced Concepts for Intelligent Vision Systems: 22nd International Conference, ACIVS 2025, Tokyo, Japan, July 28--30, 2025, Proceedings},
  organization={Springer Nature},
  year={2025},
  note={To appear}
}