Files and links (1)
SubmittedOpen Access (License Unspecified), Open
Conference proceeding
Radiometric Scene Decomposition: Scene Reflectance, Illumination, and Geometry from RGB-D Images
PROCEEDINGS OF 2016 FOURTH INTERNATIONAL CONFERENCE ON 3D VISION (3DV), pp 305-313
01 Jan 2016
Abstract
Recovering the radiometric properties of a scene (i.e., the reflectance, illumination, and geometry) is a long-sought ability of computer vision that can provide invaluable information for a wide range of applications. Deciphering the radiometric ingredients from the appearance of a real-world scene, as opposed to a single isolated object, is particularly challenging as it generally consists of various objects with different material compositions exhibiting complex reflectance and light interactions that are also part of the illumination. We introduce the first method for radiometric decomposition of real-world scenes that handles those intricacies. We use RGB-D images to bootstrap geometry recovery and simultaneously recover the complex reflectance and natural illumination while refining the noisy initial geometry and segmenting the scene into different material regions. Most important, we handle real-world scenes consisting of multiple objects of unknown materials, which necessitates the modeling of spatially-varying complex reflectance, natural illumination, texture, interreflection and shadows. We systematically evaluate the effectiveness of our method on synthetic scenes and demonstrate its application to real-world scenes. The results show that rich radiometric information can be recovered from RGB-D images and demonstrate a new role RGB-D sensors can play for general scene understanding tasks.
Metrics
Details
- Title
- Radiometric Scene Decomposition: Scene Reflectance, Illumination, and Geometry from RGB-D Images
- Creators
- Stephen Lombardi - Drexel UniversityKo Nishino - Drexel UniversityIEEE
- Publication Details
- PROCEEDINGS OF 2016 FOURTH INTERNATIONAL CONFERENCE ON 3D VISION (3DV), pp 305-313
- Series
- International Conference on 3D Vision
- Publisher
- IEEE
- Number of pages
- 9
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- Computer Science
- Web of Science ID
- WOS:000391542200034
- Scopus ID
- 2-s2.0-85011260280
- Other Identifier
- 991019167664604721
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Web of Science research areas
- Engineering, Electrical & Electronic
- Imaging Science & Photographic Technology