Conference proceeding
TIGER: Time-Varying Denoising Model for 3D Point Cloud Generation with Diffusion Process
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 9462-9471
16 Jun 2024
Abstract
Recently, diffusion models have emerged as a new pow-erful generative method for 3D point cloud generation tasks. However, few works study the effect of the archi-tecture of the diffusion model in the 3D point cloud, re-sorting to the typical UNet model developed for 2D images. Inspired by the wide adoption of Transformers, we study the complementary role of convolution (from UNet) and attention (from Transformers). We discover that their respective importance change according to the timestep in the diffusion process. At early stage, attention has an out-sized influence because Transformers are found to generate the overall shape more quickly, and at later stages when adding fine detail, convolution starts having a larger im-pact on the generated point cloud's local surface quality. In light of this observation, we propose a time-varying two-stream denoising model combined with convolution lay-ers and transformer blocks. We generate an optimizable mask from each timestep to reweigh global and local features, obtaining time-varying fused features. Experimen-tally, we demonstrate that our proposed method quantitatively outperforms other state-of-the-art methods regarding visual quality and diversity. Code is avaiable https://github.com/Zhiyuan-R/Tiger-Diffusion.
Metrics
9 Record Views
4 citations in Scopus
Details
- Title
- TIGER: Time-Varying Denoising Model for 3D Point Cloud Generation with Diffusion Process
- Creators
- Zhiyuan Ren - Michigan State UniversityMinchul Kim - Michigan State UniversityFeng Liu - Michigan State UniversityFeng Liu - Drexel University, Computer Science (Computing)Xiaoming Liu - Michigan State University
- Publication Details
- 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 9462-9471
- Publisher
- IEEE
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- Computer Science (Computing)
- Scopus ID
- 2-s2.0-85208378294
- Other Identifier
- 991022008296304721