Reality Lab Lectures: Ben Poole - 2D Priors for 3D Generation скачать в хорошем качестве

Reality Lab Lectures: Ben Poole - 2D Priors for 3D Generation

The Reality Lab Lectures - Tuesday, January 31, 2023 TALK TITLE: 2D Priors for 3D Generation SPEAKER: Ben Poole (Research Scientist @ Google Brain) TALK ABSTRACT: Large scale datasets of images with text descriptions have enabled powerful models that represent and generate pixels. But progress in 3D generation has been slow due to the lack of 3D data and efficient architectures. In this talk, I’ll present DreamFields and DreamFusion: two approaches that enable 3D generation from 2D priors using no 3D data. By turning 2D priors into loss functions, we can optimize 3D models (NeRFs) from scratch via gradient descent. These methods enable high-quality generation of 3D objects from diverse text prompts. Finally, I’ll discuss a fundamental problem with our approach and how continued progress on pixel-space priors like Imagen Video can unlock new 3D capabilities. RECORDING: Event held over videoconference and recorded by UW CSE Production Team © UW Reality Lab, 2023 http://realitylab.uw.edu