Lecture Series in Intelligent Perception and Computing
题 目 （TITLE）：Learning to Recover 3D Scene Shape from Single monocular Images
讲 座 人 （SPEAKER）: 沈春华 教授，The University of Adelaide
主 持 人 (CHAIR)：张兆翔 研究员
时 间 (TIME)：2021年4月2日（周五），15：00
地 点 (VENUE)： 腾讯会议ID: 569 713 081 Password: 2021
Despite significant progress in monocular depth estimation in the wild, recent state-of-the-art methods cannot be used to recover accurate 3D scene shape due to an unknown depth shift induced by shift-invariant reconstruction losses used in mixed-data depth prediction training, and possible unknown camera focal length. We investigate this problem in detail, and propose a two-stage framework that first predicts depth up to an unknown scale and shift from a single monocular image, and then use 3D point cloud encoders to predict the missing depth shiftA and focal length that allow us to recover a realistic 3D scene shape. In addition, we propose an image-level normalized regression loss and a normal-based geometry loss to enhance depth prediction models trained on mixed datasets. We test our depth model on nine unseen datasets and achieve state-of-the-art performance on zero-shot dataset generalization.
Professor Shen has been a Full Professor of Computer Science at The University of Adelaide since 2014, and Founding Director of the Machine Learning Theory theme at the Australian Institute for Machine Learning. His research mainly focuses on Machine Learning and Computer Vision. He was recognised as a top 5 researcher for Engineering and Computer Sciences as part of The Australian’s Life time Achievement Leaderboard (Sept. 2020, https://specialreports.theaustralian.com.au/1540291/9/), which is an exceptional achievement. He has supervised over 20 PhD students to completion. His student alumni include two Australian Research Council DECRA fellows and additional graduates who are now in tenured or tenure track roles in Universities including the University of Adelaide, Sydney University, Monash University, Wollongong University, Nanyang Technological University Singapore, and quite a few other universities in China.