The Next Frontier: Computer Vision on 3D data – with Or Litany, Sr. Research Scientist, Nvidia
Gil Elbaz hosts Or Litany, a senior research scientist at Nvidia. They discuss the impact of 3D on computer vision and where it’s going in the near future. As well, they talk about the impact of industry on academia and vice versa. Or speaks about the future of 3D generative models, NeRF and how multi-modal models are changing computer vision. Together, Gil and Or explore the best ways to succeed in the field of AI.
TOPICS & TIMESTAMPS
[0:34] Intro
[2:01] Starting his journey
[5:03] Heat transfer equation in graphics
[10:21] Multimodal changing Computer Vision
[17:47] Why is 3D Important?
[23:17] 3D Generative Models in the next years
[26:25] Neural Rendering
[29:39] Connection between images/video & 3D
[31:39] Temporal Data
[33:45] Autonomous Driving & Simulation
[36:27] Prof Leonidas Guibas
[41:56] NeRF & Editing 3D information
[46:02] Manipulation of 3D representations
[52:23] Future of NeRF
[1:02:31] Google
[1:06:03] Meta [FAIR] experience
[1:09:57] Nvidia
[1:10:58] Sanya Fidler
[1:16:38] Consciousness
[1:21:31] Career Tips for Computer Vision Engineers
Or Litany:
Interesting links:
EG3D: Efficient Geometry-aware 3D Generative Adversarial Networks
GUEST BIO
Our guest is Or Litany. Or Litany currently works as a senior research scientist at Nvidia. He earned his BSC in physics and mathematics from Hebrew University and his master’s degree from the Technion. After that, he went on to do his PhD at Tel Aviv University, where he worked on analyzing 3D data with graph neural networks under professor Alex Bronstein. For his postdoc, Or attended Stanford University studying under the legendary professor Leonidas Guibas, as well as working as part of FAIR, the research group of Meta, where he pushed the cutting edge of 3D data analysis. Or is an extremely accomplished researcher with research that focuses on 3D deep learning for scene understanding, point cloud analysis and shape analysis. In 2023, Or will be joining the Technion as an assistant professor.
ABOUT THE HOST
I’m Gil Elbaz, Co-founder and CTO of Datagen. In this podcast, I speak with interesting computer vision thinkers and practitioners. I ask the big questions that touch on the issues and challenges that ML and CV engineers deal with every day. On the way, I hope you uncover a new subject or gain
I’m Gil Elbaz, Co-founder and CTO of Datagen. In this podcast, I speak with interesting computer vision thinkers and practitioners. I ask the big questions that touch on the issues and challenges that ML and CV engineers deal with every day. On the way, I hope you uncover a new subject or gain a different perspective, as well as enjoying engaging conversation. It’s about much more than the technical processes – it’s about people, journeys, and ideas. Turn up the volume, insights inside.