The Next Frontier: Computer Vision on 3D data – with Or Litany, Sr. Research Scientist, Nvidia

Gil Elbaz hosts Or Litany, a senior research scientist at Nvidia. They discuss the impact of 3D on computer vision and where it’s going in the near future. As well, they talk about the impact of industry on academia and vice versa. Or speaks about the future of 3D generative models, NeRF and how multi-modal models are changing computer vision. Together, Gil and Or explore the best ways to succeed in the field of AI.

TOPICS & TIMESTAMPS

[0:34] Intro

[2:01] Starting his journey

[5:03] Heat transfer equation in graphics

[10:21] Multimodal changing Computer Vision

[17:47] Why is 3D Important?

[23:17] 3D Generative Models in the next years

[26:25] Neural Rendering

[29:39] Connection between images/video & 3D

[31:39] Temporal Data

[33:45] Autonomous Driving & Simulation

[36:27] Prof Leonidas Guibas

[41:56] NeRF & Editing 3D information

[46:02] Manipulation of 3D representations

[52:23]  Future of NeRF

[1:02:31] Google

[1:06:03] Meta [FAIR] experience

[1:09:57] Nvidia

[1:10:58] Sanya Fidler

[1:16:38] Consciousness

[1:21:31] Career Tips for Computer Vision Engineers

Or Litany:

LinkedIn

Google Scholar

Github

Interesting links:

Alex Bronstein

Angel Chang

Sanja Fidler

Leonidas Guibas

Judy Hoffman

Justin Johnson

Fei-Fei Li

Ameesh Makadia

Manolis Saava

Srinath Sridhar

Charles Ruizhongtai Qi

PointNet

Red-Black Tree

Nvidia

Two minute papers

The Three Body Problem

EG3D: Efficient Geometry-aware 3D Generative Adversarial Networks  

GUEST BIO

Our guest is Or Litany. Or Litany currently works as a senior research scientist at Nvidia. He earned his BSC in physics and mathematics from Hebrew University and his master’s degree from the Technion. After that, he went on to do his PhD at Tel Aviv University, where he worked on analyzing 3D data with graph neural networks under professor Alex Bronstein. For his postdoc, Or attended Stanford University studying under the legendary professor Leonidas Guibas, as well as working as part of FAIR, the research group of Meta, where he pushed the cutting edge of 3D data analysis. Or is an extremely accomplished researcher with research that focuses on 3D deep learning for scene understanding, point cloud analysis and shape analysis. In 2023, Or will be joining the Technion as an assistant professor.

ABOUT THE HOST

I’m Gil Elbaz, Co-founder and CTO of Datagen. In this podcast, I speak with interesting computer vision thinkers and practitioners. I ask the big questions that touch on the issues and challenges that ML and CV engineers deal with every day. On the way, I hope you uncover a new subject or gain

I’m Gil Elbaz, Co-founder and CTO of Datagen. In this podcast, I speak with interesting computer vision thinkers and practitioners. I ask the big questions that touch on the issues and challenges that ML and CV engineers deal with every day. On the way, I hope you uncover a new subject or gain a different perspective, as well as enjoying engaging conversation. It’s about much more than the technical processes – it’s about people, journeys, and ideas. Turn up the volume, insights inside.

You cannot copy content of this page

Add or Claim Your Profile

Submit the form below to add or claim an existing profile. 

Within 24 hours, we’ll review your request and connect you to your existing profile for full editing.