Surface reconstruction from point clouds

Graphs
ML
GDL
Author

Rana Hanocka

Rana Hanocka

Rana Hanocka is a Ph.D. candidate at Tel Aviv University under the supervision of Daniel Cohen-Or and Raja Giryes. Rana obtained an M.Sc. in Electrical Engineering from Tel Aviv University and a B.Sc. in Electrical Engineering from Rensselaer Polytechnic Institute. Rana is the recipient of the Dan David Prize’s 2020 Scholarship in Artificial Intelligence, and was awarded the Outstanding Data Science Fellowship by Israel’s Council for Higher Education.

Project

In this project, we will take a closer look into surface reconstruction from point clouds. This project is a hands-on project in PyTorch. You will gain familiarity with 3D surface reconstruction and applying deep neural networks to meshes. The project is mainly focused on the Point2Mesh [1] technique, which optimizes the weights of a CNN to deform some initial mesh to shrink-wrap the input point cloud. You will apply this technique to scans and a wider variety of data in order to explore the current strengths and limitations of such a technique, and how it can be further improved. One interesting direction is to learn which edge to split, thereby defining where to add additional mesh connectivity. By the end of the project, you should better understand these topics from a theoretical and practical perspective, and gain insights with respect to how to incorporate similar concepts into your own research.

[1] Point2Mesh: A Self-Prior for Deformable Meshes. Rana Hanocka, Gal Metzer, Raja Giryes, and Daniel Cohen-Or. SIGGRAPH 2020.