Deep Learning for 3D Data

CSE291 (E00) - Fall 2022


Slides from 2021 Winter (Old, link)


Slides of 2022 Fall (Ongoing)


Section 1

Theories of Geometry

9/22, 9/27
Intro, Curve Theory, PDF (2022 ver), Annotated PDF (2021 ver) overview of the course, logistics, curve theory
9/29
Surface Theory differential map, normal curvature, principal curvature
10/4
Surface Theory (II) shape operator, first fundamental form, isometry, fundamental theorem of surfaces
10/6, 10/11
Mesh and Point Cloud polygonal mesh, point cloud
10/13
Rotation and SO(3) rotation matrix, euler angle, angle-axis, quaternion

Section 2

3D Deep Learning

Section 2.1

3D Reconstruction

10/18, 10/20
Learning-based MVS learning-based MVS, NeRF
10/25
State-of-the-art Neural 3D Capturing MVSNeRF, NeRFusion, TensoRF
10/27
Single Image to 3D EMD, Chamfer, mesh deformation

Section 2.2

3D Data Understanding

11/1
3D Backbone Networks Volumetric CNN, PointNet
11/3
3D Detection Frustum PointNet, PointPillar, VoteNet
11/8
6D Pose Estimation ICP, Umeyama's method, direct method
11/15
6D Pose Estimation (II) indirect approach, DenseFusion, PVN3D, NOCS
11/17
Intrinsics-based Analysis geodesic distance, dijkstra's algorithm for geodesics, learning-based method for geodesics, applications
11/22
Guest lecture by Kaichun Mo 3D affordance, object manipulation
11/24
Thanksgiving No class

Section 2.3

Structured 3D Learning

11/29
Deformation Models surface deformation, space deformation, skeleton skinning
12/1
Mesh Processing misc mesh processing problems and a brief intro to the course next quarter