Course Syllabus

The following syllabus is a tentative plan and is subject to change.

Date Topic Slides
August 29
Overview

  • Presentation Signup Link
  • Paper Presentation Upload
  • Project Presentation Upload

    		•
    September 5
    3D Perception I

  • Mask R-CNN
  • PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space

    		•
    September 12
  • Project Proposal Presentation
  • Introduction to Robot Simulations
  • Introduction to Deep Learning Frameworks
  • Project Proposal Slides Due on September 10

    		•
    September 19
    3D Perception II

  • DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation
  • NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis

    		•
    September 26
    Visual Modeling for Robot Control

  • Deep Visual Foresight for Planning Robot Motion
  • Fully Body Visual Self-Modeling of Robot Morphologies

    		•
    Otcober 3
    Multimodal Perception

  • More Than a Feeling: Learning to Grasp and Regrasp Using Vision and Touch
  • The Boombox: Visual Reconstruction from Acoustic Vibrations

    		•
    Otcober 10
    Mid-term Project Presentation

  • Mid-term Project Slides Submission Due on Otcober 8

    		•
    Otcober 17 Fall break, No class
    Otcober 24
    Self-Supervised Learning I

  • Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hours
  • QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation

    		•
    Otcober 31
    Self-Supervised Learning II

  • Time-Contrastive Networks: Self-Supervised Learning from Video
  • Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulation

    		•
    November 7
    Reinforcement Learning I

  • Learning Synergies between Pushing and Grasping with Self-supervised Deep Reinforcement Learning
  • Learning Dexterous In-Hand Manipulation
    		•
    November 14
    Reinforcement Learning II

  • Learning Latent Plans from Play
  • Generative Adversarial Imitation Learning

    		•
    November 21 Thanksgiving, No class
    November 28
    Large Vision-Language Model for Robotics

  • Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language
  • Do As I Can, Not As I Say: Grounding Language in Robotic Affordances

    		•
    December 5
    Final Project Presentation

  • Final Project Presentation Slides Due on December 3
  • Final Project Report and Code Due on December 17

    		•