Course Information

Course Description

Brief Description :

The goal of this course is an introduction and hands-on experience on latest mixed reality technology at the cross-section of 3D computer graphics and vision, human-machine interaction, as well as gaming technology.

Learning Goals :

After attending this course, students will: - Understand the foundations of 3D graphics, Computer Vision, and Human-Machine Interaction - Have a clear understanding of how to build mixed reality apps with a lot of hands-on experience - Have a good overview of state-of-the-art Mixed Reality

Prerequisites / Notice :

Prerequisites include: - Good programming skills (C# / C++ / Java, etc.) - Computer graphics/vision experience: Students should have taken, at a minimum, Visual Computing. Higher level courses are recommended, such as Introduction to Computer Graphics, 3D Vision, Computer Vision.

Related Courses :
Lecture Schedule :
Date Description
September 23 Introduction
September 30 Unity Tutorial, Device Handout, Project Assignments
October 07 Guest Speaker
October 14 Guest Speaker
October 21 Guest Speaker
October 28 Unity Tutorial
November 04 Guest Speaker
November 11 Midterm Presentations
November 18 Guest Speaker
November 25 Guest Speaker
December 02 Guest Speaker
December 09 Guest Speaker
December 16 Final Demos
Tutorials :

To get you started with developing mixed reality applications, we will host tutorials at the beginning of the semester. If you want to simultaneously implement the tutorial, you can install Unity for your OS. In case you have trouble with this or do not have access to a laptop, you can use one of the student labs which we will reserve for this purpose. The machines in the lab are all equipped with Windows and Unity. When there is no tutorial after the main lecture, students are highly encouraged to continue working on their projects. The TAs will be around in case you have questions to ask.

Student Projects :

Over the semester, students will work on a project related to a topic in Mixed Reality in collaboration with a supervisor. Students are required to form groups of 4. For this purpose, we will provide a list of project suggestions, but you are free to propose your own project.

The projects are first come first serve :

For your projects, we can make the following hardware available: - Microsoft HoloLens - Meta Quest - Oculus Rift - MagicLeap 2 - Aria Glasses - Mobile phone devices - iPad - Samsung Tablet - Webcams - Boston Dynamics Spot Robot

Students with project ideas that require any other special equipment, please talk to us!

Project Proposal :

Each student group is then required to hand in a project proposal by the announced deadlines. Make sure to talk to your assigned supervisor and discuss the project with them while planning your proposal. The template for the project proposal report can be found here.

The proposal should be 1-2 pages describing what you want to do in the project, and how you plan to achieve your envisioned results. A good idea is to identify the algorithmic and technical challenges within the project. Try to address each of them individually and explain your considered solutions; also make an attempt to think about alternatives if you believe a particular approach is unstable or likely to fail.

Midterm Presentations :

At this milestone, you present what you did so far so that you get feedback. You are encouraged to raise open questions. This is a possibility for us to steer the project and help you, as well as to get feedback from your fellow classmates.

Final Presentations :

They will be held as a regular presentation session. In addition, you are required to hand in a technical report for your project. The report format should be in parallel with CVPR paper format. Latex and Word templates can be found here.

Final demos will be held right after the end of the final presentations in a space nearby. More details on this will follow soon.

Semester Index