Course Information

Course Description

Brief Description :

The goal of this course is an introduction and hands-on experience on latest mixed reality technology at the cross-section of 3D computer graphics and vision, human-machine interaction, as well as gaming technology.

Learning Goals :

After attending this course, students will: - Understand the foundations of 3D graphics, Computer Vision, and Human-Machine Interaction - Have a clear understanding of how to build mixed reality apps with a lot of hands-on experience - Have a good overview of state-of-the-art Mixed Reality

Prerequisites / Notice :

Prerequisites include: - Good programming skills (C# / C++ / Java, etc.) - Computer graphics/vision experience: Students should have taken, at a minimum, Visual Computing. Higher level courses are recommended, such as Introduction to Computer Graphics, 3D Vision, Computer Vision.

Related Courses :
Deadlines :
Deadline Description
September 25 Group formation and project selection
October 08, 23:59 Project proposal report and slides due
October 09 Project proposal presentations
November 05, 23:59 Midterm project report and slides due
November 06 Midterm presentations
December 17, 23:59 Final project presentation poster due
December 18 Final project poster session and demo
January 08, 23:59 Final project reports due

All the online submission deadlines are due by 23:59 on the specified date.

Tutorials :

To get you started with developing mixed reality applications, we will host tutorials at the beginning of the semester. These will take place in CAB G 11 after the main lectures. If you want to simultaneously implement the tutorial, you can install Unity for your OS. In case you have trouble with this or do not have access to a laptop, you can use the student lab CAB H 56, which has been reserved for this purpose. We will be live-streaming the tutorials there (the room has 24 seats). The machines in the lab are all equipped with Windows and Unity. When there is no tutorial after the main lecture, students are highly encouraged to continue working on their projects. The TAs will be around in case you have questions to ask.

Student Projects :

Over the semester, students will work on a project related to a topic in Mixed Reality in collaboration with a supervisor. Students are required to form groups of 4. For this purpose, we will provide a list of project suggestions, but you are free to propose your own project.

The projects are first come first serve :

For your projects, we can make the following hardware available: - Microsoft HoloLens - Meta Quest - Oculus Rift - MagicLeap 2 - Aria Glasses - Mobile phone devices - iPad - Samsung Tablet - Webcams - Boston Dynamics Spot Robot

Students with project ideas that require any other special equipment, please talk to us!

Project Proposal :

Each student group is then required to hand in and present a project proposal by the announced deadlines. Make sure to talk to your assigned supervisor and discuss the project with them while planning your proposal. Each team will present their project proposal during a designated lecture. The template for the project proposal report can be found here.

The proposal should be 1-2 pages describing what you want to do in the project, and how you plan to achieve your envisioned results. A good idea is to identify the algorithmic and technical challenges within the project. Try to address each of them individually and explain your considered solutions; also make an attempt to think about alternatives if you believe a particular approach is unstable or likely to fail.

Midterm Presentations :

At this milestone, you present what you did so far so that you get feedback. You are encouraged to raise open questions. This is a possibility for us to steer the project and help you, as well as to get feedback from your fellow classmates. In addition, you are required to submit a 2-page report that identifies your current status, problems you have identified, and your next steps.

Final Presentations :

They will be held as a regular presentation session. In addition, you are required to hand in a technical report for your project. The report format should be in parallel with CVPR paper format. Latex and Word templates can be found here.

Final demos will be held right after the end of the final presentations in a space nearby. More details on this will follow soon.

Semester Index