RGB-D Reconstruction for Mixed Reality

RGB-D Reconstruction for Mixed Reality

2019, Feb 05    

For the 3D Scanning & Motion Capture at TUM course we implemented a realtime 3D reconstruction algorithm based on Kinect Fusion. Additionally we show, how such an algorithm can be used for Mixed Reality by implementing an interface between our implementation (C++, CUDA, DirectCompute) and the Unity game engine. The implemented Unity “game” gets the current position and scene geometry at each update. Results:

Original Scene Interaction Reconstruction

Team Members: Patrick Radner, Juan Raul Padron Griffe, Wojciech Zielonka, Baris Yazici
Instructors: Angela Dai, Justus Thies

Github
Poster