Conceptional Development of image recognition engine for outdoor 3D objects on smartphones

The goal of this project is not only to track, but also to recognize 3 dimensional structures in open space with the use of devices like smartphones or tablets. Visual cues as well as sensor data are going to be combined to fulfill this task.

The system will be designed specially to work with facades of public buildings throughout the whole year. Thus issues like varying lightning condition, occlusions and different viewing angles have to be considered in order to extract time-independent robust features.  The expected accuracy of this large scale tracking should allow 3D real-time video augmentation with all kind of visual content.