Abstract

In recent years, multi-touch technology has had its breakthrough in research as well as in consumer electronics. This development was mainly driven by multi-touch enabled devices entering the mass market.
Compared to conventional single-pointer interaction using a mouse, multi- touch surfaces allow for much richer and more diverse ways of Human-Computer Interaction (HCI). Users can interact with an application in a direct and natural way using their fingers or whole hands to touch the surface, hence the term natural user interfaces (NUI).
To support the development of applications for multi-touch devices a lot of different software frameworks have emerged to assist developers in the process. Although all of these frameworks provide a set of well-known and ready-to-use gestures, they lack flexibility concerning the definition and extensibility of gestures as well as reusability in different application scenarios.
The goal of this work is to overcome those shortcomings and develop methods for the generalization of multi-touch interactions to allow a modular definition of gestures at a high level of abstraction. This enables to decouple the logic of the interaction relevant parts of an application completely from the application's run-time logic and use interaction techniques in a platform and application independent manner.
Therefore, different gestures can easily be interchanged and modified without having to change the application itself.

Reference

Pilz, F. (2011). MINT - a framework for the design and development of multimodal interaction on multi-touch surfaces [Diploma Thesis, Technische Universität Wien]. reposiTUm. https://resolver.obvsg.at/urn:nbn:at:at-ubtuw:1-51342