Multimodal Interactive System Design in the Scope of Performing Arts Creating a Hybrid Sensing Robot for Ubiquitous Human Machine Interaction

Abstract

Based on the idea of an immersive integration of robots and sensor technology in the future this master thesis explores and defines new human-robot interaction possibilities by building a robot that uses hybrid sensing of body mounted sensors, motion tracking and neural interfaces. Together with the virtual, responsive and adaptable space of a theatre environment new interaction strategies were tested, defined and evaluated to open up promising perspectives and to indicate possible enhancements of future human-robot interaction. The development of the robot resulted in a stage performance and interactive narrative in which an actor, by the means of thought, emotion and action, interacts with a robot on stage.