Lecturer: Cosima Prahm, Michael Bressler
Fields: Computer Science, Biology, Medicine
Content
In this hands-on course, participants will explore how body and brain signals can be used as inputs for immersive interactive applications or games. After a short introduction to physiology and measurement of muscle activity (EMG), brain activity (EEG), heart activity (EKG) as well as user interface design principles and gamification, we will provide a tutorial on the Unity game engine and prefabs for signal processing and interaction design.
Using provided hardware, participants will work in a maximum of 5 small teams consisting of 3-4 people to prototype applications using the Unity Game Engine to integrate physiological signals into XR/VR scenarios. Sessions will be structured as hackathon-style workshops, combining brief input lectures, supervised technical guidance, and plenty of time for experimentation.
The course will conclude with team presentations in which groups pitch and demo their applications to fellow IK participants and a small jury. The emphasis is on creativity, collaboration, and gaining hands-on experience in turning physiological signals into novel forms of human–computer interaction.
Provided Hardware:
– Meta Quest 3/3S (XR/VR Headset with optical hand tracking)
– MyoArmband (EMG Bracelet)
– Muse S (EEG Headband)
– Polar Belt (EKG Chest Belt)
Description for every course Session:
- Session 1: Introduction to physiological signals (EMG, EEG, EKG), user interface design and gamification. Overview of measurement devices, introduction to VR/AR/XR, Hardware setup, Unity tutorial, team formation.
- Session 2: Prototyping session I – connecting devices, first experiments with devices, developing creative concepts.
- Session 3: Prototyping session II – refining signal integration, debugging, testing interaction concepts.
- Session 4: Prototyping session III – polishing prototypes, preparing demos and pitches.
- Presentation: Final presentation (short PPT as introduction of the team and the project, followed by a demo)
Literature
- Aspiring participants are encouraged to visit the Unity tutorials at: https://learn.unity.com/pathway/unity-essentials
Lecturer
Cosima Prahm graduated from the Medical University Vienna, Austria, in 2019 with a PhD in Medicine – Clinical Neuroscience. During that time, she was a research assistant at the Clinical Laboratory for Bionic Extremity Reconstruction and Rehabilitation lead by Prof. Aszmann at the Medical University in Vienna, at the Clinical Laboratory for Bionic Limb Reconstruction, Austria. At the University of Tuebingen, Germany, she was head of research of the laboratory for Hand, Plastic, Reconstructive and Burn Surgery while actively conducting research herself in both clinical projects and in the field of TechNeuroRehabilitation, where she also established the working group PlayBionic that focuses on digital health applications. She is now working at the Clinic for Hand, Replantation and Microsurgery, Charité University Medicine, and is the director of the Center for Clinical Research at the occupational trauma hospital Unfallkrankenhaus Berlin.
Affiliation: Charité – University Medicine Berlin
Homepage: www.playbionic.org
Michael Bressler finished his Master’s degree in Information Technology at the Vienna University of Technology with a focus on human-computer interfaces and user interface design. After several years in the private sector, he returned to research, where he mainly focuses on computer-assisted rehabilitation, virtual and augmented reality, and serious games for health.
Affiliation: BG Klinikum Unfallkrankenhaus Berlin, Zentrum für Klinische Forschung
Homepage: www.michaelbressler.at