Kinesthetic Displays: Creating Embodied Experiences of Movement Using Vibrotactile Feedback

Introduction

Kinesthesia – awareness of position and movement of body parts – is essential in all aspects of life. Kinesthesia enables mundane activities such as typing or lifting a glass to our lips, as well as feats like playing a piano concert or competing in an elite sport. It not only provides information about our body but also helps form an embodied understanding of the world around us.

Current State of Kinesthesia in HCI

Although kinesthesia is central to human experience, it is barely used in human-computer interaction (HCI). However, existing methods like visual retargeting or auditory body illusions suggest that such displays are possible. Vibration, exemplified by the Pinocchio Illusion, might be an ideal actuation method to convey kinesthetic information; however, the literature shows no systematic way to achieve this.

Project Goals

I aim to design kinesthetic displays (KDs), general-purpose devices that provide an embodied experience of movement. I will apply a sensorimotor perspective to the design of vibrotactile feedback, building on my know-how of using sensorimotor contingencies for designing vibrotactile material experiences.

Research Approach

In this project, my team and I will design a series of prototype KDs which will be used to study how:

1. Design decisions
2. Stimulation parameters
3. Algorithms

influence the introspective experience of movement. The resulting data will be used to formulate design guidelines for KDs and to establish an empirical theory of sensorimotor interaction.

Potential Impact

KDs will transform remote and co-located training and skill sharing. They will help us better understand our own bodies and provide amputees with sensory access to prosthetic limbs or other body augmentations. Finally, KDs will provide digital systems with an embodied channel of communication, revolutionizing how we interact with computers.