TAG (TRANSLATIVE AFFECTIVE GESTURE)
April 2019
Gesture mapping for enhancement of empathy-building mirroring behavior in cross-cultural communication. A fast, semi-functional prototype.
We rely on our interpretation of others' gestures and body language for many communication cues, perhaps even more than we rely on the content of verbal language. Differences in gestural dialects can create challenges in communication of intent and social decision making across socio-cultural divides.
TAG proposes a system for emotional intent translation for individuals' physical gestures, enabling more fluid communication in social interactions and acting as a training system for development of empathetic mirroring.
The prototype uses a fusion of IMU and EMG, determining different affective assignments based on gestural speed and character. Each individual builds a unique gestural signature through a machine learning training process.
A collaboration with Saif Haobsh.