Designer Paul Pillitteri created this urban design experiment titled 'The Sound of Emotion,' which is a physical structure that reads human facial expressions and produces music based on the sensed emotion.
Users can create their own sounds and music based on which expression they show, and as they change their face the music is altered as well. The structure holds four iPads that each play a different musical instrument. The instrumental iPads are also connected to a piece of recognition software.
The ultimate goal is for strangers to come together and build a musical creation together. By expressing similar or completely opposite emotions, the music will always turn out unique. The Sound of Emotion was used as an experiment in San Francisco’s ‘Market Street Prototyping Festival' and is now on display at San Francisco’s Yerba Buena Center for the Arts.
Face-Reading Music Makers
The 'Sound of Emotion' is a Device That Projects Sound from Expressions
Trend Themes
1. Facial Expression Recognition - Disruptive innovation opportunities include developing technology that can accurately read and interpret facial expressions to create personalized experiences.
2. Emotion-based Music Creation - Disruptive innovation opportunities include creating devices or software that generate music based on the user's current emotional state.
3. Collaborative Music Production - Disruptive innovation opportunities include designing platforms that allow strangers to come together and create music as a collective experience.
Industry Implications
1. Music Technology - Disruptive innovation opportunities include integrating facial expression recognition technology into musical instruments and production software.
2. Experiential Design - Disruptive innovation opportunities include incorporating facial expression recognition technology into interactive installations and experiential marketing campaigns.
3. Artificial Intelligence - Disruptive innovation opportunities include developing advanced algorithms and AI models that can accurately analyze and interpret human emotions based on facial expressions.