Designer Paul Pillitteri created this urban design experiment titled 'The Sound of Emotion,' which is a physical structure that reads human facial expressions and produces music based on the sensed emotion.
Users can create their own sounds and music based on which expression they show, and as they change their face the music is altered as well. The structure holds four iPads that each play a different musical instrument. The instrumental iPads are also connected to a piece of recognition software.
The ultimate goal is for strangers to come together and build a musical creation together. By expressing similar or completely opposite emotions, the music will always turn out unique. The Sound of Emotion was used as an experiment in San Francisco’s ‘Market Street Prototyping Festival' and is now on display at San Francisco’s Yerba Buena Center for the Arts.