In an effort to help blind people perceive the faces of people they are speaking with, Huawei is debuting its Facing Emotions app. Available for the Huawei Mate 20 Pro, the app takes advantage of AI to help blind people hear emotions and can already translate seven universal emotions — anger, fear, disgust, happiness, sadness, surprise, and contempt — into corresponding sounds. To develop this, Huawei worked with the Polish Blind Association.
To accomplish this, the Facing Emotions app uses the phone's back camera to scan the faces of conversation partners, by identifying facial features like eyes, nose, brows, and the mouth. All of this can be accomplished while offline, as the device will use built-in machine learning algorithms to detect emotions and interpret them as sounds.