Free Trend Report Free 2019 Report & eBook

Get the top 100 trends happening right NOW -- plus a FREE copy of our award-winning book.

Keynotes.org Our Research Methodology

This article is one of 350,000 experiments. We use crowd filtering, big data and AI to identify insights.

Huawei's StorySign App Uses AR and AI to Translate Stories

 - Dec 4, 2018
References: cnet & venturebeat
Designed to enhance story time for deaf children, Huawei's StorySign app utilizes a mixture of AI and AR to bring books to life for children who can't hear the story being read. Developed in a collaboration between Huawei, the European Union of the Deaf, Penguin publishing, and the animation gurus at Aardman. Given that sign language is as diverse as spoken language, and can range from country to country, the StorySign app currently features support for sign language in British, French, German, Italian, Spanish, Dutch, Portuguese, Irish, Belgian Flemish, and Swiss-German.

The StorySign app currently only supports the children's book 'Where's Spot?' but its creators will be adding more content in the future. To use the app, parents or children simply need to hold their phone up to the pages, which will then summon an avatar that will sign out the words in real time as users flip through.

Image Credit: Huawei