In a time of increased awareness surrounding sexual violence and harassment on the back of the #MeToo movement, Instagram announced its new anti-abuse feature, which will preemptively block abusive DM requests.
The feature uses an innovative AI-led system to target commonly-used words, phrases, and emojis (as well as common misspellings) that are offensive. A custom list of words and phrases can be uploaded to further protect users based on their comfort levels. To cut down on repeat offenses, the anti-abuse feature also offers users the option to block not only offensive main accounts, but also new accounts created by previously blocked users.
To maintain privacy, offensive messages are not automatically reported to Instagram, though users can manually report them at their leisure. The anti-abuse feature can be toggled on or off by looking at Hidden Words under Privacy Settings.
Image Credit: Instagram / NPR / Shutterstock
What's Driving This Trend
- AI-powered Anti-abuse Features
- Innovative AI-led systems can be implemented in messaging platforms to target abusive messages and preemptively block them from reaching the users.
- User-controlled Anti-abuse Filters
- Allowing users to upload custom lists of offensive phrases can give them more control over the abusive message filtering process.
- Proactive Account Blocking
- Offering the option to block not only offensive main accounts, but also new accounts created by previously blocked users, can help reduce repeat offenses.
Who This Affects Most
- Social Media Platforms
- Implementing AI-powered anti-abuse features in social media platforms can help improve user experience and safety, as well as address concerns around harassment and abuse.
- Messaging Apps
- AI-led systems can be integrated into messaging apps to filter out abusive messages, providing a safer and more comfortable environment for users.
- Online Content Moderation
- Addressing concerns around online harassment and abuse can present opportunities for businesses providing content moderation services to partner with social media platforms and messaging apps.
