perspective

Google ‘Toxicity Detection’ Tool Rated Wikipedia Comments to Women as More Hostile

Google’s Jigsaw research division and the Wikimedia Foundation collaborated on an automated “harassment detection” tool called Detox to help identify hostile comments on Wikipedia. Users recently found the tool would rate comments directed at women as more hostile than the same comments directed at men. Foundation staff shut down the tool after it was also found to treat people identifying themselves as gay to be hostile.

Google wants to "Police Tone"