{"id":32785,"date":"2026-06-18T20:57:50","date_gmt":"2026-06-18T10:57:50","guid":{"rendered":"https:\/\/www.chillicomment.com\/?p=32785"},"modified":"2026-06-18T20:57:50","modified_gmt":"2026-06-18T10:57:50","slug":"interactive-why-do-ai-models-struggle-with-online-hate-speech-detection","status":"publish","type":"post","link":"https:\/\/www.chillicomment.com\/?p=32785&lang=en","title":{"rendered":"Interactive Why do AI models struggle with online hate speech detection?"},"content":{"rendered":"
\n
\n
\n
By\u00a0<\/span>Hanna Duggal\u00a0and\u00a0Mohammed Haddad<\/div>\n<\/div>\n<\/div>\n
\n
Published On 18 Jun 2026<\/span><\/div>\n<\/div>\n<\/div>\n
\n

Hate speech that once circulated in person now travels farther and faster via anonymous online accounts behind a screen.<\/p>\n

As the United Nations marks the\u00a0International Day\u00a0for Countering Hate Speech on June 18, UN Secretary-General Antonio Guterres has warned that social platforms are amplifying the threat.<\/p>\n

With artificial intelligence (AI) increasingly tasked with detecting and removing hate speech online, Al Jazeera looks at where these systems fall short compared with human judgement.<\/p>\n

How is hate speech defined?<\/h2>\n

According to the UN, hate speech covers any communication \u2013 spoken, written or behavioural \u2013 that discriminates against or incites violence towards a person or group.<\/p>\n

The UN states that hate speech targets a person\u2019s actual or perceived identity, race, ethnicity, religion, gender, sexual orientation or disability. And it isn\u2019t limited to words, with the UN noting it can also take the form of images, cartoons, gestures and even objects.<\/p>\n

How many people encounter hate speech online?<\/h2>\n

According to a\u00a02023\u00a0joint survey of 8,000 people in 16 countries done by polling company Ipsos and the UN Educational, Scientific and Cultural Organization (UNESCO), more than two-thirds of internet users encountered hate speech online.<\/p>\n

The survey also found that 33 percent of people thought LGBTQI people experienced the most cases of hate speech, followed by ethnic and racial minorities (28 percent) and women (18 percent).<\/p>\n

Meta, which owns Facebook, has removed fewer hateful posts since 2023. In the last quarter of 2025, the company removed 1.3 million posts from Instagram and 1.3 million from Facebook, compared to 7.4 million removed from Instagram and 5.8 million from Facebook in the fourth quarter of 2024.<\/p>\n

This came as the company shifted away from proactive detection of hate speech and relied more on users to report encounters.<\/p>\n

On the other hand, TikTok\u00a0said\u00a0it removed 96.3 percent of all hate speech and content in the fourth quarter of 2025 before it was reported.<\/p>\n

Get instant alerts and updates based on your interests. Be the first to know when big stories happen.<\/span><\/div>\n

To detect and combat the spread of hate speech online, social media companies have increasingly turned to AI, using content moderation systems powered by large language models (LLMs) that promise to automate content filtering across huge volumes of messages.<\/p>\n

In general, these systems use labeled datasets and pretrained language models to detect abusive language. They then apply rules or score thresholds to decide whether content is hateful or violates company policies.<\/p>\n

A 2025\u00a0study\u00a0by researchers at the University of Pennsylvania found that these models vary widely in how they identify and classify hate speech, with significant inconsistencies across systems and demographic groups, raising concerns about bias and unequal protection online.<\/p>\n

The study evaluated seven AI moderation systems \u2013 including models from OpenAI, Anthropic, DeepSeek, Mistral, and Google \u2013 and found major differences in how they identified and scored hate speech across categories.<\/p>\n

This chart shows how different AI moderation systems scored the severity of hate speech targeting the same groups on a 0\u20131 scale. Higher values indicate the model judged the content as more hateful.<\/p>\n

Mistral Moderation Endpoint is often clustered very close to 1, meaning it labels many examples as highly hateful regardless of the target group.<\/p>\n

OpenAI Moderation Endpoint tends to produce much lower scores for many categories, sometimes less than half the score assigned by other models.<\/p>\n

As the study authors put it, \u201cIf two systems produce different outcomes for the same piece of content \u2013 flagging it as hate speech in one case but not in another \u2013 it undermines the legitimacy of the moderation process.\u201d<\/p>\n

The limitations of AI hate speech detection<\/h2>\n

While AI systems are able to detect explicit hate speech \u2013 for example, when profanities and slurs are used against a particular group \u2013 more nuanced examples are missed by LLMs.<\/p>\n

\u201cOne challenging example is the case of implicit hate speech, which is often not detected as such because it contains no mention of slurs,\u201d Arkaitz Zubiaga, an associate professor at Queen Mary University of London, and co-lead of the university\u2019s Social Data Science lab, told Al Jazeera. \u201cThis could be the case of a positive-sounding message such as \u201cI would love to see how great the world would be if\u2026\u201d followed by a derogatory message disparaging a demographic group. AI systems can struggle to see the hate in those messages if they focus instead on the positive side of the message.\u201d<\/p>\n

Zubiaga adds that the opposite is also true, where seemingly offensive words, which are now incorporated into language for more endearing purposes, are highlighted as hate speech.<\/p>\n

\u201cThis is the case of reclaimed language, where keywords that are historically deemed slurs are embraced and repurposed by the communities they were initially used to disparage, and the slurs are then used between members of the marginalised community,\u201d he said. \u201cWhile these cases should not be flagged as hateful, AI systems have a tendency to do it.\u201d<\/p>\n

(ALJAZEERA)<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

By\u00a0Hanna Duggal\u00a0and\u00a0Mohammed Haddad Published On 18 Jun […]<\/p>\n","protected":false},"author":1,"featured_media":30776,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[58],"tags":[],"yoast_head":"\nInteractive Why do AI models struggle with online hate speech detection? -<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.chillicomment.com\/?p=32785&lang=en\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Interactive Why do AI models struggle with online hate speech detection? -\" \/>\n<meta property=\"og:description\" content=\"By\u00a0Hanna Duggal\u00a0and\u00a0Mohammed Haddad Published On 18 Jun […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.chillicomment.com\/?p=32785&lang=en\" \/>\n<meta property=\"article:published_time\" content=\"2026-06-18T10:57:50+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.chillicomment.com\/wp-content\/uploads\/2025\/10\/Jc1JuZmeTgOPtws1HNx9Keju29BANwY24fCuteHwrrU.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"640\" \/>\n\t<meta property=\"og:image:height\" content=\"421\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"\u8fa3\u624b\u795e\u7f16\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u8fa3\u624b\u795e\u7f16\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.chillicomment.com\/?p=32785&lang=en\",\"url\":\"https:\/\/www.chillicomment.com\/?p=32785&lang=en\",\"name\":\"Interactive Why do AI models struggle with online hate speech detection? -\",\"isPartOf\":{\"@id\":\"https:\/\/www.chillicomment.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.chillicomment.com\/?p=32785&lang=en#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.chillicomment.com\/?p=32785&lang=en#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.chillicomment.com\/wp-content\/uploads\/2025\/10\/Jc1JuZmeTgOPtws1HNx9Keju29BANwY24fCuteHwrrU.jpg\",\"datePublished\":\"2026-06-18T10:57:50+00:00\",\"dateModified\":\"2026-06-18T10:57:50+00:00\",\"author\":{\"@id\":\"https:\/\/www.chillicomment.com\/#\/schema\/person\/48dc71dff979790a3a71a01523644725\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.chillicomment.com\/?p=32785&lang=en#breadcrumb\"},\"inLanguage\":\"zh-CN\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.chillicomment.com\/?p=32785&lang=en\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-CN\",\"@id\":\"https:\/\/www.chillicomment.com\/?p=32785&lang=en#primaryimage\",\"url\":\"https:\/\/www.chillicomment.com\/wp-content\/uploads\/2025\/10\/Jc1JuZmeTgOPtws1HNx9Keju29BANwY24fCuteHwrrU.jpg\",\"contentUrl\":\"https:\/\/www.chillicomment.com\/wp-content\/uploads\/2025\/10\/Jc1JuZmeTgOPtws1HNx9Keju29BANwY24fCuteHwrrU.jpg\",\"width\":640,\"height\":421},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.chillicomment.com\/?p=32785&lang=en#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.chillicomment.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Interactive Why do AI models struggle with online hate speech detection?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.chillicomment.com\/#website\",\"url\":\"https:\/\/www.chillicomment.com\/\",\"name\":\"\",\"description\":\"\u8a00\u8ad6\u81ea\u7531\u4e0d\u53ef\u6216\u7f3a \u83ef\u4eba\u8a55\u8ad6\u7f51\u5a92\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.chillicomment.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"zh-CN\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.chillicomment.com\/#\/schema\/person\/48dc71dff979790a3a71a01523644725\",\"name\":\"\u8fa3\u624b\u795e\u7f16\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-CN\",\"@id\":\"https:\/\/www.chillicomment.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/ce2aecb0273dfe258c5ec580f635c1dd?s=96&d=wavatar&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/ce2aecb0273dfe258c5ec580f635c1dd?s=96&d=wavatar&r=g\",\"caption\":\"\u8fa3\u624b\u795e\u7f16\"},\"url\":\"https:\/\/www.chillicomment.com\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Interactive Why do AI models struggle with online hate speech detection? -","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.chillicomment.com\/?p=32785&lang=en","og_locale":"zh_CN","og_type":"article","og_title":"Interactive Why do AI models struggle with online hate speech detection? -","og_description":"By\u00a0Hanna Duggal\u00a0and\u00a0Mohammed Haddad Published On 18 Jun […]","og_url":"https:\/\/www.chillicomment.com\/?p=32785&lang=en","article_published_time":"2026-06-18T10:57:50+00:00","og_image":[{"width":640,"height":421,"url":"https:\/\/www.chillicomment.com\/wp-content\/uploads\/2025\/10\/Jc1JuZmeTgOPtws1HNx9Keju29BANwY24fCuteHwrrU.jpg","type":"image\/jpeg"}],"author":"\u8fa3\u624b\u795e\u7f16","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"\u8fa3\u624b\u795e\u7f16","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"5 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.chillicomment.com\/?p=32785&lang=en","url":"https:\/\/www.chillicomment.com\/?p=32785&lang=en","name":"Interactive Why do AI models struggle with online hate speech detection? -","isPartOf":{"@id":"https:\/\/www.chillicomment.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.chillicomment.com\/?p=32785&lang=en#primaryimage"},"image":{"@id":"https:\/\/www.chillicomment.com\/?p=32785&lang=en#primaryimage"},"thumbnailUrl":"https:\/\/www.chillicomment.com\/wp-content\/uploads\/2025\/10\/Jc1JuZmeTgOPtws1HNx9Keju29BANwY24fCuteHwrrU.jpg","datePublished":"2026-06-18T10:57:50+00:00","dateModified":"2026-06-18T10:57:50+00:00","author":{"@id":"https:\/\/www.chillicomment.com\/#\/schema\/person\/48dc71dff979790a3a71a01523644725"},"breadcrumb":{"@id":"https:\/\/www.chillicomment.com\/?p=32785&lang=en#breadcrumb"},"inLanguage":"zh-CN","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.chillicomment.com\/?p=32785&lang=en"]}]},{"@type":"ImageObject","inLanguage":"zh-CN","@id":"https:\/\/www.chillicomment.com\/?p=32785&lang=en#primaryimage","url":"https:\/\/www.chillicomment.com\/wp-content\/uploads\/2025\/10\/Jc1JuZmeTgOPtws1HNx9Keju29BANwY24fCuteHwrrU.jpg","contentUrl":"https:\/\/www.chillicomment.com\/wp-content\/uploads\/2025\/10\/Jc1JuZmeTgOPtws1HNx9Keju29BANwY24fCuteHwrrU.jpg","width":640,"height":421},{"@type":"BreadcrumbList","@id":"https:\/\/www.chillicomment.com\/?p=32785&lang=en#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.chillicomment.com\/"},{"@type":"ListItem","position":2,"name":"Interactive Why do AI models struggle with online hate speech detection?"}]},{"@type":"WebSite","@id":"https:\/\/www.chillicomment.com\/#website","url":"https:\/\/www.chillicomment.com\/","name":"","description":"\u8a00\u8ad6\u81ea\u7531\u4e0d\u53ef\u6216\u7f3a \u83ef\u4eba\u8a55\u8ad6\u7f51\u5a92","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.chillicomment.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"zh-CN"},{"@type":"Person","@id":"https:\/\/www.chillicomment.com\/#\/schema\/person\/48dc71dff979790a3a71a01523644725","name":"\u8fa3\u624b\u795e\u7f16","image":{"@type":"ImageObject","inLanguage":"zh-CN","@id":"https:\/\/www.chillicomment.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/ce2aecb0273dfe258c5ec580f635c1dd?s=96&d=wavatar&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ce2aecb0273dfe258c5ec580f635c1dd?s=96&d=wavatar&r=g","caption":"\u8fa3\u624b\u795e\u7f16"},"url":"https:\/\/www.chillicomment.com\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/www.chillicomment.com\/index.php?rest_route=\/wp\/v2\/posts\/32785"}],"collection":[{"href":"https:\/\/www.chillicomment.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.chillicomment.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.chillicomment.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.chillicomment.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=32785"}],"version-history":[{"count":-4,"href":"https:\/\/www.chillicomment.com\/index.php?rest_route=\/wp\/v2\/posts\/32785\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.chillicomment.com\/index.php?rest_route=\/wp\/v2\/media\/30776"}],"wp:attachment":[{"href":"https:\/\/www.chillicomment.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=32785"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.chillicomment.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=32785"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.chillicomment.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=32785"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}