{"id":76346,"date":"2021-05-16T09:00:47","date_gmt":"2021-05-16T13:00:47","guid":{"rendered":"https:\/\/newsroom.carleton.ca\/?post_type=cu_story&p=76346"},"modified":"2025-08-19T09:37:14","modified_gmt":"2025-08-19T13:37:14","slug":"biased-algorithms-moderation-censoring-activists","status":"publish","type":"cu_story","link":"https:\/\/carleton.ca\/news\/story\/biased-algorithms-moderation-censoring-activists\/","title":{"rendered":"Beyond a technical bug: Biased algorithms and moderation are censoring activists on social media"},"content":{"rendered":"\n
\n
\n\n \n \n \n \n
\n\n
<\/div>\n \n
\n
\n\n

\n Beyond a technical bug: Biased algorithms and moderation are censoring activists on social media\n <\/h1>\n \n <\/header>\n <\/div>\n\n \n <\/path>\n <\/path>\n <\/svg>\n <\/div>\n\n \n\n <\/div>\n<\/section>\n\n

Following Red Dress Day on May 5, a day aimed to raise awareness for Missing and Murdered Indigenous Women and Girls (MMIWG), Indigenous activists and supporters of the campaign found posts about MMIWG had disappeared<\/a> from their Instagram accounts. In response, Instagram released a tweet saying that this was \u201ca widespread global technical issue not related to any particular topic<\/a>,\u201d followed by an apology explaining that the platform \u201cexperienced a technical bug, which impacted millions of people\u2019s stories, highlights and archives around the world<\/a>.\u201d<\/p>\n\n\n\n

Creators, however, said that not all stories were affected.<\/p>\n\n\n\n

And this is not the first time social media platforms have been under scrutiny because of their erroneous censoring of grassroots activists and racial minorities. <\/p>\n\n\n\n

Many Black Lives Matter<\/a> (BLM) activists were similarly frustrated when Facebook flagged their accounts, but didn\u2019t do enough to stop racism and hate speech<\/a> against Black people on their platform.<\/p>\n\n\n\n

So were these really about technical glitches? Or did they result from the platforms\u2019 discriminatory and biased policies and practices? The answer lies somewhere in between.<\/p>\n\n\n\n

Towards automated content moderation<\/h2>\n\n\n\n

Every time an activist\u2019s post is wrongly removed, there are at least three possible scenarios. <\/p>\n\n\n\n

First, sometimes the platform deliberately takes down activists\u2019 posts and accounts, usually at request of and\/or in co-ordination with the government. This happened when Facebook and Instagram removed posts and accounts of Iranians<\/a> who expressed support for the Iranian general Qassem Soleiman. <\/p>\n\n\n\n

In some countries and disputed territories, such as Kashmir<\/a>, Crimea, Western Sahara and Palestinian territories<\/a>, platforms censored activists and journalists to allegedly maintain their market access or to protect themselves from legal liabilities<\/a>.<\/p>\n\n\n\n

Second, a post can be removed through a user-reporting mechanism. To handle unlawful or prohibited communication, social media platforms have indeed primarily relied on users reporting<\/a>.<\/p>\n\n\n\n

Applying community standards developed by the platform, content moderators would then review reported content and determine whether a violation had occurred. If it had, the content would be removed, and, in the case of serious or repeat infringements, the user may be temporarily suspended or permanently banned.<\/p>\n\n\n\n

This mechanism is problematic. Due to the sheer volume of reports received on a daily basis, there are simply not enough moderators to review each report adequately. Also, complexities and subtleties of language pose real challenges. Meanwhile, marginalized groups reclaiming abusive terms for public awareness, such as BLM and MMIWG, can be misinterpreted as being abusive.<\/p>\n\n\n\n

Further, in flagging content, users tend to rely on partisanship and ideology<\/a>. User reporting approach is driven by popular opinion of a platform\u2019s users while potentially repressing the right to unpopular speech.<\/p>\n\n\n\n

Such approach also emboldens freedom to hate<\/a>, where users exercise their right to voice their opinions while actively silencing others. A notable example is the removal by Facebook of \u201cFreedom for Palestine<\/a>,\u201d a multi-artist collaboration posted by Coldplay, after a number of users reported the song as \u201cabusive.\u201d <\/p>\n\n\n\n

Third, platforms are increasingly using artificial intelligence (AI) to help identify and remove prohibited content. The idea is that complex algorithms that use natural language processing can flag racist or violent content faster and better than humans possibly can. During the COVID-19 pandemic, social media companies are relying more on AI to cover for tens of thousands of human moderators who were sent home<\/a>. Now, more than ever, algorithms decide what users can and cannot post online.<\/p>\n\n\n\n

Algorithmic biases<\/h2>\n\n\n\n

There\u2019s an inherent belief that AI systems are less biased and can scale better than human beings. In practice, however, they\u2019re easily disposed to error and can impose bias on a colossal systemic scale. <\/p>\n\n\n\n

In two 2019 computational linguistic studies, researchers discovered that AI intended to identify hate speech may actually end up amplifying racial bias.<\/p>\n\n\n\n

In one study<\/a>, researchers found that tweets written in African American English commonly spoken by Black Americans are up to twice more likely to be flagged as offensive compared to others. Using a dataset of 155,800 tweets, another study<\/a> found a similar widespread racial bias against Black speeches.<\/p>\n\n\n\n

What\u2019s considered offensive is bound to social context; terms that are slurs when used in some settings may not be in others. Algorithmic systems lack an ability to capture nuances and contextual particularities, which may not be understood by human moderators who test data used to train these algorithms either. This means natural language processing which is often perceived as an objective tool to identify offensive content can amplify the same biases that human beings have. <\/p>\n\n\n\n

Algorithmic bias may jeopardize some people who are already at risk by wrongly categorizing them as offensive, criminals or even terrorists. In mid 2020, Facebook deleted at least 35 accounts of Syrian journalists and activists<\/a> on the pretext of terrorism while in reality, they were campaigning against violence and terrorism.<\/p>\n\n\n\n

\"Indigenous
\n Protesters gather in Winnipeg the day after the jury delivered a not-guilty verdict in the second degree murder trial of Raymond Cormier, the man accused of killing Tina Fontaine. MMIWG activists had their posts removed from Instagram on a day to raise awareness.<\/span>
\n THE CANADIAN PRESS\/John Woods<\/span><\/span>
\n <\/figcaption><\/figure>\n\n\n\n

MMIWG, BLM and the Syrian cases exemplify the dynamic of \u201calgorithms of opression<\/a>\u201d where algorithms reinforce older oppressive social relations and re-install new modes of racism and discrimination. <\/p>\n\n\n\n

While AI is celebrated as autonomous technology that can develop away from human intervention, it is inherently biased. The inequalities that underpin bias already exist in society and influence who gets the opportunity to build algorithms and their databases, and for what purpose. As such, algorithms do not intrinsically provide ways for marginalized people to escape discrimination, but they also reproduce new forms of inequality along social, racial and political lines. <\/p>\n\n\n\n

Despite the apparent problems, algorithms are here to stay. There is no silver bullet, but one can take steps to minimize bias. First is to recognize that there\u2019s a problem. Then, making a strong commitment to root out algorithmic biases.<\/p>\n\n\n\n

Bias can infiltrate the process anywhere in designing algorithms. <\/p>\n\n\n\n

The inclusion of more people from diverse backgrounds within this process \u2014 Indigenous, racial minorities, women and other historically marginalized groups \u2014 is one of important steps to help mitigate the bias. In the meantime, it is important to push platforms to allow for as much transparency and public oversight as possible.<\/p>\n\n\n\n

\n\n\n\n

<\/p>\n\n\n\n

This article is republished from The Conversation<\/a> under a Creative Commons license. Carleton University is a member of this unique digital journalism platform that launched in June 2017 to boost visibility of Canada\u2019s academic faculty and researchers. Interested in writing a piece? Please contact Steven Reid<\/a> or sign up to become an author<\/a>.<\/p>\n\n\n\n

All photos provided by The Conversation from various sources.<\/em><\/p>\n\n\n\n

—
\nCarleton Newsroom<\/a><\/p>\n\n\n\n

\"The<\/figure>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Following Red Dress Day on May 5, a day aimed to raise awareness for Missing and Murdered Indigenous Women and Girls (MMIWG), Indigenous activists and supporters of the campaign found posts about MMIWG had disappeared from their Instagram accounts. In response, Instagram released a tweet saying that this was \u201ca widespread global technical issue not […]<\/p>\n","protected":false},"author":410,"featured_media":76347,"template":"","meta":{"_acf_changed":false,"footnotes":"","_links_to":"","_links_to_target":""},"cu_story_type":[1623],"cu_story_tag":[],"class_list":["post-76346","cu_story","type-cu_story","status-publish","has-post-thumbnail","hentry","cu_story_type-expert-perspectives"],"acf":{"cu_post_thumbnail":false},"_links":{"self":[{"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story\/76346","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story"}],"about":[{"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/types\/cu_story"}],"author":[{"embeddable":true,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/users\/410"}],"version-history":[{"count":3,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story\/76346\/revisions"}],"predecessor-version":[{"id":76350,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story\/76346\/revisions\/76350"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/media\/76347"}],"wp:attachment":[{"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/media?parent=76346"}],"wp:term":[{"taxonomy":"cu_story_type","embeddable":true,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story_type?post=76346"},{"taxonomy":"cu_story_tag","embeddable":true,"href":"https:\/\/carleton.ca\/news\/wp-json\/wp\/v2\/cu_story_tag?post=76346"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}