Every year, millions of images, videos and posts that allegedly contain terrorist or violent extremist content are removed from social media platforms like YouTube, Facebook, or Twitter. A key force behind these takedowns is the Global Internet Forum to Counter Terrorism (GIFCT), an industry-led initiative that seeks to prevent terrorists and violent extremists from exploiting digital platforms. And unfortunately, GIFCT has the potential to have a massive (and disproportionate) negative impact on the freedom of expression of certain communities.
Social media platforms have long struggled with the problem of extremist or violent content on their platforms. Platforms may have an intrinsic interest in offering their users an online environment free from unpleasant content, which is why most social media platforms terms of service contain a variety of speech provisions. During the past decade, however, social media platforms have also come under increasing pressure from governments around the globe to respond to violent and extremist content on their platforms. Spurred by the terrorist attacks in Paris and Brussels in 2015 and 2016, respectively, and guided by the shortsighted belief that censorship is an effective tool against extremism, governments have been turning to content moderation as a means to fix international terrorism.
Commercial content moderation is the process through which platformsmore specifically, human reviewers or, very often, machinesmake decisions about what content can and cannot be on their sites, based on their own Terms of Service, community standards, or other rules.
During the coronavirus pandemic, social media companies have been less able to use human content reviewers, and are instead increasingly relying on machine learning algorithms to moderate content as well as flag it. Those algorithms, which are really just a set of instructions for doing something, are fed with an initial set of rules and lots of training data in the hopes that they will learn to identify similar content But human speech is a complex social phenomenon and highly context-dependent; inevitably, content moderation algorithms make mistakes. What is worse, because machine-learning algorithms usually operate as black boxes that do not explain how they arrived at a decision, and as companies generally do not share either the basic assumptions underpinning their technology or their training data sets, third parties can do little to prevent those mistakes.
This problem has become more acute with the introduction of hashing databases for tracking and removing extremist content. Hashes are digital "fingerprints" of content that companies use to identify and remove content from their platforms. They are essentially unique, and allow for easy identification of specific content. When an image is identified as terrorist content, it is tagged with a hash and entered into a database, allowing any future uploads of the same image to be easily identified.
This is exactly what the GIFCT initiative aims to do: Share a massive database of alleged terrorist content, contributed voluntarily by companies, amongst members of its coalition. The database collects hashes, or unique fingerprints, of alleged terrorist, or extremist and violent content, rather than the content itself. GIFCT members can then use the database to check in real time whether content that users want to upload matches material in the database. While that sounds like an efficient approach to the challenging task of correctly identifying and taking down terrorist content, it also means that one single database might be used to determine what is permissible speech, and what is taken downacross the entire Internet.
Countless examples have proven that it is very difficult for human reviewersand impossible for algorithmsto consistently get the nuances of activism, counter-speech, and extremist content itself right. The result is that many instances of legitimate speech are falsely categorized as terrorist content and removed from social media platforms. Due to the proliferation of the GIFCT database, any mistaken classification of a video, picture or post as terrorist content echoes across social media platforms, undermining users' right to free expression on several platforms at once. And that, in turn, can have catastrophic effects on the Internet as a space for memory and documentation. Blunt content moderation systems can lead to the deletion of vital information not available elsewhere, such as evidence of human rights violations or war crimes. For example, the Syrian Archive, an NGO dedicated to collecting, sharing and archiving evidence of atrocities committed during the Syrian war reports that hundred of thousand videos of war atrocities are removed by YouTube annually. The Archive estimates that take down rates for videos documenting Syrian human rights violations is circa 13%, a number that has almost doubled to 20% in the wake of the coronavirus crisis. As noted, many social media platforms, including YouTube, have been using algorithmic tools for content moderation more heavily than usual, resulting in increased takedowns. If, or when, YouTube contributes hashes of content that depicts Syrian human rights violations, but has been tagged as terrorist content by YouTubes algorithms to the GIFCT database, that content could be deleted forever across multiple platforms.
The GIFCT content cartel not only risks losing valuable human rights documentation, but also has a disproportionately negative effect on some communities. Defining terrorism is a inherently political undertaking, and rarely stable across time and space. Absent international agreement on what exactly constitutes terrorist, or even violent and extremist, content, companies look at the United Nations list of designated terrorist organizations or the US State Departments list of Foreign Terrorist Organizations. But those lists mainly consist of Islamist organizations, and are largely blind to, for example, right-wing extremist groups. That means that the burden of GIFCTs misclassifications falls disproportionately on Muslim and Arab communities and highlights the fine line between an effective initiative to tackle the worst content online and sweeping censorship.
Ever since the attacks on two Mosques in Christchurch in March 2019, GIFCT has been more prominent than ever. In response to the shooting, during which 51 people were killed, French President Emmanuel Macron and New Zealand Prime Minister Jacinda Ardern launched the Christchurch Call. That initiative, which aims to eliminate violent and extremist content online, foresees a prominent role for GIFCT. In the wake of this renewed focus on GIFCT, the initiative announced that it would evolve to an independent organization, including a new Independent Advisory Committee (IAC) to represent the voices of civil society, government, and inter-governmental entities.
However, the Operating Board, where real power resides, remains in the hands of industry. And the Independent Advisory Committee is already seriously flawed, as a coalition of civil liberties organizations has repeatedly noted.
For example, governments participating in the IAC are likely to leverage their position to influence companies content moderation policies and shape definitions of terrorist content that fit their interests, away from the public and eye and therefore lacking accountability. Including governments in the IAC could also undermine the meaningful participation of civil society organizations as many are financially dependent on governments, or might face threats of reprisals for criticism government officials in that forum. As long as civil society is treated as an afterthought, GIFCT will never be an effective multi-stakeholder forum. GIFCTs flaws and their devastating effects on the freedom of expression, human rights, and the preservation of evidence of war crimes have been known for years. Civil societies organizations have tried to help reform the organization, but GIFCT and its new Executive Director have remained unresponsive. Which leads to the final problem with the IAC: leading NGOs are choosing not to participate at all.
Where does this leave GIFCT and the millions of Internet users its policies impact? Not in a good place. Without meaningful civil society representation and involvement, full transparency and effective accountability mechanisms, GIFCT risks becoming yet another industry-led forum that promises multi-stakeholderism but delivers little more than government-sanctioned window-dressing.
- Freedom: The History of an Idea - Foreign Policy Research Institute - June 19th, 2022
- Town Of Freedom Official Site - June 19th, 2022
- Pence skips Faith & Freedom conference. Is attacked by Trump anyways. - POLITICO - June 19th, 2022
- Juneteenth 2022: Freedom Songs on Apple Music - June 19th, 2022
- There's no freedom without reparations - The Connecticut Mirror - June 19th, 2022
- Freedom to Read Celebration, Supporting the Merritt Fund, and Featuring Banned Author David Levithan - ala.org - June 19th, 2022
- Is Technology in Photography Lowering the Bar or Increasing Freedom? - Fstoppers - June 19th, 2022
- Freedom From Fear: Anxiety and Depression Resource Organization - May 12th, 2022
- FREEDOM: Is it just another 'F' word now? - Millard County Chronicle Progress - May 12th, 2022
- Albuquerque Summerfest and Freedom 4th Headliners Announced - City of Albuquerque - May 12th, 2022
- The Freedom Foundation exists to tear down, not build up - Idaho EdNews - May 12th, 2022
- Russian Dissent Then and Now: 'For Your Freedom and Ours' - The Moscow Times - May 12th, 2022
- Freedom Historical Society to present 'Mount Washington Carriage Road and The Glen House' program - Conway Daily Sun - May 12th, 2022
- American Freedom Is Greater Than Slavery and Ends in Death - Tablet Magazine - May 12th, 2022
- The Press Freedom Index is Prepared With Bias and a Flawed Methodology - News18 - May 12th, 2022
- Guest column: GOP is out to limit voting and reproductive freedom - The Bulletin - May 12th, 2022
- Daly and Wallace lawsuit flagged for press freedom concerns - The Irish Times - May 12th, 2022
- Media polarisation risks press freedom and peace in conflict-hit Mali and Ethiopia - The Guardian - May 12th, 2022
- Afghanistan dispatch: 'The Taliban are the enemies of women's freedom' - JURIST - May 12th, 2022
- The Navy just launched a brand new ship it doesnt even want - Task & Purpose - May 12th, 2022
- Yoon stresses freedom, growth as he begins 5-year term - The Korea Herald - May 12th, 2022
- Opinion: More freedom or more death: A pandemic quandary we have yet to solve - The Globe and Mail - May 12th, 2022
- The freedom to divide: zoning and segregation in Connecticut - The Connecticut Mirror - April 28th, 2022
- Watch George Michael Freedom Uncut Trailer, Where the Late Singer Talks About the Pressures of Fame - Variety - April 28th, 2022
- In Our View: Religious freedom at core of Constitution - The Columbian - April 28th, 2022
- Black Girl Freedom Fund Invests Over $4 Million In 68 Organizations, Part Of #1Billion4BlackGirls Campaign - Forbes - April 28th, 2022
- Championing Consumer Freedom in Health Care | Opinion - Newsweek - April 28th, 2022
- Ed Buck and False 'Freedom' - The American Conservative - April 28th, 2022
- Thursday at 10: Preserving the past of the 'Freedom Mine' - WKOW - April 28th, 2022
- 10-rule manifesto by ai weiwei for empowerment and freedom of mind - Designboom - April 28th, 2022
- Texas Rangers Baseball Foundation accepting nominations for "Faces of Freedom" Military Program - MLB.com - April 28th, 2022
- Freedom of Expression - Caltech - April 28th, 2022
- "No Country Should Preach To Another": UK PM On 'Freedom In India' Debate - NDTV - April 28th, 2022
- Red zone 'freedom village' asked to leave twice by council - Stuff - April 28th, 2022
- Opinion | No, Vaccine Mandates Arent an Attack on Freedom - The New York Times - November 2nd, 2021
- Academic Freedom Alliance Letter on the University of Florida Situation - Reason - November 2nd, 2021
- Vaccination, Freedom and Responsibility - Coronavirus Coverage - State of the Planet - November 2nd, 2021
- Freedom football rules 2nd half to beat Liberty, claim city title - lehighvalleylive.com - November 2nd, 2021
- 'Economic freedom' rankings are contrived, meaningless nonsense - The Real News Network - November 2nd, 2021
- Central Valley Right to Life group claims vaccine protection law prohibits freedom of speech - Visalia Times-Delta and Tulare Advance-Register - November 2nd, 2021
- Bitcoin Community Projects Communicate The Message Of Freedom - Bitcoin Magazine - November 2nd, 2021
- Investigative Journalist Roohollah Zam Tops November Ranking Of The One Free Press Coalitions 10 Most Urgent Press Freedom Cases - Forbes - November 2nd, 2021
- Stalin inaugurates exhibition on freedom struggle - The Hindu - November 2nd, 2021
- G-20 Needs a Freedom and Prosperity Agenda More Than Ever - Heritage.org - November 2nd, 2021
- When Jane Johnson jeopardized her freedom for the people who aided her to escape from slavery - Face2Face Africa - November 2nd, 2021
- Letter: Responsibility of Freedom | Opinion | thepilot.com - Southern Pines Pilot - November 2nd, 2021
- Positive Vibes Only: Mayorkun Performs Liberating Track "Freedom" From His New Album 'Back In Office' - grammy.com - November 2nd, 2021
- Do vaccine mandates violate or support our freedom? Avoid anyone who thinks this question is easy - The Dallas Morning News - November 2nd, 2021
- Passing reveals pursuit of happiness, freedom and safety - District - November 2nd, 2021
- Freedom to Roam: The Rhythms Of Migration - Folk Radio UK - November 2nd, 2021
- Diversity Dialogues Raise Issues of Women's Rights, Sexual Identity and Individual Freedom - University of Arkansas Newswire - February 20th, 2021
- Capitol Talk: Antifa; 'Religious Freedom', And Limits On Local Control - MTPR - February 20th, 2021
- John Mayall: The blues have given me musical freedom - Olean Times Herald - February 20th, 2021
- Greta comes out in support of Disha, says freedom of speech and right to peaceful protest non-negotiable - The Tribune India - February 20th, 2021
- Mosaic Announces Long-Term Partnership with Freedom Forever - PRNewswire - February 20th, 2021
- Creative freedom restricted by cloaking it in religion - The Hindu - February 20th, 2021
- Statutes of Liberty: Freedom of Information Act Requests are Free for Immigrants and U.S. Citizens - ARLnow - February 20th, 2021
- Woman who fought for racial equity as a Freedom Rider reflects on the past, gives outlook on the future - WLWT Cincinnati - February 20th, 2021
- Rescue horses move to Freedom to teach, provide therapy for people in need of rescue - Boothbay Register - February 20th, 2021
- Sudan: Forces of Freedom of Change refuses army appointments as governors - Middle East Monitor - February 20th, 2021
- Freedom Foods sees another CFO depart troubled Australian dairy business - just-food.com - February 20th, 2021
- Opinion | Give Fred Gray the Medal of Freedom, because no one deserves it more - alreporter.com - February 20th, 2021
- Biden Has No Time to Lose on Freedom of Navigation Operations Against China - Foreign Policy - February 20th, 2021
- The scars of solitary: Albert Woodfox on freedom after 44 years in a concrete cell - The Guardian - February 20th, 2021
- Washington Spirit owners, Freddy Adu, and more: Freedom Kicks - Black And Red United - February 20th, 2021
- Readers Write: Impeachment trial, freedom of speech, the cold weather - Minneapolis Star Tribune - February 20th, 2021
- What the Trump administration meant for freedom of information requests - Columbia Journalism Review - February 20th, 2021
- Freedom and security: On social media platforms operating in India - The Hindu - February 20th, 2021
- 'You have to stay strong': 102-year-old freedom fighter's message to Disha Ravi - Hindustan Times - February 20th, 2021
- Freedom | Definition of Freedom at Dictionary.com - December 3rd, 2020
- Freedom - Wikipedia - December 3rd, 2020
- After 400 Years, The Reason People Come To America Is Still ... - December 3rd, 2020
- Medicare Advantage Plans for Florida at Freedom Health ... - December 3rd, 2020
- Freedom of Religion or Belief club formed at BYU - The Daily Universe - Universe.byu.edu - September 18th, 2020
- Freedom 76 At Grandview Will Be Live On FloRacing - FloRacing - September 18th, 2020
- Aviation Analysis: Revival of Fifth Freedom Flights? - Sam Chui - September 18th, 2020
- Trump Attacks The 1619 Project: U.S. Wasnt Founded On Slavery And Oppression, It Was Freedom - Moguldom - September 18th, 2020
- PAUL TIYAMBE ZELEZA - Beyond Political Freedom to Inclusive Wealth Creation and Self-Reliance - The Elephant - September 18th, 2020
- Backyard pool will bring joy and freedom to Niagara Falls boy - StCatharinesStandard.ca - September 18th, 2020
- Parson James Talks New Single, Lockdown, and Artistic Freedom - vmagazine.com - September 18th, 2020