Social media companies have done well out of the United States congressional hearings on the January 6 insurrection. They profited from livestreamed video as rioters stormed the Capitol Building. They profited from the incendiary brew of misinformation that incited thousands to travel to Washington D.C. for the Save America rally. They continue to profit from its aftermath. Clickbait extremism has been good for business.
Video footage shot by the rioters themselves has also been a major source of evidence for police and prosecutors. On the day of the Capitol Building attack, content moderators at mainstream social media platforms were overwhelmed with posts that violated their policies against incitement to or glorification of violence. Sites more sympathetic to the extreme right, such as Parler, were awash with such content.
In testifying to the congressional hearings, a former Twitter employee spoke of begging the company to take stronger action. In despair, the night before the attack, she messaged fellow employees:
When people are shooting each other tomorrow, I will try to rest in the knowledge that we tried.
Alluding to tweets by former President Trump, the Proud Boys, and other extremist groups, she spoke of realising that we were at the whim of a violent crowd that was locked and loaded.
In the weeks after the 2019 Christchurch massacre, there were hopeful signs that nations individually and collectively were prepared to better regulate the internet.
Social media companies had fought hard against accepting responsibility for their content, citing arguments that reflected the libertarian philosophies of internet pioneers. In the name of freedom, they argued, long established rules and behavioural norms should be set aside. Their success in influencing law makers has enabled companies to avoid legal penalty, even when their platforms are used to motivate, plan, execute and livestream violent attacks.
After Christchurch, mounting public outrage forced the mainstream companies into action. They acknowledged their platforms had played a role in violent attacks, adopted more stringent policies around acceptable content, hired more content moderators, and expanded their ability to intercept extreme content before it was published.
It seemed unthinkable back in 2019 that real action would not be taken to regulate and moderate social media platforms to prevent the propagation of violent, online extremism in all its forms. The livestream was a core element of the Christchurch attack, carefully framed to resemble a video game and intended to inspire future attacks.
Nearly two years later, multiple social media platforms were central to the incitement and organising of the violent attack on the US Capitol that caused multiple deaths and injuries, and led many to fear a civil war was about to erupt.
Indeed, social media was implicated in every aspect of the Capitol Building attack, just as it had been in the Christchurch massacre. Both were fermented by wild and unfounded conspiracy theories that circulated freely across social media platforms. Both were undertaken by people who felt strongly connected to an online community of true believers.
Read more: Uncivil wars? Political lies are far more dangerous than Twitter pile-ons
The testimony of Stephen Ayres to the January 6 congressional hearings provides a window into the process of radicalisation.
Describing himself as an ordinary family man who was hard core into social media, Ayres pleaded guilty to a charge of disorderly conduct for his role in the Capitol invasion. He referenced his accounts on Twitter, Facebook and Instagram as the source of his belief that the 2020 US Presidential election had been stolen. His primary sources were posts made by the former president himself.
Ayres testified that a tweet by President Trump had led him to attend the Save America rally. He exemplified the thousands of Americans who were not members of any extremist group, but had been motivated through mainstream social media to travel to Washington D.C.
The role of former US President Trump in the rise of right-wing extremism, in the US and beyond, is a recurring theme in Rethinking Social Media and Extremism, which I co-edited with Paul Pickering. At the time of the Christchurch massacre, there was ample evidence that US-based internet companies were providing global platforms for extremist causes.
Yet whenever their content moderation extended to the voices of the far right, these companies faced censure from conservatives, including from the Trump White House. The message was clear: allowing unfettered free speech for the so-called alt-right was the price social media companies would have to pay for their oligopoly. Though the growing danger of domestic terrorism was apparent, the threat of antitrust suits was a powerful disincentive for corporate action against right-wing extremists.
Social media companies have faced significant pressure from nations outside the US. For example, within months of the Christchurch attack, world leaders came together in Paris to sign the Christchurch Call to combat violent extremism online. The document was moderate in tone, but the US refused to sign. Instead, the White House doubled down in alleging that the major threat lay in the suppression of conservative voices.
In 2021, the Biden administration belatedly signed up to the Christchurch Call, but it has not succeeded in advancing any measures domestically. Despite some tough talk during the election campaign, President Biden has been unable to pass legislation that would better regulate technology companies.
With the midterm elections looming elections which often go against the party of the president there is little reason for optimism. The decisions of US lawmakers will continue to reverberate globally while ownership of Western social media remains firmly centred in the US.
Read more: How self-publishing, social media and algorithms are aiding far-right novelists
The spirit of libertarianism lives on within companies that exploded from home-grown start-ups to trillion dollar corporations within a decade. Their commitment to self-regulation suited legislators, who struggled to understand this new and constantly shape-shifting technology. The demonstrable failure of self-regulation has proven lethal for the targets of terrorism and now presents as a danger to democracy itself.
In her chapter in Rethinking Social Media and Extremism, Sally Wheeler asks us to reconsider the basis of the social licence social media companies have to operate within democracies. She argues that, rather than asking whether their activities are legal, we might ask what reforms are needed to ensure social media does not cause serious harm to people or societies.
Now central to the provision of many public services, social media platforms might be deemed public utilities and, for this reason alone, be subject to different and higher rules and expectations. This point was amply if unintentionally demonstrated by Facebook itself when it blocked many sites including emergency services during a disagreement with the Australian Government in 2021. In the process, Facebook shone a spotlight on the nations growing reliance on a poorly regulated, privately owned platform.
Amid the national outcry following the Christchurch massacre, the Australian government hastily introduced legislation intended to increase the responsibilities of internet companies. Reportedly drafted in just 48 hours before being rushed through both houses of parliament, the bill was always going to be flawed.
Effective reform demands that we first recognise the internet as a space in which actions carry real-world consequences. The most visible victims are those directly targeted by threats of extreme violence mainly women, immigrants and minorities. Even when the threats are not enacted, people are intimidated into silence, even self-harm.
More insidious but perhaps just as harmful in the long term, is the overall decline in civility that drives public discourse towards extreme positions. On social media, what is known as the Overton Window of mainstream political debate has not so much been pushed out as kicked in.
There is broad agreement that existing legal and regulatory frameworks are simply inadequate for the digital age. Yet even as the global pandemic has accelerated our reliance on all things digital, there is less agreement about the nature of the problem, much less about the remedies required. While action is clearly needed, there is always the danger of overreach.
The functioning of democratic society depends as much on our ability to debate ideas and express dissent as it does on the prevention of violent extremism. Our challenge is to balance free speech against other competing rights on the internet, just as we do elsewhere. The current approach of simply ratcheting up the penalties faced by social media companies is more likely to tip the balance against free speech. In a communication landscape that is increasingly concentrated in the hands of just a few major corporations, we are in need of more voices and more diversity, not less.
Excerpt from:
- The Grotesque Slander of Comparing Gaza Protesters to Neo-Nazis - The New Republic - April 29th, 2024 [April 29th, 2024]
- Joe Alt Is A Strong Fit For The Los Angeles Chargers - Sports Illustrated - April 29th, 2024 [April 29th, 2024]
- How The Manosphere Of Alt Right Content Targets Boys - BuzzFeed - April 29th, 2024 [April 29th, 2024]
- Say Hello To Joe Alt, Future Hall Of Fame Right Tackle - Barstool Sports - April 29th, 2024 [April 29th, 2024]
- An Alt-Right Icon Just Gave the Single Dumbest Seinfeld Take Ever - Cracked.com - April 4th, 2024 [April 4th, 2024]
- Ireland & Wales Rugby Fans Take On Alt-Right On Twitter - Balls.ie - February 18th, 2024 [February 18th, 2024]
- Doja Cat Reacts to Backlash Over Alt-Right Comedian T-Shirt: 'It Didn't Affect the World' - TooFab - December 19th, 2023 [December 19th, 2023]
- Doja Cat Responds To Backlash Over Alt-Right T-Shirt: 'It's Not An Attack' - HipHopDX - December 19th, 2023 [December 19th, 2023]
- Marvel and DC Writer Mark Waid Rejects Mark Millar's Call To Root Out Comic Book 'Cancel Pigs', Dishonestly Paints ... - Bounding Into Comics - December 19th, 2023 [December 19th, 2023]
- Maudlin Strangers unveil intense alt rock banger Im Not In The Right Mind [Video] - EARMILK - December 19th, 2023 [December 19th, 2023]
- The Dark Economics of Russell Brand - WIRED - September 23rd, 2023 [September 23rd, 2023]
- Pro-Kremlin Propagandist Ties to White Nationalist Movement ... - Southern Poverty Law Center - September 23rd, 2023 [September 23rd, 2023]
- Opinion | How to Argue Against Identity Politics Without Turning Into ... - The New York Times - September 23rd, 2023 [September 23rd, 2023]
- Anna Wintour: 'I just have to make sure things are being done right' - Financial Times - September 23rd, 2023 [September 23rd, 2023]
- Opinion | Donald Trumps Abortion Shell Game - The New York Times - September 23rd, 2023 [September 23rd, 2023]
- How to Treat Right-Wing Violence in the U.S. - The New Yorker - August 30th, 2023 [August 30th, 2023]
- Scalise, No. 2 House Republican, Says He Has Blood Cancer - The New York Times - August 30th, 2023 [August 30th, 2023]
- Emails reveal Secret Service contacts with Oath Keepers - Citizens for Responsibility and Ethics in Washington - August 30th, 2023 [August 30th, 2023]
- How Trump's Election Lies Left the Michigan G.O.P. Broken and ... - The New York Times - August 30th, 2023 [August 30th, 2023]
- Alt Right: A Primer on the New White Supremacy | ADL - March 2nd, 2023 [March 2nd, 2023]
- The Dangerous Subtlety of the Alt-Right Pipeline - March 2nd, 2023 [March 2nd, 2023]
- The Alt-Right Manipulated My Comic. Then A.I. Claimed It. - March 2nd, 2023 [March 2nd, 2023]
- Richard Spencer: Five Things to Know - Anti-Defamation League - February 20th, 2023 [February 20th, 2023]
- From Alt Right to Alt Lite: Naming the Hate - Anti-Defamation League - February 18th, 2023 [February 18th, 2023]
- Alt-right Definition & Meaning | Dictionary.com - February 18th, 2023 [February 18th, 2023]
- What Is QAnon, the Viral Pro-Trump Conspiracy Theory? - January 8th, 2023 [January 8th, 2023]
- Benedict XVIs Most Powerful Influence on the Catholic Church Came Before He Was Pope - The New Yorker - January 6th, 2023 [January 6th, 2023]
- Netflix Removed Kanye's 'Harmful Alt-Right Beliefs' From David ... - November 23rd, 2022 [November 23rd, 2022]
- Where Are All the Women on This Alt-Right, Anti-Choice, Toxic ... - November 23rd, 2022 [November 23rd, 2022]
- Forbes Gets Punked - Labels FTX Former CEO's Girlfriend a "New Darling ... - November 23rd, 2022 [November 23rd, 2022]
- Alt-Right Picks Wrong Side in Dutch Farm Crisis - November 23rd, 2022 [November 23rd, 2022]
- La Mirada Chamber Invited Alt-Right Racist to Moderate School Board ... - October 30th, 2022 [October 30th, 2022]
- Hate & Extremism | Southern Poverty Law Center - October 30th, 2022 [October 30th, 2022]
- America First Political Action Conference - Wikipedia - October 25th, 2022 [October 25th, 2022]
- Pepe the Frog - ADL - October 25th, 2022 [October 25th, 2022]
- Paul Joseph Watson - Wikipedia - October 25th, 2022 [October 25th, 2022]
- Jack Posobiec - Wikipedia - October 25th, 2022 [October 25th, 2022]
- QUIET - Wikipedia - October 25th, 2022 [October 25th, 2022]
- Shintaro Abe - Wikipedia - October 25th, 2022 [October 25th, 2022]
- #FireMcMaster, explained. How alt-right media and a handful of | by ... - October 23rd, 2022 [October 23rd, 2022]
- Right-wing politics - Wikipedia - October 23rd, 2022 [October 23rd, 2022]
- Real Viking History and the Imagined White Supremacist Past | Time - October 23rd, 2022 [October 23rd, 2022]
- More Toxic, Alt-Right, QAnonism | No Minister - October 23rd, 2022 [October 23rd, 2022]
- Steve Bannon's influence on conservative politics: Expert on alt-right explains - University of Colorado Boulder - October 23rd, 2022 [October 23rd, 2022]
- Alt-right - Wikipedia - October 17th, 2022 [October 17th, 2022]
- Alt Right: A Primer on the New White Supremacy - Anti-Defamation League - October 17th, 2022 [October 17th, 2022]
- How the Alt-Right Happened - American University - October 17th, 2022 [October 17th, 2022]
- Alt-right pipeline - Wikipedia - October 17th, 2022 [October 17th, 2022]
- Richard B. Spencer - Wikipedia - October 6th, 2022 [October 6th, 2022]
- incel Meaning & Origin | Slang by Dictionary.com - October 6th, 2022 [October 6th, 2022]
- red pill Meaning & Origin | Slang by Dictionary.com - October 6th, 2022 [October 6th, 2022]
- Just The News - Media Bias/Fact Check - October 6th, 2022 [October 6th, 2022]
- The Download: TikTok moral panics, and DeepMinds record-breaking AI - MIT Technology Review - October 6th, 2022 [October 6th, 2022]
- Roe vs. Trump in the Michigan Midterms - The New Yorker - October 6th, 2022 [October 6th, 2022]
- PhD student examines clash of masculine identities on internet hate site - University of Toronto - September 27th, 2022 [September 27th, 2022]
- By Reading Brainwaves, an A.I. Aims to Predict What Words People Listened to - Smithsonian Magazine - September 15th, 2022 [September 15th, 2022]
- A Case of Rhabdomyolysis in a Young, Morbidly Obese, Asthmatic Woman With COVID-19 - Cureus - September 11th, 2022 [September 11th, 2022]
- Mothers of the movement: Leadership by alt-right women paves the way for violence - The Conversation - September 11th, 2022 [September 11th, 2022]
- An antidemocratic philosophy called 'neoreaction' is creeping into GOP politics - The Conversation - August 2nd, 2022 [August 2nd, 2022]
- How Stop the Steal Captured the American Right - The New York Times - August 2nd, 2022 [August 2nd, 2022]
- Alt Right: A Primer on the New White Supremacy - June 24th, 2022 [June 24th, 2022]
- Will Tehama Sheriff Candidates Ties to Alt-Right Extremists Alarm ... - June 24th, 2022 [June 24th, 2022]
- Racist Great Replacement Conspiracy Went From Alt-Right to Mainstream - June 24th, 2022 [June 24th, 2022]
- Trump and his mob tried to overthrow American democracy and threaten to try again - Ohio Capital Journal - June 24th, 2022 [June 24th, 2022]
- Pacifism is the wrong response to the war in Ukraine - The Guardian - June 24th, 2022 [June 24th, 2022]
- How Culture Went Back to the Middle Ages - ArtReview - June 24th, 2022 [June 24th, 2022]
- FoxO3 restricts liver regeneration by suppressing the proliferation of hepatocytes | npj Regenerative Medicine - Nature.com - June 24th, 2022 [June 24th, 2022]
- The Alt-Right Has Its Very Own TV Show On Adult Swim - June 11th, 2022 [June 11th, 2022]
- The Nation: "The Libertarian Party Goes Alt-Right" - June 11th, 2022 [June 11th, 2022]
- Milwaukee business owners don't all want the RNC - Wisconsin Examiner - June 11th, 2022 [June 11th, 2022]
- Alt-Right Incels at Deep State Daily Stormer Site Celebrate Buffalo ... - June 3rd, 2022 [June 3rd, 2022]
- Alt Right Journalist Whos Lost Every Lawsuit Over Banned Accounts ... - June 3rd, 2022 [June 3rd, 2022]
- PBS, Lincoln Project Label DeSantis, Press Secretary 'Alt-Right' - June 3rd, 2022 [June 3rd, 2022]
- Johnny Depp-Amber Heard Verdict: The Actual Malice of the Trial - The New York Times - June 3rd, 2022 [June 3rd, 2022]
- How To Keep Meat Juicy With Science : Short Wave - NPR - June 3rd, 2022 [June 3rd, 2022]
- What Do Female Incels Really Want? - The Atlantic - May 17th, 2022 [May 17th, 2022]
- 'Well be here again': How tech companies try and fail to prevent terrorism - Protocol - May 17th, 2022 [May 17th, 2022]
- Republican and more Republican: Idaho shifts ever rightward - The Guardian - May 11th, 2022 [May 11th, 2022]
- Listen up! Here are the finalists of the 2022 Student Podcast Challenge - GBH News - May 11th, 2022 [May 11th, 2022]
- Dark Enlightenment - Wikipedia - April 27th, 2022 [April 27th, 2022]