Billions of people log onto social media platforms every day. As we spend an increasing portion of our lives online, our exposure to hate-based content becomes routine. The Anti-Defamation Leagues 2021 survey of hate and harassment on social media found that 41 percent of Americans experienced online harassment, while 27 percent experience severe harassment, which includes sexual harassment, stalking, physical threats, swatting, doxing, and sustained harassment. We are inundated with conspiracy theories, scams, misinformation, or racist speech that frustrate users or, worse, threaten our safety.
One way technology companies can create safer and more equitable online spaces is to moderate content more consistently and comprehensively. Tech companies have been frequently criticized for inconsistently enforcing their stated policies at the scale of billions of users, causing seismic levels of harm. It is unclear how content moderation teams are trained to recognize and address various forms of hate, such as antisemitism. Their training materials or even operational definitions have not been made public or shared privately with civil society. Additionally, as tech companies increasingly rely on artificial intelligence to remove offensive posts on social media platforms, we have no idea whether the perspective of targets of online hate is used to create these technologies.
For example, evidence from the leaked Facebook documents submitted by whistleblower Frances Haughen to the SEC in 2021 suggest that the haphazard way automated content moderation technologies are developed are overbroad in their understanding of hate and ineffective. The document states that current automated methods are removing less than 5% of all of the hate speech posted to Facebook. Furthermore, studies have shown that algorithms that detect hate speech online can often be racially biased.
It is crucial to find ways for communities that are often the targets of hate to contribute to the creation of technology tools that automate and augment content moderation. To model what this process might look like, the ADL Center for Technology and Society is building the Online Hate Index (OHI), a set of machine learning classifiers that detect hate targeting marginalized groups on online platforms. The first of this set, the OHI antisemitism classifier, draws upon the knowledge of both ADLs antisemitism experts and Jewish community volunteers who may have experienced antisemitism. Together, these groups are the best positioned to understand and operationalize a definition of antisemitism.
To better grasp how machine learning classifiers work, imagine a child taking in information that, through practice, helps them discern and understand their world. Machine learning works similarly. In the case of OHI, our machine learning antisemitism classifier takes in pieces of information (here, text) that have been determined to be antisemitic, or not, by ADL experts and Jewish volunteers.
Through practice, the algorithm learns to recognize antisemitic content and starts to generalize language patterns when given numerous examples of both antisemitism and not antisemitic content. In the same way, a child might take in specific information about a situation (This cup is orange) and start to generalize to their broader experience of the world (This is what the color orange looks like). Over time, the model gets better at predicting the likelihood that a piece of content it has never seen before a tweet, comment, or post is or is not antisemitic.
In August 2021, ADL conducted what we believe to be the first independent, AI-assisted, community-rooted measurement of identity-based hate across Reddit and Twitter. We found that the rate of antisemitic content on Twitter during the week we investigated was 25% higher than on Reddit. The potential reach of the antisemitic content we found on Twitter in that one week alone was 130 million people. If this is the case on some of the most responsible tech platforms, it stands to reason that these issues are much more dire on platforms run by other less forward-thinking tech companies, such as Facebook.
If all platforms were as open to sharing data as Twitter and Reddit, the future might be brighter. Groups like ADL would be able to employ tools like the OHI to audit all social platforms, rooted in the perspective of targeted communities, and ascertain the prevalence of hate against those groups on those platforms. We would then be able to evaluate whether efforts by the tech company were sufficient in decreasing hate on their platforms. We would be able to compare rates between platforms using the same measurements and determine what methods of mitigating hate have been most successful.
Unfortunately, as we described in our data accessibility scorecard, platforms other than Reddit and Twitter are not providing the necessary data to make this a reality. Platforms should provide the necessary data to make this a reality and if they do not, governments should find thoughtful means to require it.
ADL hopes the way that the OHI combines machine learning and human expertise and centers targeted communities in technology development offers a practical path to holding platforms accountable. The potential exists for other civil society organizations to develop similar tools using volunteers to label homophobia, transphobia, misogyny, and racism.
We need more technology that detects identity-based hate. If social media platforms are to effectively fight hate, they must allow the people most affected by it to lead the way.
Daniel Kelley is the Director of Strategy and Operations for the ADLCenter for Technology and Society
Originally posted here:
To Stop Online Hate, Big Tech Must Let Those Being Targeted Lead the Way - Algemeiner
- Report Sounds Alarm Over Growing Role of Big Tech in US Military-Industrial Complex - Common Dreams - April 18th, 2024 [April 18th, 2024]
- Big Tech's ad transparency tools especially X's are failing at their jobs, report finds - Mashable - April 18th, 2024 [April 18th, 2024]
- Big Tech Taps AI Agents to Drive Revenue Growth - PYMNTS.com - April 18th, 2024 [April 18th, 2024]
- National privacy standard eyed by Congress for data harvested by big tech companies Nebraska Examiner - Nebraska Examiner - April 18th, 2024 [April 18th, 2024]
- Big Tech is on a generative AI hiring spree - Fast Company - April 18th, 2024 [April 18th, 2024]
- Disruptive Innovation in the Era of Big Tech - HBR.org Daily - April 18th, 2024 [April 18th, 2024]
- Betting on US Big Tech? Top Earnings Reports to Watch in the Coming Week - FX Empire - April 18th, 2024 [April 18th, 2024]
- Big Tech Earnings Are Just Around the Corner - Meta Platforms (NASDAQ:META) - Benzinga - April 18th, 2024 [April 18th, 2024]
- WATCH LIVE: Will Cain holds panel to discuss Big Tech and Trump trial - Fox News - April 18th, 2024 [April 18th, 2024]
- Google fires 28 workers in aftermath of protests over big tech deal with Israeli government - The Bakersfield Californian - April 18th, 2024 [April 18th, 2024]
- Big Tech offices are getting smaller and that spells trouble for landlords - Quartz - April 18th, 2024 [April 18th, 2024]
- Asking Big Tech to police AI is like turning to 'oil companies to solve climate change,' AI researcher says - Fortune - April 18th, 2024 [April 18th, 2024]
- Big Tech Comes to Small Town: A Bitcoin Mining Story in Spur - CoinDesk - April 18th, 2024 [April 18th, 2024]
- Big Tech loses its appetite for office space, adding to landlords woes - Inman - April 18th, 2024 [April 18th, 2024]
- Google restructure leads to job cuts - Mobile World Live - April 18th, 2024 [April 18th, 2024]
- FTC's Lina Khan talks big tech monopolies on The Daily Show - The Ticker - April 18th, 2024 [April 18th, 2024]
- Digital public infrastructure will drive the future, not big tech: Amitabh Kant - BusinessLine - April 18th, 2024 [April 18th, 2024]
- Big tech is downsizing work space in another blow to office real estate | Mint - Mint - April 18th, 2024 [April 18th, 2024]
- UK Plans Talks With Big Tech to Limit Online Harm for Teens - Bloomberg - April 18th, 2024 [April 18th, 2024]
- Canada to Start Taxing Tech Giants in 2024 Despite US Complaints - Bloomberg - April 18th, 2024 [April 18th, 2024]
- US quarterly earnings to feature big growth in tech-related companies - Reuters - April 18th, 2024 [April 18th, 2024]
- Our View: Big Tech: Google continues to harm news groups for its own profit - Mankato Free Press - April 18th, 2024 [April 18th, 2024]
- Deepfake victims must punish Big Tech because Congress wont - The Hill - April 18th, 2024 [April 18th, 2024]
- Big tech kneecaps anyone researching it. The online harms bill needs to remove barriers to analysis - Policy Options - April 18th, 2024 [April 18th, 2024]
- Global future will not be driven by big tech but by India's DPI: Amitabh Kant - Moneycontrol - April 18th, 2024 [April 18th, 2024]
- Kids Code bills prompt epic showdown between regulators, activists and big tech firms - Biometric Update - April 18th, 2024 [April 18th, 2024]
- Tech Firms Retreating From Office Market - The Real Deal - April 18th, 2024 [April 18th, 2024]
- UKs antitrust enforcer sounds the alarm over Big Techs grip on GenAI - TechCrunch - April 18th, 2024 [April 18th, 2024]
- Time for government to regulate big tech - ACS - April 18th, 2024 [April 18th, 2024]
- UK Markets Authority Warns of AI Market Capture by Big Tech - BankInfoSecurity.com - April 18th, 2024 [April 18th, 2024]
- 2023 Boosts Big Techs AI monopoly? Google, Microsoft, Nvidia, and others wield money power - HT Tech - January 2nd, 2024 [January 2nd, 2024]
- Alphabet (GOOGL) and Meta Shows Power of Ads Over Subscriptions - Bloomberg - January 2nd, 2024 [January 2nd, 2024]
- Looking Beyond The 'Magnificent 7' Analysts Just Upgraded These Three Large-Cap Stocks - Anheuser-Busch - Benzinga - January 2nd, 2024 [January 2nd, 2024]
- Mapping the Biggest Tech Talent Hubs in the U.S. and Canada - Visual Capitalist - January 2nd, 2024 [January 2nd, 2024]
- Google, Meta, other tech giants slash DEI-related jobs, resource groups in 2023: Report - Fox Business - January 2nd, 2024 [January 2nd, 2024]
- South Koreas proposed tech regulations would be a gift to China - The Hill - January 2nd, 2024 [January 2nd, 2024]
- Outlook 2024: Big changes to expect in personal tech - The Indian Express - January 2nd, 2024 [January 2nd, 2024]
- Big Tech Dumped $17 Billion Into AI Companies in 2023 Despite Frozen Market - The Messenger - January 2nd, 2024 [January 2nd, 2024]
- Why OpenAI signals the start of the post-Christensen startup world - Tech.eu - January 2nd, 2024 [January 2nd, 2024]
- Opinion | Lindsey Graham and Elizabeth Warren: When It Comes to Big Tech, Enough Is Enough - The New York Times - July 29th, 2023 [July 29th, 2023]
- Globe editorial: Canada can't tackle Big Tech on its own - The Globe and Mail - July 29th, 2023 [July 29th, 2023]
- July jobs report and more Big Tech earnings are in the week ahead after markets notch historic run for Dow - CNBC - July 29th, 2023 [July 29th, 2023]
- A Setback in the F.T.C.'s Fight Against Big Tech - The New Yorker - July 29th, 2023 [July 29th, 2023]
- Be strong in the fight against Big Tech, Canada - Canada's National Observer - July 29th, 2023 [July 29th, 2023]
- Decoding volatility: Are big tech stocks as stable as we think? - CryptoSlate - July 29th, 2023 [July 29th, 2023]
- Patients think their health data will be leaked and don't trust big tech ... - Contemporary Pediatrics - July 29th, 2023 [July 29th, 2023]
- The Role of Artificial Intelligence in Big Tech Earnings Season - Fagen wasanni - July 29th, 2023 [July 29th, 2023]
- The problem with Big Tech's voluntary AI safety commitments - Emerging Tech Brew - July 29th, 2023 [July 29th, 2023]
- How the Crypto Market Prepares Ahead of Big Tech Earnings ... - BeInCrypto - July 29th, 2023 [July 29th, 2023]
- Tony Anscombe: It's Misleading to Ask if Big Tech Wants to Read ... - BroadbandBreakfast.com - July 29th, 2023 [July 29th, 2023]
- The Week Ahead: Fed, ECB and BoJ set rates, and Big Tech ... - Financial Times - July 29th, 2023 [July 29th, 2023]
- China's Big Tech making a comeback with Beijing offering fresh ... - The Straits Times - July 29th, 2023 [July 29th, 2023]
- Montgomery County school district sues Big Tech over youth mental ... - Washington Times - June 18th, 2023 [June 18th, 2023]
- Big Tech knows most Brits don't know how to protect their online ... - TechRadar - June 18th, 2023 [June 18th, 2023]
- The time for talk is over is time for action on data privacy - The Hill - June 18th, 2023 [June 18th, 2023]
- Meet the man calling out Big Techs climate hypocrisy - Corporate Knights Magazine - June 18th, 2023 [June 18th, 2023]
- Letter: UK watchdog's tough stance on Big Tech should reassure MPs - Financial Times - June 18th, 2023 [June 18th, 2023]
- Peter Thiel on Big Tech: A Throwback Lecture - Walter Bradley Center for Natural and Artificial Intelligence - June 18th, 2023 [June 18th, 2023]
- Big Tech Is Big Tobacco - The Lever - May 6th, 2023 [May 6th, 2023]
- Graham fires warning shot at Big Tech: Were going to unleash the courtrooms of America on you - Fox News - May 6th, 2023 [May 6th, 2023]
- Experts weigh the current cost of anticompetitive behavior in Big ... - NYU Law - May 6th, 2023 [May 6th, 2023]
- Big Tech lobbying on AI regulation as industry races to harness ... - Center for Responsive Politics - May 6th, 2023 [May 6th, 2023]
- 'Big Tech is knowingly fueling a mental-health crisis in this country ... - Morningstar - May 6th, 2023 [May 6th, 2023]
- EY's Abandoned Split Exposes Obstacles to Big Tech Consulting - Bloomberg Tax - May 6th, 2023 [May 6th, 2023]
- Apple CEO Tim Cook calls mass layoffs a last resort, as the company avoids the giant job cuts of its Big Tech peers - Yahoo Finance - May 6th, 2023 [May 6th, 2023]
- Big Tech stocks are flying! Which ones are the best buys today? - Motley Fool UK - May 6th, 2023 [May 6th, 2023]
- Why Indian start-ups have accused the Internet and Mobile Association of India of spreading Big Tech propaganda - The Indian Express - May 6th, 2023 [May 6th, 2023]
- Intimate Images Protection Update Big Tech Warned To Be Ready ... - BC INJURY LAW - May 6th, 2023 [May 6th, 2023]
- Apple Stock and Big Tech Are Winners. Why Cathie Wood's ARK Is Still a Loser. - Barron's - May 4th, 2023 [May 4th, 2023]
- White House officials will meet Big Tech CEOs as President Biden looks to tackle AI safety concerns - Yahoo Canada Finance - May 4th, 2023 [May 4th, 2023]
- The top 10 buzziest companies Gen Z wants to work fornone of them are in Big Tech, says new report - CNBC - May 4th, 2023 [May 4th, 2023]
- Apple Reports Earnings Today. What to Expect. - Barron's - May 4th, 2023 [May 4th, 2023]
- Big Tech Earnings: Time to Take Another Bite of Apple? - Yahoo Finance - May 4th, 2023 [May 4th, 2023]
- Vibe Check: Big Tech Is Losing Its 'Luster' For The Class Of 2023 Amid Mounting Layoffs And An Uncertain Economy - Forbes - May 4th, 2023 [May 4th, 2023]
- Lindsey Graham says Big Tech will kill online child safety bill, teases plan with Elizabeth Warren - Washington Times - May 4th, 2023 [May 4th, 2023]
- 'Break them open' new EU rules coming for Big Tech - TNW - May 4th, 2023 [May 4th, 2023]
- EY's Abandoned Split Exposes Obstacles to Big Tech Consulting - Bloomberg Law - May 4th, 2023 [May 4th, 2023]
- Open Source Communities Need More Than Funding From Big Tech - DevOps.com - May 4th, 2023 [May 4th, 2023]
- Night School, Class 3: Big Tech vs the insurgents - Financial Times - May 4th, 2023 [May 4th, 2023]
- MM View: The Big Tech monster is coming for you - but only if you let it - Money Marketing - May 4th, 2023 [May 4th, 2023]