If it seems like every week theres a new scandal about ethics and the tech industry, its not your imagination. Even as the tech industry is trying to establish concrete practices and institutions around tech ethics, hard lessons are being learned about the wide gap between the practices of doing ethics and what people think of as ethical. This helps explain, in part, why it raises eyebrows when Google dissolves its short-lived AI ethics advisory board, in the face of public outcry about including a controversial alumnus of the Heritage Foundation on it, or when organized pressure from Googles engineering staff results in the cancellation of military contracts.
This gap is important, because alongside these decidedly bad calls by those leading the charge for ethics in industry, we are also seeing the tech sector begin investing meaningful resources in the organizational capacity to identify, track, and mitigate the consequences of algorithmic technologies. We are at a point where it would seem that the academics and critics who had exhorted the industry to make such considerations for decades should be declaring a small victory. Yet in many cases, those same outside voices are raising a vigorous round of objections to the tech industrys choices, often with good reason. While just a few years ago, it seemed everyone shared an understanding of what was meant by ethics in the tech industry, now that ethics is a site of power, who gets to determine the meaning and practices of ethics is being hotly contested.
In Silicon Valley, however, it is unclear what all of this means, particularly when it comes to translating ethical principles into the practical necessities and language of business. Is tech ethics just the pursuit of robust processes? What are tech ethicists goals, and what is their theory of change? Is any of this work measurable in the frameworks companies already use to account for value? How much does ethics add to the cost of doing business, and what is the difference for companies that are just starting up, racing toward IPO, or already household names?
Building fair and equitable machine learning systems.
To find out, we along with co-author of the study, danah boyd (who prefers lowercase letters in her name) studied those doing the work of ethics inside of companies, whom we call ethics owners, to find out what they see as their task at hand. Owner is common parlance inside of flat corporate structures, meaning someone who is responsible for coordinating a domain of work across the different units of an organization. Our research interviewing this new class of tech industry professionals shows that their work is, tentatively and haltingly, becoming more concrete through both an attention to process and a concern with outcomes. We learned that people in these new roles encounter an important set of tensions that are fundamentally not resolvable. Ethical issues are never solved, they are navigated and negotiated as part of the work of ethics owners.
The central challenge ethics owners are grappling with is negotiating between external pressures to respond to ethical crises at the same time that they must be responsive to the internal logics of their companies and the industry. On the one hand, external criticisms push them toward challenging core business practices and priorities. On the other hand, the logics of Silicon Valley, and of business more generally, create pressures to establish or restore predictable processes and outcomes that still serve the bottom line.
We identified three distinct logics that characterize this tension between internal and external pressures:
Meritocracy: Although originally coined as a derisive term in satirical science fiction by British sociologist Michael Young, meritocracy infuses everything in Silicon Valley from hiring practices to policy positions, and retroactively justifies the industrys power in our lives. As such, ethics is often framed with an eye toward smarter, better, and faster approaches, as if the problems of the tech industry can be addressed through those virtues. Given this, it is not surprising that many within the tech industry position themselves as the actors best suited to address ethical challenges, rather than less technically-inclined stakeholders, including elected officials and advocacy groups. In our interviews, this manifested in relying on engineers to use their personal judgement by grappling with the hard questions on the ground, trusting them to discern and to evaluate the ethical stakes of their own products. While there are some rigorous procedures that help designers scan for the consequences of their products, sitting in a room and thinking hard about the potential harms of a product in the real world is not the same as thoroughly understanding how someone (whose life is very different than a software enginee) might be affected by things like predictive policing or facial recognition technology, as obvious examples. Ethics owners find themselves being pulled between technical staff that assert generalized competence over many domains and their own knowledge that ethics is a specialized domain that requires deep contextual understanding.
Market fundamentalism: Although it is not the case that tech companies will choose profit over social good in every instance, it is the case that the organizational resources necessary for morality to win out need to be justified in market-friendly terms. As a senior leader in a research division explained, this means that the system that you create has to be something that people feel adds value and is not a massive roadblock that adds no value, because if it is a roadblock that has no value, people literally wont do it, because they dont have to. In the end, the market sets the terms of the debate, even if maximum profit is not the only acceptable outcome. Ethics owners therefore must navigate between avoiding measurable downside risks and promoting the upside benefits of more ethical AI. Arguing against releasing a product before it undergoes additional testing for racial or gender bias, or in order to avoid a potential lawsuit, is one thing. Arguing that the more extensive testing will lead to greater sales numbers is something else. Both are important, but one fits squarely inside the legal and compliance team, the other fits better in product teams.
Technological solutionism: The idea that all problems have tractable technical fixes has been reinforced by the rewards the industry has reaped for producing technology that they believe does solve problems. As such, the organizational practices that facilitate technical success are often ported over to ethics challenges. This is manifested in the search for checklists, procedures, and evaluative metrics that could break down messy questions of ethics into digestible engineering work. This optimism is counterweighted by a concern that, even when posed as a technical question, ethics becomes intractable, like its too big of a problem to tackle.This tension is on stark display in addressing bias and unfairness in AI; there are dozens of solutions for fixing algorithmic bias through complex statistical methods, but less work on addressing the underlying bias in data collection or in the real world that that data is collected from. And even for a fair algorithm, fairness is only a subset of ethical questions about a product. What good is fairness if it only leads to a less biased set of people harmed by a dangerous product?
Our research shows that even if they are all engaged in some form of critique of it, the collective goal of ethics owners is not to stop the tech industry. They, like the engineers they work alongside, are enmeshed in organizational cultures that reward metric-oriented and fast-paced work with more resources. This ratchets up the pressure to fit in and ratchets down the capacity to object, which makes it all the more difficult to distinguish between success and failure moral victories can look like punishment while ethically questionable products earn big bonuses. The tensions that arise from this must be worked through, with one eye on process, certainly, but also with the other eye squarely focused on outcomes, both short- and long-term, both inside and outside companies, and as both employees and members of a much broader society.
We saw these tensions when the co-founder of the Stanford Human-Centered AI (HAI) Institute, the renowned AI researcher Fei-Fei Li, became notorious while working at Google for warning in a leaked email that Googlers should not publicly discuss the role of their AI products in constructing a system for facial analysis on military drones. Rather than using her considerable sway advocating against the military contract for obviously ethically-troubling technology, Li argued to colleagues that discussing Project Maven publicly would lead to damaging the positive image they had cultivated through talk of humanistic AI.
Similarly, when human rights legal scholar Philip Alston said from the 2018 AI Now symposium stage, half-jokingly, I want to strangle ethics, he was not implying that he wishes people and companies to be less ethical, but rather that ethics as opposed to a human rights legal framework, for example is typically approached as a non-normative, open-ended, undefined and unaccountable endeavor focused on achieving a robust process rather than a substantive outcome. Oddly enough, Alstons take on ethics is copacetic with Lis: ethics as a series of processes appears to not need to make substantive commitments to just outcomes.
For better or worse, the parameters of those processes will drive future administrative regulations, algorithmic accountability documentation, investment priorities, and human resource decisions. When we collectively debate how to manage the consequences of digital technologies, we should include more of the perspective of people whose labor is shaping this part of our futures.
Excerpt from:
The Ethical Dilemma at the Heart of Big Tech Companies
- 2023 Boosts Big Techs AI monopoly? Google, Microsoft, Nvidia, and others wield money power - HT Tech - January 2nd, 2024 [January 2nd, 2024]
- Alphabet (GOOGL) and Meta Shows Power of Ads Over Subscriptions - Bloomberg - January 2nd, 2024 [January 2nd, 2024]
- Looking Beyond The 'Magnificent 7' Analysts Just Upgraded These Three Large-Cap Stocks - Anheuser-Busch - Benzinga - January 2nd, 2024 [January 2nd, 2024]
- Mapping the Biggest Tech Talent Hubs in the U.S. and Canada - Visual Capitalist - January 2nd, 2024 [January 2nd, 2024]
- Google, Meta, other tech giants slash DEI-related jobs, resource groups in 2023: Report - Fox Business - January 2nd, 2024 [January 2nd, 2024]
- South Koreas proposed tech regulations would be a gift to China - The Hill - January 2nd, 2024 [January 2nd, 2024]
- Outlook 2024: Big changes to expect in personal tech - The Indian Express - January 2nd, 2024 [January 2nd, 2024]
- Big Tech Dumped $17 Billion Into AI Companies in 2023 Despite Frozen Market - The Messenger - January 2nd, 2024 [January 2nd, 2024]
- Why OpenAI signals the start of the post-Christensen startup world - Tech.eu - January 2nd, 2024 [January 2nd, 2024]
- Opinion | Lindsey Graham and Elizabeth Warren: When It Comes to Big Tech, Enough Is Enough - The New York Times - July 29th, 2023 [July 29th, 2023]
- Globe editorial: Canada can't tackle Big Tech on its own - The Globe and Mail - July 29th, 2023 [July 29th, 2023]
- July jobs report and more Big Tech earnings are in the week ahead after markets notch historic run for Dow - CNBC - July 29th, 2023 [July 29th, 2023]
- A Setback in the F.T.C.'s Fight Against Big Tech - The New Yorker - July 29th, 2023 [July 29th, 2023]
- Be strong in the fight against Big Tech, Canada - Canada's National Observer - July 29th, 2023 [July 29th, 2023]
- Decoding volatility: Are big tech stocks as stable as we think? - CryptoSlate - July 29th, 2023 [July 29th, 2023]
- Patients think their health data will be leaked and don't trust big tech ... - Contemporary Pediatrics - July 29th, 2023 [July 29th, 2023]
- The Role of Artificial Intelligence in Big Tech Earnings Season - Fagen wasanni - July 29th, 2023 [July 29th, 2023]
- The problem with Big Tech's voluntary AI safety commitments - Emerging Tech Brew - July 29th, 2023 [July 29th, 2023]
- How the Crypto Market Prepares Ahead of Big Tech Earnings ... - BeInCrypto - July 29th, 2023 [July 29th, 2023]
- Tony Anscombe: It's Misleading to Ask if Big Tech Wants to Read ... - BroadbandBreakfast.com - July 29th, 2023 [July 29th, 2023]
- The Week Ahead: Fed, ECB and BoJ set rates, and Big Tech ... - Financial Times - July 29th, 2023 [July 29th, 2023]
- China's Big Tech making a comeback with Beijing offering fresh ... - The Straits Times - July 29th, 2023 [July 29th, 2023]
- Montgomery County school district sues Big Tech over youth mental ... - Washington Times - June 18th, 2023 [June 18th, 2023]
- Big Tech knows most Brits don't know how to protect their online ... - TechRadar - June 18th, 2023 [June 18th, 2023]
- The time for talk is over is time for action on data privacy - The Hill - June 18th, 2023 [June 18th, 2023]
- Meet the man calling out Big Techs climate hypocrisy - Corporate Knights Magazine - June 18th, 2023 [June 18th, 2023]
- Letter: UK watchdog's tough stance on Big Tech should reassure MPs - Financial Times - June 18th, 2023 [June 18th, 2023]
- Peter Thiel on Big Tech: A Throwback Lecture - Walter Bradley Center for Natural and Artificial Intelligence - June 18th, 2023 [June 18th, 2023]
- Big Tech Is Big Tobacco - The Lever - May 6th, 2023 [May 6th, 2023]
- Graham fires warning shot at Big Tech: Were going to unleash the courtrooms of America on you - Fox News - May 6th, 2023 [May 6th, 2023]
- Experts weigh the current cost of anticompetitive behavior in Big ... - NYU Law - May 6th, 2023 [May 6th, 2023]
- Big Tech lobbying on AI regulation as industry races to harness ... - Center for Responsive Politics - May 6th, 2023 [May 6th, 2023]
- 'Big Tech is knowingly fueling a mental-health crisis in this country ... - Morningstar - May 6th, 2023 [May 6th, 2023]
- EY's Abandoned Split Exposes Obstacles to Big Tech Consulting - Bloomberg Tax - May 6th, 2023 [May 6th, 2023]
- Apple CEO Tim Cook calls mass layoffs a last resort, as the company avoids the giant job cuts of its Big Tech peers - Yahoo Finance - May 6th, 2023 [May 6th, 2023]
- Big Tech stocks are flying! Which ones are the best buys today? - Motley Fool UK - May 6th, 2023 [May 6th, 2023]
- Why Indian start-ups have accused the Internet and Mobile Association of India of spreading Big Tech propaganda - The Indian Express - May 6th, 2023 [May 6th, 2023]
- Intimate Images Protection Update Big Tech Warned To Be Ready ... - BC INJURY LAW - May 6th, 2023 [May 6th, 2023]
- Apple Stock and Big Tech Are Winners. Why Cathie Wood's ARK Is Still a Loser. - Barron's - May 4th, 2023 [May 4th, 2023]
- White House officials will meet Big Tech CEOs as President Biden looks to tackle AI safety concerns - Yahoo Canada Finance - May 4th, 2023 [May 4th, 2023]
- The top 10 buzziest companies Gen Z wants to work fornone of them are in Big Tech, says new report - CNBC - May 4th, 2023 [May 4th, 2023]
- Apple Reports Earnings Today. What to Expect. - Barron's - May 4th, 2023 [May 4th, 2023]
- Big Tech Earnings: Time to Take Another Bite of Apple? - Yahoo Finance - May 4th, 2023 [May 4th, 2023]
- Vibe Check: Big Tech Is Losing Its 'Luster' For The Class Of 2023 Amid Mounting Layoffs And An Uncertain Economy - Forbes - May 4th, 2023 [May 4th, 2023]
- Lindsey Graham says Big Tech will kill online child safety bill, teases plan with Elizabeth Warren - Washington Times - May 4th, 2023 [May 4th, 2023]
- 'Break them open' new EU rules coming for Big Tech - TNW - May 4th, 2023 [May 4th, 2023]
- EY's Abandoned Split Exposes Obstacles to Big Tech Consulting - Bloomberg Law - May 4th, 2023 [May 4th, 2023]
- Open Source Communities Need More Than Funding From Big Tech - DevOps.com - May 4th, 2023 [May 4th, 2023]
- Night School, Class 3: Big Tech vs the insurgents - Financial Times - May 4th, 2023 [May 4th, 2023]
- MM View: The Big Tech monster is coming for you - but only if you let it - Money Marketing - May 4th, 2023 [May 4th, 2023]
- Big Tech has eviscerated America's patent system The Gilmer Mirror - Gilmer Mirror - May 4th, 2023 [May 4th, 2023]
- We need regulators with teeth to fight Big Tech monopolism - The Spectator Australia - May 4th, 2023 [May 4th, 2023]
- IAMAI showdown: Start-ups explore other lobby groups to fight Big Tech dominance - Moneycontrol - May 4th, 2023 [May 4th, 2023]
- Snap and Amazon Q1 Shows Big Tech's Advertising Advantage - The Information - May 4th, 2023 [May 4th, 2023]
- How big tech is undermining women's reproductive rights in ... - San Francisco Chronicle - May 4th, 2023 [May 4th, 2023]
- Opinion: Failure to regulate artificial intelligence will entrench Big ... - The Globe and Mail - May 4th, 2023 [May 4th, 2023]
- Tech layoffs: Yes, there's a better way to fire people. Is Big Tech doing it? No way. - Yahoo Finance - March 31st, 2023 [March 31st, 2023]
- As Big Tech cuts workers, other industries are desperate to hire them - February 18th, 2023 [February 18th, 2023]
- Worlds 22 Biggest Tech Companies of 2023 - UserGuiding - February 18th, 2023 [February 18th, 2023]
- Big techs supersized ambitions | The Economist - February 18th, 2023 [February 18th, 2023]
- House Judiciary Committee chair Jim Jordan subpoenas big tech CEOs over user speech - CBS News - February 18th, 2023 [February 18th, 2023]
- At Tesla and Other Big Tech Firms, Its Not the Machines But the Assumptions Behind Them Causing Problems - Forbes - February 18th, 2023 [February 18th, 2023]
- Big Tech earnings face more heat as cloud cover fades | Reuters - February 5th, 2023 [February 5th, 2023]
- Big Tech earnings face more heat as cloud cover fades - February 5th, 2023 [February 5th, 2023]
- Big Tech on defense: Apple, Amazon and Google report earnings - CNN - February 5th, 2023 [February 5th, 2023]
- Californias new gold rush: Big tech moves to gain the edge in AI - The Indian Express - February 5th, 2023 [February 5th, 2023]
- Big (1988) - IMDb - January 25th, 2023 [January 25th, 2023]
- Big (film) - Wikipedia - January 25th, 2023 [January 25th, 2023]
- Dow books third straight day of gains, but Nasdaq and S&P 500 end lower as investors await big tech earnings - MarketWatch - January 25th, 2023 [January 25th, 2023]
- Google Layoffs: Big Tech Continues Downsizing - forbes.com - December 28th, 2022 [December 28th, 2022]
- Here Comes More Censorship: Rachel Levine Pressuring Big Tech to Shut ... - December 28th, 2022 [December 28th, 2022]
- Preserve local journalism by holding Big Tech accountable - December 21st, 2022 [December 21st, 2022]
- Fauci testimony 'confirms' Big Tech collusion to censor free speech on ... - December 21st, 2022 [December 21st, 2022]
- How big tech defeated the biggest antitrust push in decades on Capitol Hill - Los Angeles Times - December 21st, 2022 [December 21st, 2022]
- J6 Witch Hunt Is What Happens When Big Tech And Feds Team Up - December 12th, 2022 [December 12th, 2022]
- Big Tech, Big Fines | ZeroHedge - December 12th, 2022 [December 12th, 2022]
- Court: Psaki Must Testify Over White House's Big Tech Collusion - December 12th, 2022 [December 12th, 2022]
- Big Tech shows off its AI | Financial Times - December 12th, 2022 [December 12th, 2022]
- Big Tech and governments are fighting the fake reviews industry. India is gearing up too. - Economic Times - December 12th, 2022 [December 12th, 2022]
- VOTE: Do you trust Big Tech platforms to treat all points of view fairly? - ABC6OnYourSide.com - December 12th, 2022 [December 12th, 2022]