Our ability to collect and record information in a digital form has exploded as has our adoption of AI systems, which use data to make decisions. But data isnt neutral, and sexism, racism and other forms of discrimination are showing up in our data products. Catherine DIgnazio, an assistant professor of urban science and planning at the Massachusetts Institute of Technology (MIT), argues we need to do better. Along with Lauren Klein, who directs the Digital Humanities Lab at Emory University, she is the co-author of the new book Data Feminism, which charts a course for a more equitable data science. DIgnazio also directs MITs new Data and Feminism lab, which seeks to use data and computation to counter oppression.
What is data feminism and why do we need it?It is data science with an intersectional feminist lens. It takes all inequality into account at every stage of the data processing pipeline, including gender discrimination but also other forms of intersecting discrimination like racism, classism and ableism. And the reason we need it is to stop producing harmful racist and sexist data products.
We shouldnt be surprised about the sexist results coming out of these algorithms with the flawed data we are feeding in
When you look at data and AI this way, what kind of problems do you find?We find some people are winning and some people are losing. The benefits and harms are not being equally distributed. And those who are losing are disproportionately women, people of colour, and other marginalised groups. One way they are losing is that data most of us would think is important isnt being collected. We have detailed datasets on things like the length of guinea pig teeth and items lost on the New York City subway. But, in the US, missing data includes maternal mortality data, which has only started being collected recently, and sexual harassment data. And so much of our health and medical understanding is based on research that has been done exclusively on the male body.
How do people with less privilege show up in datasets?Weve had facial analysis software that is much less accurate for dark-skinned women and algorithms that disadvantage female applicants. Weve also had child abuse prediction software that over-targets poor families and predictive policing software like PredPol that disproportionately targets neighbourhoods of colour. The former pulls data from state health and welfare services, which poor people are more likely to access, while the latter is based on historical crime data; only US policing practices have always disproportionately surveilled and patrolled neighbourhoods of colour. We shouldnt be surprised about the racist and sexist results coming out of these algorithms with the deeply flawed data we are feeding in.
If our data and algorithms are all so flawed, how do we change things to make them better?First we need to be tuning in to the ways that oppressive forces might be insidiously inserting themselves into the data pipeline. More understanding is particularly needed among the technical folks who are making these systems. It is rarely the case that the discrimination in products is intentional; its just that nobody has ever taught them that it is a problem or emphasised that it is important. University data-science courses should include more than just a single ethics class.
Then we have to actually use data and computation to challenge inequality. We have to collect counter-data. Take for example the comprehensive dataset on Mexicos femicides gender-related killings of women and girls that has been compiled for the past five years from media reports by Mara Salguero, a citizen activist in that country. She is filling a vacuum because the Mexican government is not collecting the data. Now of course data alone is never enough. But if the data is used in concert with organising, lobbying and building political will, it can be very effective. In the US, we do have organisations working to call out injustice and produce their own counter-data, including Data for Black Lives, the Algorithmic Justice League and The Markup. We need to fund more of this kind of work.
Is there such thing as neutral data?There is a naive assumption that if you see numbers in a spreadsheet, they are real somehow. But data is never this raw, truthful input, and it is never neutral. It is information that has been collected in certain ways by certain actors and institutions for certain reasons. For example, there is a comprehensive database at the US federal level of sexual assaults on college campuses colleges are required to report it. But whether students come forward to make those reports will depend on whether the college has a climate that will support survivors. Most colleges are not doing enough, and so we have vast underreporting of those crimes. It is not that data is evil or never useful, but the numbers should never be allowed to speak for themselves because they dont tell the whole story when there are power imbalances in the collection environment.
Would data sciences bias problems be solved if there were simply more data scientists, coders and computer programmers who were women or from minority backgrounds?More diversity is an important part of the solution. As a group, data scientists are more likely to be male, white and highly educated. They have never experienced sexism, racism or classism so it is hard for them to see it. We call this the privilege hazard in the book and diversity can mitigate it.
But only including more women or people of colour is not going to solve everything. We need to put communities who will be impacted by the information systems into the process of making them. Because inevitably designers and programmers are going to be building systems for life experiences that they havent had. If everyone that builds a welfare application needs to have lived on welfare, that would be a high bar. Because I am a woman doesnt mean Im going to understand how to build an application for domestic workers. But there are participation strategies from other fields like urban planning and how we incorporate those in data science is an area ripe for exploration.
In the book you talk about Big Dick Data. What is it and should we just reject it outright?We coined it to denote big data projects that are characterised by masculine fantasies of world domination. Big Dick Data projects fetishise large size and prioritise it, along with speed, over quality, ignore context and inflate their technical capabilities. They also tend to have little consideration for inequalities or inclusion in the process. Mark Zuckerberg aiming to supersede human senses with AI might be considered one such project, along with software company Palantirs claims about massive-scale datasets. Big Dick Data projects arent necessarily wholly invalid, but they suck up resources that could be given smaller, more inclusive projects.
What would you most like people to think about or ask themselves when they encounter data or a graph in the media?A good general strategy and feminist practice is to ask what we call who questions. Who made this? Who collected the data? Whose lives are embodied in the data? Who is it serving? Who is harmed potentially? Asking these questions allows us to start to see how privilege is baked in.
How is privilege being baked into the coronavirus data we are collecting?The US governments response to coronavirus has been a case of missing data. There has been community spread, but the numbers are completely unreliable because kits are in short supply and people are having a hard time getting tests. And then poor people, which include many from immigrant backgrounds, will be less likely to seek tests because of lack of insurance, lack of ability to afford insurance co-pays and lack of paid sick time if they test positive.
Data Feminism by Catherine DIgnazio and Lauren F Klein is published by MIT (25)
See the rest here:
Catherine DIgnazio: 'Data is never a raw, truthful input and it is never neutral' - The Guardian
- Jackboot - Wikipedia - December 8th, 2016 [December 8th, 2016]
- The Federalist #51 - Constitution Society - January 8th, 2017 [January 8th, 2017]
- Free oppression Essays and Papers - 123helpme - January 25th, 2017 [January 25th, 2017]
- Labour movements in Congo Brazzaville: Between oppression and self determination - CADTM.org - February 7th, 2017 [February 7th, 2017]
- A Modern Choice on Life - Harvard Political Review - February 7th, 2017 [February 7th, 2017]
- Opinion: While true oppression exists, hypocrisy of some women is clear - Shelby Township Source Newspapers - February 7th, 2017 [February 7th, 2017]
- Understanding Information Oppression in the Era of Trump - MediaFile - February 7th, 2017 [February 7th, 2017]
- Angolans Bravery Broke Down Chains of Colonial Oppression - Minister - AllAfrica.com - February 7th, 2017 [February 7th, 2017]
- Hoosier attorneys travel to Rwanda on legal mission trip - Indiana Lawyer - February 8th, 2017 [February 8th, 2017]
- Bishop: Government has betrayed me over refugees - Premier - February 9th, 2017 [February 9th, 2017]
- Open Letter to NFL Players Traveling to Israel on a Trip Organized by Netanyahu's Government - The Nation. - February 9th, 2017 [February 9th, 2017]
- Police Disperse Shiite Protesters Demanding Release Of El-Zakzaky - SaharaReporters.com - February 9th, 2017 [February 9th, 2017]
- Turkey's HDP Women's Assembly issues feminist call-to-arms against 'one man rule' - Left Foot Forward - February 9th, 2017 [February 9th, 2017]
- Collin Nji: The first African to win Google's CodeIn Challenge - Pulse ... - Pulse Nigeria - February 9th, 2017 [February 9th, 2017]
- Student leader says 'black-on-black crime is not a thing,' wants to ... - The College Fix - February 10th, 2017 [February 10th, 2017]
- Sri Lanka: Tamil Insurgents Marxism Versus Nationalism - Sri Lanka Guardian - February 11th, 2017 [February 11th, 2017]
- Israeli Knesset 'legalizes' robbery of Palestinian land - Liberation - February 12th, 2017 [February 12th, 2017]
- LETTER: Evangelical Lutheran Church respond to political cartoon - The Dickinson Press - February 12th, 2017 [February 12th, 2017]
- Visiting Our Past: Odyssey of Clyde pioneer Jacob Shook - Asheville Citizen-Times - February 12th, 2017 [February 12th, 2017]
- Organize to defeat Trump's Muslim ban | Fight Back! - Fight Back! Newspaper - February 12th, 2017 [February 12th, 2017]
- Do we have a legitimate government? - Altoona Mirror - February 13th, 2017 [February 13th, 2017]
- Anti-Castro Cuban-American lawmakers see a champion in Trump - The Daily Progress - February 13th, 2017 [February 13th, 2017]
- Anti-Trump Swedish Government Accused of Hypocrisy for Kowtowing to Iran - Heat Street - February 13th, 2017 [February 13th, 2017]
- CSG President vetoes Israel-Palestinian lunch resolution | The ... - The Michigan Daily - February 14th, 2017 [February 14th, 2017]
- Sweden's 'Feminist' Government Defends Veiling in Iran After Attacking Trump - Breitbart News - February 14th, 2017 [February 14th, 2017]
- U. Mass Students Plot Strike Against 'Oppression' of Migrants - Breitbart News - February 15th, 2017 [February 15th, 2017]
- March on Washington: Drawing the Line between Empowerment and Oppression - The Index - February 15th, 2017 [February 15th, 2017]
- Ethiopian Athlete Who Made Anti-government Gesture in Rio Reunites With Family - Voice of America - February 15th, 2017 [February 15th, 2017]
- Mottley: Tax clearance certificate an 'instrument of oppression' - Loop Barbados - February 15th, 2017 [February 15th, 2017]
- Sweden's 'feminist' government criticized for wearing headscarves in Iran - Washington Post - February 15th, 2017 [February 15th, 2017]
- Turkey purge: dark cloud of oppression hangs over country's universities - Times Higher Education (THE) (blog) - February 16th, 2017 [February 16th, 2017]
- Fox News' Todd Starnes Redefines 'The Deplorables' - Forward - February 16th, 2017 [February 16th, 2017]
- Christophobia: a Global Perspective - AINA (press release) - February 18th, 2017 [February 18th, 2017]
- AzaadiFreedom from Indian Oppression - Economic and Political Weekly - February 18th, 2017 [February 18th, 2017]
- Iraqi forces advance on Islamic State-held western Mosul - Stars and Stripes - February 20th, 2017 [February 20th, 2017]
- Henry Rollins Doesn't Smoke Pot, But Demands The Right to Choose To - Weed News - February 20th, 2017 [February 20th, 2017]
- UC San Diego Students Protest Visit by 'Oppressive and Offensive' Dalai Lama - Heat Street - February 20th, 2017 [February 20th, 2017]
- Commentary | We must all stand with Tibet - The McGill Daily (blog) - February 20th, 2017 [February 20th, 2017]
- In Trump's America, Christian proselytizing is another form of oppression - LGBTQ Nation - February 20th, 2017 [February 20th, 2017]
- Elders share experiences with oppression from their youth - B.C. Catholic Newspaper - February 20th, 2017 [February 20th, 2017]
- Iran tells US chess champion to wear a hijab here's how she responds - TheBlaze.com - February 22nd, 2017 [February 22nd, 2017]
- Afro-Mexican people brought to light - The Daily Evergreen - February 23rd, 2017 [February 23rd, 2017]
- Online activism is leading the fight against oppression but at what cost? - Asian Correspondent - February 23rd, 2017 [February 23rd, 2017]
- Stephen Miller was no hero fighting left-wing oppression at Santa ... - Los Angeles Times - February 23rd, 2017 [February 23rd, 2017]
- Grass-roots leaders join call for 'disrupting' oppression that hurts many - Catholic News Service - February 23rd, 2017 [February 23rd, 2017]
- President Trump Breaks a Promise on Transgender Rights - New York Times - February 24th, 2017 [February 24th, 2017]
- Pussy Riot Protests Through Make America Great Again Viral Video - Conatus News - February 24th, 2017 [February 24th, 2017]
- Governor Treen brought sunshine to Louisiana governmental conservatism - Bayoubuzz - February 24th, 2017 [February 24th, 2017]
- I want an international probe into failed Turkey coup Fethullah Glen - Citifmonline - February 24th, 2017 [February 24th, 2017]
- Lateral Oppression Hurts Us All - The Lakota Country Times - February 24th, 2017 [February 24th, 2017]
- On finding freedom from oppression, fear - Davisclipper - February 24th, 2017 [February 24th, 2017]
- Supreme Court denies bail to leading anti-base activist in Okinawa; government accused of oppression - The Japan Times - February 24th, 2017 [February 24th, 2017]
- Disobedience Checks Unjust Laws - The Oberlin Review - February 24th, 2017 [February 24th, 2017]
- Cycles and Oppression - Patheos (blog) - February 24th, 2017 [February 24th, 2017]
- Another Jewish cemetery desecrated; what will the President say? Isn't the government supposed to help? - San Diego Jewish World - February 27th, 2017 [February 27th, 2017]
- Transport groups hold nationwide transport strike to protest government's PUV modernization program - CNN Philippines - February 27th, 2017 [February 27th, 2017]
- Opinion: The Relevance of Orwell's 1984 - Emertainment Monthly (registration) (blog) - February 27th, 2017 [February 27th, 2017]
- Monitoring group documents Turkey-backed profiling in Netherlands - Turkey Purge - February 27th, 2017 [February 27th, 2017]
- What should we see in the ashes of the Standing Rock protest camp? - Liberation - February 28th, 2017 [February 28th, 2017]
- Opinion: Focusing on religious oppression in China misses the big ... - CNN - February 28th, 2017 [February 28th, 2017]
- Trump Vows Teamwork with 'Allies in the Muslim World' to 'Demolish and Destroy ISIS' - Breitbart News - March 1st, 2017 [March 1st, 2017]
- Freedom House: Chinese Communists Intensifying Religious ... - Voice of America - March 1st, 2017 [March 1st, 2017]
- ISIS Threatens China In New Video Showing Chinese Jihadists - Vocativ - March 1st, 2017 [March 1st, 2017]
- Focusing on religious oppression in China misses the big picture - Gant Daily - March 1st, 2017 [March 1st, 2017]
- This Is Why The Youth Is Picking Up Arms In Kashmir - Youth Ki Awaaz - March 2nd, 2017 [March 2nd, 2017]
- Saudi Arabia: Music video and government initiatives split society - Freemuse - March 3rd, 2017 [March 3rd, 2017]
- From Latin America to South Africa: it's time for effective solidarity towards Palestine - The Daily Vox (blog) - March 3rd, 2017 [March 3rd, 2017]
- Focusing on religious oppression in China misses the big picture - CNN International - March 3rd, 2017 [March 3rd, 2017]
- Articles: Islam, the Veil, and Oppression - American Thinker - American Thinker - March 3rd, 2017 [March 3rd, 2017]
- UK's student union rebukes officer for Israeli embassy plot - The Electronic Intifada (blog) - March 4th, 2017 [March 4th, 2017]
- Public needs to help get government back on track - Fairfield Daily Republic - March 4th, 2017 [March 4th, 2017]
- Shahbaz Bhatti's legacy six years on - DAWN.com - March 6th, 2017 [March 6th, 2017]
- The Readers' Forum: Monday letters - Winston-Salem Journal - March 6th, 2017 [March 6th, 2017]
- Focusing on religious oppression in China misses the big picture - CNN - March 6th, 2017 [March 6th, 2017]
- How America Became a Colonial Ruler in Its Own Cities - Vanity Fair - March 7th, 2017 [March 7th, 2017]
- Plurality of Americans are right: "dissatisfaction with government" worst problem facing country - Hilltop Views - March 7th, 2017 [March 7th, 2017]
- The Oppression of Eve: Was Patriarchy Actually The First Sin? - Patheos (blog) - March 7th, 2017 [March 7th, 2017]
- Thousands in women's rights march in Polish capital - National - thenews.pl - March 7th, 2017 [March 7th, 2017]
- Probe: Artist Blacklist Antidemocratic Oppression - KBS WORLD Radio - KBS WORLD Radio News - March 7th, 2017 [March 7th, 2017]
- Peoples' Tribunal Indicts Myanmar Leaders for Genocide Against Rohingya, Atrocities Against Kachin - The Chicago Monitor - March 8th, 2017 [March 8th, 2017]