Engineering | News releases | Technology
November 29, 2023
University of Washington researchers found that when prompted to create pictures of a person, the AI image generator over-represented light-skinned men, sexualized images of certain women of color and failed to equitably represent Indigenous peoples. For instance, compared here (clockwise from top left) are the results of four prompts to show a person from Oceania, Australia, Papua New Guinea and New Zealand. Papua New Guinea, where the population remains mostly Indigenous, is the second most populous country in Oceania.Ghosh et al./EMNLP 2023 AI GENERATED IMAGE
What does a person look like? If you use the popular artificial intelligence image generator Stable Diffusion to conjure answers, too frequently youll see images of light-skinned men.
Stable Diffusions perpetuation of this harmful stereotype is among the findings of a new University of Washington study. Researchers also found that, when prompted to create images of a person from Oceania, for instance, Stable Diffusion failed to equitably represent Indigenous peoples. Finally, the generator tended to sexualize images of women from certain Latin American countries (Colombia, Venezuela, Peru) as well as those from Mexico, India and Egypt.
The researchers will present their findings Dec. 6-10 at the 2023 Conference on Empirical Methods in Natural Language Processing in Singapore.
Its important to recognize that systems like Stable Diffusion produce results that can cause harm, said Sourojit Ghosh, a UW doctoral student in the human centered design and engineering department. There is a near-complete erasure of nonbinary and Indigenous identities. For instance, an Indigenous person looking at Stable Diffusions representation of people from Australia is not going to see their identity represented that can be harmful and perpetuate stereotypes of the settler-colonial white people being more Australian than Indigenous, darker-skinned people, whose land it originally was and continues to remain.
To study how Stable Diffusion portrays people, researchers asked the text-to-image generator to create 50 images of a front-facing photo of a person. They then varied the prompts to six continents and 26 countries, using statements like a front-facing photo of a person from Asia and a front-facing photo of a person from North America. They did the same with gender. For example, they compared person to man and person from India to person of nonbinary gender from India.
The team took the generated images and analyzed them computationally, assigning each a score: A number closer to 0 suggests less similarity while a number closer to 1 suggests more. The researchers then confirmed the computational results manually. They found that images of a person corresponded most with men (0.64) and people from Europe (0.71) and North America (0.68), while corresponding least with nonbinary people (0.41) and people from Africa (0.41) and Asia (0.43).
Likewise, images of a person from Oceania corresponded most closely with people from majority-white countries Australia (0.77) and New Zealand (0.74), and least with people from Papua New Guinea (0.31), the second most populous country in the region where the population remains predominantly Indigenous.
A third finding announced itself as researchers were working on the study: Stable Diffusion was sexualizing certain women of color, especially Latin American women. So the team compared images using a NSFW (Not Safe for Work) Detector, a machine-learning model that can identify sexualized images, labeling them on a scale from sexy to neutral. (The detector has a history of being less sensitive to NSFW images than humans.) A woman from Venezuela had a sexy score of 0.77 while a woman from Japan ranked 0.13 and a woman from the United Kingdom 0.16.
We werent looking for this, but it sort of hit us in the face, Ghosh said. Stable Diffusion censored some images on its own and said, These are Not Safe for Work. But even some that it did show us were Not Safe for Work, compared to images of women in other countries in Asia or the U.S. and Canada.
While the teams work points to clear representational problems, the ways to fix them are less clear.
We need to better understand the impact of social practices in creating and perpetuating such results, Ghosh said. To say that better data can solve these issues misses a lot of nuance. A lot of why Stable Diffusion continually associates person with man comes from the societal interchangeability of those terms over generations.
The team chose to study Stable Diffusion, in part, because its open source and makes its training data available (unlike prominent competitor Dall-E, from ChatGPT-maker OpenAI). Yet both the reams of training data fed to the models and the people training the models themselves introduce complex networks of biases that are difficult to disentangle at scale.
We have a significant theoretical and practical problem here, said Aylin Caliskan, a UW assistant professor in the Information School. Machine learning models are data hungry. When it comes to underrepresented and historically disadvantaged groups, we do not have as much data, so the algorithms cannot learn accurate representations. Moreover, whatever data we tend to have about these groups is stereotypical. So we end up with these systems that not only reflect but amplify the problems in society.
To that end, the researchers decided to include in the published paper only blurred copies of images that sexualized women of color.
When these images are disseminated on the internet, without blurring or marking that they are synthetic images, they end up in the training data sets of future AI models, Caliskan said. It contributes to this entire problematic cycle. AI presents many opportunities, but it is moving so fast that we are not able to fix the problems in time and they keep growing rapidly and exponentially.
This research was funded by a National Institute of Standards and Technology award.
For more information, contact Ghosh at ghosh100@uw.edu and Caliskan at aylin@uw.edu.
Follow this link:
AI image generator Stable Diffusion perpetuates racial and ... - University of Washington
- Pope Francis to visit Asia and Oceania in September - Crux Now - April 16th, 2024 [April 16th, 2024]
- EY Weighs Another 100 Job Cuts in Oceania, The Australian Reports - Bloomberg - April 16th, 2024 [April 16th, 2024]
- Oceania Cruises Announces New 2025-2026 Tropics and Exotics Collection - Norwegian Cruise Line Holdings - April 16th, 2024 [April 16th, 2024]
- Pope Francis to visit 4 nations across Asia and Oceania in September - Vatican News - April 16th, 2024 [April 16th, 2024]
- Oceania Cruises Announces New 2025-26 Tropics and Exotics Collection - Cruise Industry News - April 16th, 2024 [April 16th, 2024]
- Pope Francis will head to Asia and Oceania in September for his longest foreign trip yet - America: The Jesuit Review - April 16th, 2024 [April 16th, 2024]
- Oceania Cruises Announces New Tropics and Exotics Collection for 2025-2026 - Porthole Cruise and Travel - April 16th, 2024 [April 16th, 2024]
- Per Berth Prices Rise for Oceania and Regent Newbuilds - Cruise Industry News - April 16th, 2024 [April 16th, 2024]
- Pope Francis to embark on tour of Southeast Asia, Oceania in longest papal trip - Bakersfield Now - April 16th, 2024 [April 16th, 2024]
- Pope will take his longest trip: to Asia-Oceania in September - Aleteia - April 16th, 2024 [April 16th, 2024]
- Asia/Oceania I: Korea, Republic maintain perfect record with another 3-0 win - Billie Jean King Cup - April 16th, 2024 [April 16th, 2024]
- Highlights of Billie Jean King Cup 2024 tennis tournament Asia-Oceania - Xinhua - April 16th, 2024 [April 16th, 2024]
- Oceania Cruises Announces New Tropics and Exotics Collection - Recommend Magazine - April 16th, 2024 [April 16th, 2024]
- VATICAN Pope Francis will be in Southeast Asia and Oceania from 2 to 13 September - AsiaNews - April 16th, 2024 [April 16th, 2024]
- Oceania Triathlon continental titles on the line in Taupo this weekend World Triathlon - World Triathlon - April 16th, 2024 [April 16th, 2024]
- DHL Express introduces dedicated flight between Sydney and Hong Kong to cater to Oceania-North Asia trade demand - payloadasia.com - April 16th, 2024 [April 16th, 2024]
- Vatican announces long-awaited papal visit to Asia and Oceania - Macao News - April 16th, 2024 [April 16th, 2024]
- EY confirms 148 jobs gone in mass redundancy round across Oceania - The West Australian - April 16th, 2024 [April 16th, 2024]
- Hosts Tonga launch campaign with dominant victory against American Samoa - Oceania Football Confederation - April 16th, 2024 [April 16th, 2024]
- Oceania Cruises unveils 2026 around the world voyage on Vista - TTG Asia - March 16th, 2024 [March 16th, 2024]
- Sea Control 501 Multilateral Approaches to Maritime Security in Oceania with Zach Ota | Center for International ... - CIMSEC - March 16th, 2024 [March 16th, 2024]
- Oceania set to open booking for $60K, 180-day around-the-world cruise - Business Insider - March 12th, 2024 [March 12th, 2024]
- Oceania Cruises Announces 2026 Around the World Voyage Aboard Its Newest Ship, Vista - PR Newswire - March 12th, 2024 [March 12th, 2024]
- The Oceania Vista will sail the world in 2026 - Travel Weekly - March 12th, 2024 [March 12th, 2024]
- Oceania Announces 2026 Around the World Voyage Aboard Vista - Cruise Industry News - March 12th, 2024 [March 12th, 2024]
- Oceania Championships: Record-breaking Samoan Opeloge and Australia's Elliott make moves in Olympic rankings - International Weightlifting Federation... - February 27th, 2024 [February 27th, 2024]
- Hawaii-based 'Indo-Pacific Support Cutter' focused on Oceania is on its first Pacific deployment - Honolulu Star-Advertiser - February 27th, 2024 [February 27th, 2024]
- PNG and Vanuatu to participate in inaugural FIFA Series - Football in Oceania - February 27th, 2024 [February 27th, 2024]
- OCEANIA/PAPUA NEW GUINEA - Escalation is feared after tribal conflict: The only way to avoid it is on-site dialogue - Agenzia Fides - February 27th, 2024 [February 27th, 2024]
- Brazil claim record-extending 6th FIFA Beach Soccer World Cup - Oceania Football Confederation - February 27th, 2024 [February 27th, 2024]
- NMI's Aiden Gimed wins silver in Oceania Weightlifting Championships - Marianas Variety News & Views - February 27th, 2024 [February 27th, 2024]
- Fiji U20s secures 39-25 win over Tonga at round 1 of Oceania Rugby U20s Challenge - Fijivillage - February 27th, 2024 [February 27th, 2024]
- Vakuruivalu wins bronze in the senior men's 109kg category at the Oceania Weightlifting Championship - Fijivillage - February 27th, 2024 [February 27th, 2024]
- 5G subs in SE Asia & Oceania to hit 550M by 2029-end - Nation Thailand - December 3rd, 2023 [December 3rd, 2023]
- APCO and AIP partner to strengthen Oceania packaging industry - Packaging Gateway - December 3rd, 2023 [December 3rd, 2023]
- Solomon Islands to host OFC Women's Champions League in March - Friends of Football - December 3rd, 2023 [December 3rd, 2023]
- Tahiti tournament next prize for Wellington Olympic or Auckland City - Friends of Football - December 3rd, 2023 [December 3rd, 2023]
- Gordon Treanor joins $3bn drinks giant Suntory Oceania - The Shout - December 3rd, 2023 [December 3rd, 2023]
- LoL esports announces Japans LJL will join Oceania in PCS ... - Dexerto - December 3rd, 2023 [December 3rd, 2023]
- NZ Festival of Squash in Tauranga attracts top world and Oceania ... - Bay of Plenty Times - December 3rd, 2023 [December 3rd, 2023]
- Sisters Stephanie and Caley McNair gain international smallbore ... - Hawkes Bay Today - December 3rd, 2023 [December 3rd, 2023]
- Australian Superbike: Herfoss Earns Pole Position At "The Bend" - RoadracingWorld.com - December 3rd, 2023 [December 3rd, 2023]
- From boys' football to the Ferns in a year the rapid rise of winger ... - Friends of Football - December 3rd, 2023 [December 3rd, 2023]
- Global protein production expected to slow, but persist in 2024 - MEAT+POULTRY - December 3rd, 2023 [December 3rd, 2023]
- Catching up after the weekend? Heres all the top results and all on ... - Friends of Football - December 3rd, 2023 [December 3rd, 2023]
- All Blacks Sevens chart new beginnings in the HSBC SVNS Series - allblacks.com - December 3rd, 2023 [December 3rd, 2023]
- The Dominican Republic to host WBSC Americas U-15 Baseball ... - World Baseball Softball Confederation - December 3rd, 2023 [December 3rd, 2023]
- XXX BFA Asian Championship starts Sunday, qualifies three teams ... - World Baseball Softball Confederation - December 3rd, 2023 [December 3rd, 2023]
- Oceania - Students | Britannica Kids | Homework Help - March 31st, 2023 [March 31st, 2023]
- 5 Things You Should Know About: Oceania - WorldAtlas - March 4th, 2023 [March 4th, 2023]
- Oceania Healthcare (NZSE:OCA) Is Paying Out Less In Dividends Than Last Year - Simply Wall St - November 27th, 2022 [November 27th, 2022]
- 'Wingspan' Oceania Expansion Announced for Release Soon on iOS, Android, Switch, Xbox, and PC TouchArcade - Touch Arcade - October 30th, 2022 [October 30th, 2022]
- Oceania and Africa rising in university rankings - The PIE News - October 17th, 2022 [October 17th, 2022]
- South Asia And Oceania Pea Fiber Consumption Is Expected To Grow By Nearly 2x By 2032 - openPR - October 17th, 2022 [October 17th, 2022]
- PET Type Antiblock Masterbatch Market Size reach to 82.50 million USD in 2022-2027 With Impact of domestic and global market Top players: Review by... - October 17th, 2022 [October 17th, 2022]
- The Legend of Heroes: Trails to Azure launches on March 14, 2023 in North America; March 17 in Europe and March 24 in Oceania - RPG Site - October 17th, 2022 [October 17th, 2022]
- A 5G-proficient workforce will be in high demand: Nitin Bansal, MD, India & Head Networks, South East Asia, Oceania And India, Ericsson - The... - October 17th, 2022 [October 17th, 2022]
- Being in India more critical than ever: Ericssons Mirtillo | Mint - Mint - October 17th, 2022 [October 17th, 2022]
- Sedin lands in Melbourne with Steve de Mamiel at the helm - ARNnet - October 17th, 2022 [October 17th, 2022]
- Heavy Machinery Maintenance & Repair Demand Is Set To Reach A Valuation of US$ 284 Bn Billion 2032; Owing To Technology Integration into Service... - October 17th, 2022 [October 17th, 2022]
- WWII Ship Sunk In Oceania Shows Up In Dried-Up Californian Lake Officials Have No Idea How It Got There - IFLScience - October 15th, 2022 [October 15th, 2022]
- EY Oceania Strengthens Transformation Capability Through The Business Acquisition Of Red Moki - The Balance - October 15th, 2022 [October 15th, 2022]
- World University Rankings 2023: trends analysis - Times Higher Education - October 15th, 2022 [October 15th, 2022]
- How Africa is still paying the most for the lowest-quality internet - Benjamindada.com - October 15th, 2022 [October 15th, 2022]
- Global population hits 8 billion soon, but shrinks by 2100 - Big Think - October 15th, 2022 [October 15th, 2022]
- Banana Genomes Hint at Hidden Species We Urgently Need to Find - ScienceAlert - October 15th, 2022 [October 15th, 2022]
- Boxing: Kiwi heavyweight Hemi Ahio ready for the spotlight - New Zealand Herald - October 15th, 2022 [October 15th, 2022]
- An unbeatable moment to leverage: 2023 Womens World Cup must win hearts to change minds - The Guardian - October 15th, 2022 [October 15th, 2022]
- Architectural Services Sales Is Anticipated to Reach US$ 426.3 Bn by 2032; Rising Urbanization to Act as Key Drivers | Fact.MR's Study - GlobeNewswire - October 15th, 2022 [October 15th, 2022]
- Oceania unveils world cruise and other long voyages for 2025 - Travel Weekly - September 15th, 2022 [September 15th, 2022]
- Sailing to the Baltic Sea's top port cities with Oceania - Cruise Passenger - September 15th, 2022 [September 15th, 2022]
- Oceania Dairy tanker driver injured after truck rolls in South Cantebury - Stuff - September 15th, 2022 [September 15th, 2022]
- Study Highlights Wide Variation in Mortality of Spondyloarthritis, IBD Across the Globe - AJMC.com Managed Markets Network - September 15th, 2022 [September 15th, 2022]
- Earth had its 6th-warmest August on record - National Oceanic and Atmospheric Administration - September 15th, 2022 [September 15th, 2022]
- Humans have caused unprecedented changes to rivers - Earth.com - September 15th, 2022 [September 15th, 2022]
- From boat to bike: Georgie Howe's rapid rise to the pro ranks - CyclingTips - September 15th, 2022 [September 15th, 2022]
- Turbulence not over: Asahi pushes canned beer and healthier innovation as cost pressures heighten - FoodNavigator-Asia.com - September 15th, 2022 [September 15th, 2022]
- Auckland City keep quadruple title hopes alive with Chatham Cup football final win - Stuff - September 15th, 2022 [September 15th, 2022]
- Cruise Lines That Don't Require a COVID-19 Vaccination - Cruise Fever - September 3rd, 2022 [September 3rd, 2022]
- Buh bye, buffets? Heres what its like to cruise now - The Boston Globe - September 3rd, 2022 [September 3rd, 2022]