By Faye Flam
ITS BECOME a kind of sport to shoot down social science claims, whether its the notion that you can ace interviews if you stand like Wonder Woman or charm your next date by reading two pages of Moby Dick before you leave.
And now critics have taken aim at a prize target a much-cited claim that symphony orchestras hire more women when they audition musicians behind a screen. There are big implications here, since the study has been used in diversity efforts across industries, which is why the take-down has taken off in the media.
But the blind auditions wont go the way of the other results that have vanished into air upon a more critical analysis. One reason is that blind auditions really exist; they were not a contrivance set up by scientists in a lab, as with the studies that have become infamous in the so-called replication crisis. Those mostly relied on experiments from which researchers made oversized and often counterintuitive claims. Some, it turned out, incorporated errors in statistical analysis that made random noise look like surprising new findings.
In contrast, blind auditions were independently adopted by real orchestras, starting with the Boston Symphony Orchestra, in the latter part of the 20th century. The purpose was to prevent conductors from choosing their own students, or their personal favorites, and instead force them to focus entirely on the music. Its also been adopted for awarding astronomers time on the Hubble Space Telescope a limited resource that has only gone to a small fraction of astronomers who submit proposals.
In the 1990s, two economists Claudia Goldin, an Economics professor at Harvard, and Cecilia Rouse, now an economics professor at Princeton University set out to investigate whether blind selection in orchestras was the direct cause of a concurrent increase in the number of women hired for orchestra positions.
Goldin and Rouse went around the country to different orchestras to observe their auditioning practices and collect data on past practices as well as records of who auditioned and who got hired. Much of that data was buried in files in basements. They learned interesting things on the journey including the fact that some orchestras used carpeting or other measures to disguise the difference in sound between male and female footsteps.
The results, published in 2000, were complicated. There are different rounds of selection preliminary, semi-finals, and finals, and women did better in blind selections in some rounds but not others. This was reflected in the abstract of their paper, which admits up front that their data are noisy and some of their numbers dont pass standard tests of statistical significance.
In an interview, Goldin said that they were particularly interested in seeing what happened to the subset of people who applied to both blind and non-blind auditions. Asking people to audition behind a screen might bring in a different, more diverse group of applicants, she said, but there were some musicians who applied to both kinds. Comparing how they performed in blind versus non-blind auditions would offer a kind of natural experiment. And thats where those controversial numbers surface.
The paper says that, using the audition data, we find that the screen increases by 50% the probability that a woman will be advanced from certain preliminary rounds and increases by severalfold the likelihood that a woman will be selected in the final round. The results were cited by politicians and TED talk speakers, and often referenced by other researchers.
One of the critiques came from Columbia University statistics professor Andrew Gelman, whose blog posts have become known for identifying and explaining the kinds of statistical errors or cheats that have led to erroneous or misleading conclusions in social science and medical research.
He criticized the lack of clarity in the paper, writing that he could not figure out how they calculated the much-touted 50% figure, let alone the several-fold difference mentioned, so it was impossible for him to see whether these numbers stand up to statistical tests.
Thats a fair criticism. But even if their data were too noisy to determine that blind auditions increased female hires, that doesnt prove that theres no effect, or that discrimination didnt exist. Goldin said that their number comes from isolating just the cases where the same people applied in both kinds of auditions, and applies, as the paper says, only to certain stages in the process.
A similar study of the Hubble Telescope time got a comparable result. When identifying information was removed from proposals, women became more likely than men to get approved for the first time in the 18 years the data were tracked. As described in detail in Physics Today, the blinding also resulted in more time going to researchers from lesser-known institutions. Reviewers had to look at the substance of the proposals in more depth rather than relying on the track record of the proposers.
A third study looked at coders and found that in gender-blind submissions, womens code was more likely to be accepted than mens; but when the coders gender was known, womens code was accepted less often.
We shouldnt lump a study that examined decades of hiring data at real orchestras in with the headlines that oversold findings that forced smiles make you happier, that hearing words associated with aging make you walk more slowly, and that women are much more likely to vote for Republicans at certain points in the menstrual cycle.
Unlike those other disappearing findings which blustered about a whole new understanding of human nature or offered people too-easy-to-be-true life hacks this blind audition paper was modest, claiming only to shed light on a cultural phenomenon at a particular place and time. Theres no reason to throw it into the trash heap of bad science.
BLOOMBERG OPINION
Read the original here:
Can blind auditions help women succeed? Yes. - BusinessWorld Online
- Hubble Telescope spies stormy weather and a shrinking Great Red Spot on Jupiter (video) - Space.com - March 16th, 2024 [March 16th, 2024]
- NASA's James Webb Space Telescope mission Live updates - Space.com - March 16th, 2024 [March 16th, 2024]
- Secret remains: James Webb measures the rate of expansion of the Universe - The Universe. Space. Tech - March 16th, 2024 [March 16th, 2024]
- Cosmic Expansion Mystery Suggests 'We Have Misunderstood the Universe' - Newsweek - March 16th, 2024 [March 16th, 2024]
- NASA releases an official tabletop adventure that's brave enough to ask: what would Earth be like if a dragon ... - PC Gamer - March 6th, 2024 [March 6th, 2024]
- Hubble Telescope spies massive 'bridge of stars' connecting 2 galaxies on collision course (image) - Space.com - January 30th, 2024 [January 30th, 2024]
- Hubble telescope spots tiniest water-rich world in orbit - The Register - January 30th, 2024 [January 30th, 2024]
- This Hubble Telescope photo of a spiral galaxy will take your breath away - Space.com - January 30th, 2024 [January 30th, 2024]
- Hubble telescope spots water around tiny hot and steamy exoplanet in 'exciting discovery' - Space.com - January 30th, 2024 [January 30th, 2024]
- Old age is the one thing the Hubble telescope and its latest photo have in common - Digital Camera World - January 30th, 2024 [January 30th, 2024]
- Hubble Telescope captures massive bridge of stars between two merging galaxies that could be our new home - WION - January 30th, 2024 [January 30th, 2024]
- NASA's Hubble telescope discovers water vapor In small exoplanet's atmosphere - DNA India - January 30th, 2024 [January 30th, 2024]
- Hubble Telescope detects water vapour in the atmosphere of smallest exoplanet GJ 9827d - Tech Explorist - January 30th, 2024 [January 30th, 2024]
- See This Remarkable Spiral Galaxy from the Eyes of the Hubble Telescope - Beebom - January 30th, 2024 [January 30th, 2024]
- Have we seen the last-ever picture from the Hubble? - Digital Camera World - December 14th, 2023 [December 14th, 2023]
- NASA will try bringing the Hubble telescope back online on Friday - Digital Trends - December 14th, 2023 [December 14th, 2023]
- 30 years ago, astronauts completed the Hubble telescope's first repair. Here's how - CBC.ca - December 14th, 2023 [December 14th, 2023]
- Cosmic Chameleon: Galaxy's Stunning Transformation by Hubble Filters - SciTechDaily - November 15th, 2023 [November 15th, 2023]
- Today's Photo from Ted Grussing Photography: Tweaking ... my ... - Sedona.biz - November 15th, 2023 [November 15th, 2023]
- The science of exploration through photography The Durango ... - The Durango Herald - November 15th, 2023 [November 15th, 2023]
- Hubble telescope captures jaw-dropping 'glitzy' galactic view - Study Finds - August 8th, 2023 [August 8th, 2023]
- Planetary defense test deflected an asteroid but unleashed a ... - UCLA Newsroom - August 8th, 2023 [August 8th, 2023]
- This new tool 'cleans' annoying satellite trails from Hubble telescope photos - Space.com - June 14th, 2023 [June 14th, 2023]
- Hubble Telescope gazes into the heart of a monstrous galaxy cluster (photo) - Space.com - May 14th, 2023 [May 14th, 2023]
- NASA's Hubble telescope captures Jupiter's Great Red Spot, reveals shocking details - DNA India - May 14th, 2023 [May 14th, 2023]
- Hubble telescope spies 'peek-a-boo' exoplanets amid star's tilted dust rings - Space.com - May 14th, 2023 [May 14th, 2023]
- NASA Astronomy Picture of the Day 8 May 2023: Mesmerizing Spanish Dancer Galaxy - HT Tech - May 14th, 2023 [May 14th, 2023]
- Portugal participates in the development of a first-class instrument ... - EurekAlert - May 14th, 2023 [May 14th, 2023]
- Brandywine Art Guide: Multiplicities - women in the arts - Chadds ... - Chadds Ford Live - May 14th, 2023 [May 14th, 2023]
- Hubble telescope reveals huge star's explosion in blow-by-blow detail - Reuters - November 11th, 2022 [November 11th, 2022]
- James Webb and Hubble telescope images capture DART asteroid collision ... - November 1st, 2022 [November 1st, 2022]
- Hubble telescope peeks through 'cosmic keyhole' in stunning photo - November 1st, 2022 [November 1st, 2022]
- The 10 biggest telescopes on Earth - Space.com - October 15th, 2022 [October 15th, 2022]
- Tragedy in the making! 2 gigantic galaxies set to crash; NASA Hubble Telescope snaps photo - HT Tech - October 15th, 2022 [October 15th, 2022]
- Your Answers: What name would you give to a new planet? - ideastream - October 15th, 2022 [October 15th, 2022]
- George Fitzgerald: "Serum is one of the best synthesizers ever made, hardware of software" - MusicRadar - October 15th, 2022 [October 15th, 2022]
- JCPL Column: Looking to the stars - Daily Journal - September 29th, 2022 [September 29th, 2022]
- Hubble Telescope Captures Spectacular Image of Spiral Galaxy - Greek Reporter - September 22nd, 2022 [September 22nd, 2022]
- Hubble Telescope Captures What Might Be the Prettiest Spiral Galaxy Ever - CNET - September 22nd, 2022 [September 22nd, 2022]
- James Webb Telescope rediscovers Earendel, the farthest known star in the universe - EL PAS USA - September 22nd, 2022 [September 22nd, 2022]
- Viewpoints: The Formula Shortage Isn't Over; Male Lawmakers Aren't Doing Their Jobs As Fathers - Kaiser Health News - September 22nd, 2022 [September 22nd, 2022]
- What the Orion Nebula Looks Like to Webb Telescope Vs Hubble Telescope - Gizmodo - September 14th, 2022 [September 14th, 2022]
- JWST takes a peek at the first ever galaxies - Astrobites - September 3rd, 2022 [September 3rd, 2022]
- Scientists harness powers of Webb and Hubble in stunning galactic image - Mashable - August 30th, 2022 [August 30th, 2022]
- NASA Captured The Sound Of Space (And It's Bloody Terrifying) - Boss Hunting - August 27th, 2022 [August 27th, 2022]
- James Webb Telescope images of the planet open up new horizons of the imagination - The Indian Express - August 25th, 2022 [August 25th, 2022]
- NASA released a clip of what a black hole sounds like and it's haunting - KING5.com - August 25th, 2022 [August 25th, 2022]
- Galactic diversity captured in new Hubble telescope photo - Space.com - July 31st, 2022 [July 31st, 2022]
- What did Hubble Telescope see on your birthday? Find out here - India Today - July 31st, 2022 [July 31st, 2022]
- Opinion: At $10 billion, the Webb telescope is a bargain - Daily Press - July 31st, 2022 [July 31st, 2022]
- The First Images from the James Webb Telescope Are Breathtakingand Significant - The New Yorker - July 21st, 2022 [July 21st, 2022]
- Bob Korechoff, 75, is an aerospace engineer who worked with a team of engineers to fix the Hubble Telescope - The Spokesman Review - July 21st, 2022 [July 21st, 2022]
- Comparing The Hubble Telescope & The James Webb Is Like Millennials Vs. Gen Z - Bustle - July 21st, 2022 [July 21st, 2022]
- Rutgers Astrophysicist Selected for Research on the James Webb Space Telescope - Rutgers University - July 21st, 2022 [July 21st, 2022]
- Pillars of Creation: $16B Space Telescope vs $500 Backyard Photo - PetaPixel - July 11th, 2022 [July 11th, 2022]
- How the Webb Telescope will unveil the mysteries of cosmic star-making factories - Inverse - July 11th, 2022 [July 11th, 2022]
- Look: The Hubble telescope reveals of luminous sea of galaxies - Yahoo News - June 30th, 2022 [June 30th, 2022]
- Palestinian Journalist: The Arab And Muslim World Is Mired In Backwardness, Light Years Behind The World's Rapid Development - Middle East Media... - June 30th, 2022 [June 30th, 2022]
- Largest star in Milky Way is DYING and could collapse into a black hole... - The US Sun - June 30th, 2022 [June 30th, 2022]
- Comparison: Webb vs Hubble Telescope - Webb/NASA - June 24th, 2022 [June 24th, 2022]
- NASA shares Hubble view of Jupiter's auroras 100 times more energetic than those on Earth - Republic World - June 24th, 2022 [June 24th, 2022]
- Sun just killed a comet! Hubble Space Telescope reveals shocking details - HT Tech - June 24th, 2022 [June 24th, 2022]
- Uncovering the Mass of Distant Stars - AZoQuantum - June 24th, 2022 [June 24th, 2022]
- Hubbles Most Iconic Images Will Be Smoked By NASAs New Space TelescopeBut Its Not Webb - Forbes - June 11th, 2022 [June 11th, 2022]
- Jun 11: Music from the cosmos, thunderbird extinction, Hubble gets the big picture and more - CBC.ca - June 11th, 2022 [June 11th, 2022]
- Why Uranus and Neptune colours are different: NASA's Hubble Telescope has the answer - HT Tech - June 7th, 2022 [June 7th, 2022]
- Hubble Telescope captures giant star 32x larger than Sun, but it will die first! Check breathtaking NASA photo - HT Tech - June 7th, 2022 [June 7th, 2022]
- The Milky Way and Andromeda Galaxies Are Set to Collide in 4 Billion Years - My Modern Met - June 7th, 2022 [June 7th, 2022]
- Hubble telescope refines universe expansion rate mystery - Space.com - May 23rd, 2022 [May 23rd, 2022]
- Hubble telescope looks deep into the Needle's Eye in this dwarf spiral galaxy photo - Space.com - May 23rd, 2022 [May 23rd, 2022]
- Hubble Telescope: Something weird going on in universe - us.bolnews.com - May 23rd, 2022 [May 23rd, 2022]
- James Webb Space Telescope and 344 Single Points of Failure - thenewstack.io - May 23rd, 2022 [May 23rd, 2022]
- Hubble clicks photo that shows future of Milky Way Galaxy - WION - May 23rd, 2022 [May 23rd, 2022]
- #SpaceSnap The Alluring Crab Nebula Captured by the Hubble and Herschel Space Telescopes - iTech Post - May 23rd, 2022 [May 23rd, 2022]
- Space is an ecosystem, too. And it's in peril - Canada's National Observer - May 13th, 2022 [May 13th, 2022]
- The best Hubble Space Telescope images of all time! - May 11th, 2022 [May 11th, 2022]
- China to beat NASA Hubble Space Telescope with its Xuntian Telescope - HT Tech - May 11th, 2022 [May 11th, 2022]
- How many types of galaxies are there in the universe? - Interesting Engineering - April 25th, 2022 [April 25th, 2022]
- NASA to make announcement Wednesday regarding Hubble Telescope - The Edwardsville Intelligencer - March 29th, 2022 [March 29th, 2022]
- Expanding Universe. The Hubble Space Telescope - Taschen - March 26th, 2022 [March 26th, 2022]