Artificial intelligence is increasingly playing a role in companies hiring decisions. Algorithms help target ads about new positions, sort through resumes, and even analyze applicants facial expressions during video job interviews. But these systems are opaque, and we often have no idea how artificial intelligence-based systems are sorting, scoring, and ranking our applications.
Its not just that we dont know how these systems work. Artificial intelligence can also introduce bias and inaccuracy to the job application process, and because these algorithms largely operate in a black box, its not really possible to hold a company that uses a problematic or unfair tool accountable.
A new Illinois law one of the first of its kind in the US is supposed to provide job candidates a bit more insight into how these unregulated tools actually operate. But its unlikely the legislation will change much for applicants. Thats because it only applies to a limited type of AI, and it doesnt ask much of the companies deploying it.
Set to take effect January 1, 2020, the states Artificial Intelligence Video Interview Act has three primary requirements. First, companies must notify applicants that artificial intelligence will be used to consider applicants fitness for a position. Those companies must also explain how their AI works and what general types of characteristics it considers when evaluating candidates. In addition to requiring applicants consent to use AI, the law also includes two provisions meant to protect their privacy: It limits who can view an applicants recorded video interview to those whose expertise or technology is necessary and requires that companies delete any video that an applicant submits within a month of their request.
As Aaron Rieke, the managing director of the technology rights nonprofit Upturn, told Recode about the law, This is a pretty light touch on a small part of the hiring process. For one thing, the law only covers artificial intelligence used in videos, which constitutes a small share of the AI tools that can be used to assess job applicants. And the law doesnt guarantee that you can opt out of an AI-based review of your application and still be considered for a role (all the law says is that a company has to gain your consent before using AI; it doesnt require that hiring managers give you an alternative method).
Its hard to feel that that consent is going to be super meaningful if the alternative is that you get no shot at the job at all, said Rieke. He added that theres no guarantee that the consent and explanation the law requires will be useful; for instance, the explanation could be so broad and high-level that its not helpful.
If I were a lawyer for one of these vendors, I would say something like, Look, we use the video, including the audio language and visual content, to predict your performance for this position using tens of thousands of factors, said Rieke. If I was feeling really conservative, I might name a couple general categories of competency. (He also points out that the law doesnt define artificial intelligence, which means its difficult to tell what companies and what types of systems the law actually applies to).
Because the law is limited to AI thats used in video interviews, the company it most clearly applies to is Utah-based HireVue, a popular job interview platform that offers employers an algorithm-based analysis of recorded video interviews. Heres how it works: You answer pre-selected questions over your computer or phone camera. Then, an algorithm developed by HireVue analyzes how youve answered the questions, and sometimes even your facial expressions, to make predictions about your fit for a particular position.
HireVue says it already has about 100 clients using this artificial intelligence-based feature, including major companies like Unilever and Hilton.
Some candidates who have used HireVues system complain that the process is awkward and impersonal. But thats not the only problem. Algorithms are not inherently objective, and they reflect the data used to train them and the people that design them. That means they can inherit, and even amplify, societal biases, including racism and sexism. And even if an algorithm is explicitly instructed not to consider factors like a persons name, it can still learn proxies for protected identities (for instance, an algorithm could learn to discriminate against people who have gone to a womens college).
Facial recognition tech, in particular, has faced criticism for struggling to identify and characterize the faces of people with darker skin, women, and trans and non-binary people, among other minority groups. Critics also say that emotion (or affect) recognition technology in particular, which purports to make judgments about a persons emotions based on their facial expressions, is scientifically flawed. Thats why one research nonprofit, the AI Now Institute, called for the prohibition of such technology in high-stakes decision-making including job applicant vetting.
[W]hile youre being interviewed, theres a camera thats recording you, and its recording all of your micro facial expressions and all of the gestures youre using, the intonation of your voice, and then pattern matching those things that they can detect with their highest performers, AI Now Institute co-founder Kate Crawford told Recodes Kara Swisher earlier this year. [It] might sound like a good idea, but think about how youre basically just hiring people who look like the people you already have.
Even members of Congress are worried about that technology. In 2018, US Sens. Kamala Harris, Elizabeth Warren, and Patty Murray wrote to the Equal Employment Opportunity Commission, the federal agency charged with investigating employment discrimination, asking whether such facial analysis technology could violate anti-discrimination laws.
Despite being one of the first laws to regulate these tools, the Illinois law doesnt address concerns about bias. No federal legislation explicitly regulates these AI-based hiring systems. Instead, employment lawyers say such AI tools are generally subject to the Uniform Guidelines, employment discrimination standards created by several federal agencies back in 1978 (you can read more about that here).
The EEOC did not respond to Recodes multiple requests for comment.
Meanwhile, its not clear how, under Illinois new law, companies like HireVue will go about explaining the characteristics in applicants that its AI considers, given that the company claims that its algorithms can weigh up to tens of thousands of factors (it says it removes factors that are not predictive of job success).
The law also doesnt explain what an applicant might be entitled to if a company violates one of its provisions. Law firms advising clients on compliance have also noted that its not clear whether the law applies exclusively to businesses filling a position in Illinois, or just interviews that take place in the state. Neither Illinois State Sen. Iris Martinez nor Illinois Rep. Jaime M. Andrade, legislators who worked on the law, responded to a request for comment by the time of publication.
HireVues CEO Kevin Parker said in a blog post that the law entails very little, if any, change because its platform already complies with GDPRs principles of transparency, privacy, and the right to be forgotten. [W]e believe every job interview should be fair and objective, and that candidates should understand how theyre being evaluated. This is fair game, and its good for both candidates and companies, he wrote in August.
A spokesperson for HireVue said the decision to provide an alternative to an AI-based analysis is up to the company thats hiring, but argued that those alternatives can more time-consuming for candidates. If a candidate believes that a system is biased, the spokesperson said recourse options are the same as when a candidate believes that any part of the hiring process, or any individual interviewer, was unfairly biased against them.
Under the new law in Illinois, if you participate in a video interview that uses AI tech, you can ask for your footage to be deleted after the fact. But its worth noting that the law appears to still give the company enough time to train its model on the results of your job interview even if you think the final decision was problematic.
This gives these AI hiring companies room to continue to learn, says Rieke. Theyre going to delete the underlying video, but any learning or improvement to their systems they get to keep.
Open Sourced is made possible by Omidyar Network. All Open Sourced content is editorially independent and produced by our journalists.
- Artificial Intelligence (AI) Definition - Investopedia - May 31st, 2020
- The Temptations Of Artificial Intelligence Technology And The Price Of Admission - Forbes - May 31st, 2020
- Artificial intelligence offers a chance to optimize COVID-19 treatment in international partnership - Vanderbilt University News - May 31st, 2020
- Reality Check: The Benefits of Artificial Intelligence - AiThority - May 31st, 2020
- Thanks To Renewables And Machine Learning, Google Now Forecasts The Wind - Forbes - May 31st, 2020
- Artificial intelligence is hopelessly biased - and that's how it will stay - TechRadar India - May 31st, 2020
- Top Artificial Intelligence Trends that will Change the Decade - Analytics Insight - May 31st, 2020
- Art and artifice - The Indian Express - May 31st, 2020
- The Role of Artificial Intelligence in Ethical Hacking | EC-Council Official Blog - EC-Council Blog - May 31st, 2020
- Microsoft is cutting dozens of MSN news production workers and replacing them with artificial intelligence - Seattle Times - May 31st, 2020
- Artificial intelligence software improves accuracy, doubles speed in evaluating CT scans of advanced cancer - UAB News - May 31st, 2020
- Coronavirus tests the value of artificial intelligence in medicine - FierceHealthcare - May 31st, 2020
- The Use of Artificial Intelligence by Investment Advisers: Considerations Based on an Advisers Fiduciary Duties - JD Supra - May 31st, 2020
- Lecturer in Artificial Intelligence for Digital Infrastructures job with UNIVERSITY OF BRISTOL | 208485 - Times Higher Education (THE) - May 31st, 2020
- Artificial Intelligence (AI) Market to Reach USD 202.57 Billion by 2026; Rising Demand for Cloud-based Applications to Aid Growth: Fortune Business... - May 31st, 2020
- Walmart Employees Are Out to Show Its Anti-Shoplifting AI Doesn't Work - WIRED - May 31st, 2020
- How artificial intelligence is keeping time-critical shipments on track during pandemic - FreightWaves - May 31st, 2020
- Coronavirus Update: Recent FTC Guidance on the Use of Artificial Intelligence and Algorithms in the Age of COVID-19 - Government Contracts Legal Forum - May 31st, 2020
- COVID-19 Impact: A Mix of Challenges and Opportunities | Artificial Intelligence-as-a-Service (AIaaS) Market 2020-2024 | Growing Adoption of Cloud... - May 31st, 2020
- IIT-Ropar and TSW Launch a PG Programme in Artificial Intelligence - THE WEEK - May 31st, 2020
- MS in Artificial Intelligence | Artificial Intelligence - May 19th, 2020
- What is Artificial Intelligence? | Azure Blog and Updates ... - May 19th, 2020
- What Are the Advantages of Artificial Intelligence ... - May 19th, 2020
- AI Tutorial | Artificial Intelligence Tutorial - Javatpoint - May 19th, 2020
- It's Called Artificial Intelligencebut What Is Intelligence? - WIRED - May 19th, 2020
- Powering the Artificial Intelligence Revolution - HPCwire - May 19th, 2020
- Artificial intelligence is struggling to cope with how the world has changed - ZDNet - May 19th, 2020
- An AI future set to take over post-Covid world - The Indian Express - May 19th, 2020
- A New Way To Think About Artificial Intelligence With This ETF - MarketWatch - May 19th, 2020
- Artificial intelligence-based imaging reconstruction may lead to incorrect diagnoses, experts caution - Radiology Business - May 19th, 2020
- Artificial Intelligence in the Covid Frontline - Morningstar - May 19th, 2020
- Patent Analytics Market to Reach USD 1,668.4 Million by 2027; Integration of Machine Learning and Artificial Intelligence to Spur Business... - May 19th, 2020
- Artificial Intelligence in Cancer: How Is It Used in Practice? - Cancer Therapy Advisor - May 19th, 2020
- Five Important Subsets of Artificial Intelligence - Analytics Insight - May 19th, 2020
- Ethical artificial intelligence: Could Switzerland take the lead? - swissinfo.ch - May 19th, 2020
- The Future of Artificial Intelligence: Edge Intelligence - Analytics Insight - May 19th, 2020
- 5 Ways Artificial Intelligence Is Changing Architecture - May 15th, 2020
- Keysight Validates Artificial Intelligence (AI) and ... - May 15th, 2020
- What Is Artificial Intelligence? Examples and News in 2019 ... - May 15th, 2020
- Artificial Intelligence (AI) Is Nothing Without Humans - E3zine.com - May 15th, 2020
- Artificial intelligence is helping seniors who are isolated during the coronavirus pandemic - WXYZ - May 15th, 2020
- ValleyML is launching a Machine Learning and Deep Learning Boot Camp from July 14th to Sept 10th and AI Expo Series from Sept 21st to Nov 19th 2020.... - May 15th, 2020
- TSA Issues Road Map to Tackle Insider Threat With Artificial Intelligence - Nextgov - May 15th, 2020
- The Expanding Role Of Artificial Intelligence In Tax - Forbes - May 15th, 2020
- Artificial Intelligence: Technology Of The Future - Forbes India - May 15th, 2020
- SparkCognition and Milize to Offer Automated Machine Learning Solutions for Financial Institutions to the APAC Region - PRNewswire - May 15th, 2020
- Alpha Modus Allowed 2nd Patent Leveraging Artificial Intelligence for Monitoring and Analyzing Consumer Behavior - Yahoo Finance - May 15th, 2020
- Tesla : Artificial Intelligence - the .AI domain is on the rise - marketscreener.com - May 15th, 2020
- Artificial Intelligence Can Only Help Architecture if We Ask the Right Questions - ArchDaily - May 15th, 2020
- Fighting COVID-19: Artificial Intelligence community to help citizens and the healthcare system - Canada NewsWire - May 15th, 2020
- Understanding the Four Types of Artificial Intelligence - May 9th, 2020
- Artificial intelligence Facts for Kids - May 9th, 2020
- 4 Main Types of Artificial Intelligence - G2 - May 9th, 2020
- Artificial intelligence project lets Holocaust survivors ... - May 9th, 2020
- Artificial intelligence - Simple English Wikipedia, the ... - May 9th, 2020
- Artificial Intelligence Market by Size, Share, Analysis ... - May 9th, 2020
- A.I. Artificial Intelligence movie review (2001) | Roger Ebert - May 9th, 2020
- Artificial Intelligence is Evolving to Process the World Like Humans - Interesting Engineering - May 9th, 2020
- Drug research turns to artificial intelligence in COVID-19 fight - Business in Vancouver - May 9th, 2020
- Women wanted: Why now could be a good time for women to pursue a career in AI - CNBC - May 9th, 2020
- Artificial Intelligence Used to Identify Light Sources With Far Fewer Measurements - Unite.AI - May 9th, 2020
- The Impending Artificial Intelligence Revolution in Healthcare - Op-Ed - HIT Consultant - May 9th, 2020
- COVID-19 identification in X-ray images by Artificial intelligence - News Anyway - May 9th, 2020
- Is artificial intelligence the answer to the care sector amid COVID-19? - Descrier - May 9th, 2020
- Artificial intelligence - Wikipedia - April 26th, 2020
- artificial intelligence | Definition, Examples, and ... - April 26th, 2020
- What Is Artificial Intelligence (AI)? | PCMag - April 26th, 2020
- How Artificial Intelligence Is Totally Changing Everything ... - April 26th, 2020
- Artificial Intelligence And Automation Top Focus For Venture Capitalists - Forbes - April 26th, 2020
- Benefits & Risks of Artificial Intelligence - Future of ... - April 26th, 2020
- Artificial intelligence can take banks to the next level - TechRepublic - April 26th, 2020
- Health care of tomorrow, today: How artificial intelligence is fighting the current, and future, COVID-19 pandemic | TheHill - The Hill - April 26th, 2020
- How Artificial Intelligence, IoT And Big Data Can Save The Bees - Forbes - April 26th, 2020
- First meeting of the new CEPEJ Working Group on cyberjustice and artificial intelligence - Council of Europe - April 26th, 2020
- When the coronavirus hit, California turned to artificial intelligence to help map the spread - 60 Minutes - CBS News - April 26th, 2020
- Artificial Intelligence in the Oil & Gas Industry, 2020-2025 - Upstream Operations to Witness Significant Growth - ResearchAndMarkets.com - Yahoo... - April 26th, 2020
- Pre & Post COVID-19 Market Estimates-Artificial Intelligence (AI) Market in Retail Sector 2019-2023| Increased Efficiency of Operations to Boost... - April 26th, 2020
- EUREKA Clusters Artificial Intelligence (AI) Call | News item - The Netherlands and You - April 26th, 2020
- A guide to healthy skepticism of artificial intelligence and coronavirus - Brookings Institution - April 2nd, 2020
- AI vs your career? What artificial intelligence will really do to the future of work - ZDNet - April 2nd, 2020