Artificial intelligence is increasingly playing a role in companies hiring decisions. Algorithms help target ads about new positions, sort through resumes, and even analyze applicants facial expressions during video job interviews. But these systems are opaque, and we often have no idea how artificial intelligence-based systems are sorting, scoring, and ranking our applications.
Its not just that we dont know how these systems work. Artificial intelligence can also introduce bias and inaccuracy to the job application process, and because these algorithms largely operate in a black box, its not really possible to hold a company that uses a problematic or unfair tool accountable.
A new Illinois law one of the first of its kind in the US is supposed to provide job candidates a bit more insight into how these unregulated tools actually operate. But its unlikely the legislation will change much for applicants. Thats because it only applies to a limited type of AI, and it doesnt ask much of the companies deploying it.
Set to take effect January 1, 2020, the states Artificial Intelligence Video Interview Act has three primary requirements. First, companies must notify applicants that artificial intelligence will be used to consider applicants fitness for a position. Those companies must also explain how their AI works and what general types of characteristics it considers when evaluating candidates. In addition to requiring applicants consent to use AI, the law also includes two provisions meant to protect their privacy: It limits who can view an applicants recorded video interview to those whose expertise or technology is necessary and requires that companies delete any video that an applicant submits within a month of their request.
As Aaron Rieke, the managing director of the technology rights nonprofit Upturn, told Recode about the law, This is a pretty light touch on a small part of the hiring process. For one thing, the law only covers artificial intelligence used in videos, which constitutes a small share of the AI tools that can be used to assess job applicants. And the law doesnt guarantee that you can opt out of an AI-based review of your application and still be considered for a role (all the law says is that a company has to gain your consent before using AI; it doesnt require that hiring managers give you an alternative method).
Its hard to feel that that consent is going to be super meaningful if the alternative is that you get no shot at the job at all, said Rieke. He added that theres no guarantee that the consent and explanation the law requires will be useful; for instance, the explanation could be so broad and high-level that its not helpful.
If I were a lawyer for one of these vendors, I would say something like, Look, we use the video, including the audio language and visual content, to predict your performance for this position using tens of thousands of factors, said Rieke. If I was feeling really conservative, I might name a couple general categories of competency. (He also points out that the law doesnt define artificial intelligence, which means its difficult to tell what companies and what types of systems the law actually applies to).
Because the law is limited to AI thats used in video interviews, the company it most clearly applies to is Utah-based HireVue, a popular job interview platform that offers employers an algorithm-based analysis of recorded video interviews. Heres how it works: You answer pre-selected questions over your computer or phone camera. Then, an algorithm developed by HireVue analyzes how youve answered the questions, and sometimes even your facial expressions, to make predictions about your fit for a particular position.
HireVue says it already has about 100 clients using this artificial intelligence-based feature, including major companies like Unilever and Hilton.
Some candidates who have used HireVues system complain that the process is awkward and impersonal. But thats not the only problem. Algorithms are not inherently objective, and they reflect the data used to train them and the people that design them. That means they can inherit, and even amplify, societal biases, including racism and sexism. And even if an algorithm is explicitly instructed not to consider factors like a persons name, it can still learn proxies for protected identities (for instance, an algorithm could learn to discriminate against people who have gone to a womens college).
Facial recognition tech, in particular, has faced criticism for struggling to identify and characterize the faces of people with darker skin, women, and trans and non-binary people, among other minority groups. Critics also say that emotion (or affect) recognition technology in particular, which purports to make judgments about a persons emotions based on their facial expressions, is scientifically flawed. Thats why one research nonprofit, the AI Now Institute, called for the prohibition of such technology in high-stakes decision-making including job applicant vetting.
[W]hile youre being interviewed, theres a camera thats recording you, and its recording all of your micro facial expressions and all of the gestures youre using, the intonation of your voice, and then pattern matching those things that they can detect with their highest performers, AI Now Institute co-founder Kate Crawford told Recodes Kara Swisher earlier this year. [It] might sound like a good idea, but think about how youre basically just hiring people who look like the people you already have.
Even members of Congress are worried about that technology. In 2018, US Sens. Kamala Harris, Elizabeth Warren, and Patty Murray wrote to the Equal Employment Opportunity Commission, the federal agency charged with investigating employment discrimination, asking whether such facial analysis technology could violate anti-discrimination laws.
Despite being one of the first laws to regulate these tools, the Illinois law doesnt address concerns about bias. No federal legislation explicitly regulates these AI-based hiring systems. Instead, employment lawyers say such AI tools are generally subject to the Uniform Guidelines, employment discrimination standards created by several federal agencies back in 1978 (you can read more about that here).
The EEOC did not respond to Recodes multiple requests for comment.
Meanwhile, its not clear how, under Illinois new law, companies like HireVue will go about explaining the characteristics in applicants that its AI considers, given that the company claims that its algorithms can weigh up to tens of thousands of factors (it says it removes factors that are not predictive of job success).
The law also doesnt explain what an applicant might be entitled to if a company violates one of its provisions. Law firms advising clients on compliance have also noted that its not clear whether the law applies exclusively to businesses filling a position in Illinois, or just interviews that take place in the state. Neither Illinois State Sen. Iris Martinez nor Illinois Rep. Jaime M. Andrade, legislators who worked on the law, responded to a request for comment by the time of publication.
HireVues CEO Kevin Parker said in a blog post that the law entails very little, if any, change because its platform already complies with GDPRs principles of transparency, privacy, and the right to be forgotten. [W]e believe every job interview should be fair and objective, and that candidates should understand how theyre being evaluated. This is fair game, and its good for both candidates and companies, he wrote in August.
A spokesperson for HireVue said the decision to provide an alternative to an AI-based analysis is up to the company thats hiring, but argued that those alternatives can more time-consuming for candidates. If a candidate believes that a system is biased, the spokesperson said recourse options are the same as when a candidate believes that any part of the hiring process, or any individual interviewer, was unfairly biased against them.
Under the new law in Illinois, if you participate in a video interview that uses AI tech, you can ask for your footage to be deleted after the fact. But its worth noting that the law appears to still give the company enough time to train its model on the results of your job interview even if you think the final decision was problematic.
This gives these AI hiring companies room to continue to learn, says Rieke. Theyre going to delete the underlying video, but any learning or improvement to their systems they get to keep.
Open Sourced is made possible by Omidyar Network. All Open Sourced content is editorially independent and produced by our journalists.
- A guide to healthy skepticism of artificial intelligence and coronavirus - Brookings Institution - April 2nd, 2020
- AI vs your career? What artificial intelligence will really do to the future of work - ZDNet - April 2nd, 2020
- Return On Artificial Intelligence: The Challenge And The Opportunity - Forbes - April 2nd, 2020
- Stanford launches an accelerated test of AI to help with Covid-19 care - STAT - April 2nd, 2020
- How Artificial Intelligence Is Helping Fight The COVID-19 Pandemic - Entrepreneur - April 2nd, 2020
- Enterprise Artificial Intelligence Along With Telehealth And Teleconferences Can Help In Fighting COVID-19 - Entrepreneur - April 2nd, 2020
- AI (Artificial Intelligence) Companies That Are Combating The COVID-19 Pandemic - Forbes - April 2nd, 2020
- How Artificial Intelligence is Going to Make Your Analytics Better Than Ever - Security Magazine - April 2nd, 2020
- STAT's guide to how hospitals are using AI to fight Covid-19 - STAT - April 2nd, 2020
- 6 Visions of How Artificial Intelligence will Change Architecture - ArchDaily - April 2nd, 2020
- The race problem with AI: Machines are learning to be racist' - Metro.co.uk - April 2nd, 2020
- Artificial Intelligence in Retail Market Projected to Grow with a CAGR of 35.9% Over the Forecast Period, 2019-2025 - ResearchAndMarkets.com - Yahoo... - April 2nd, 2020
- Google and the Oxford Internet Institute explain artificial intelligence basics with the A-Z of AI - VentureBeat - April 2nd, 2020
- AiThority Interview with Seth Siegel, AI Consulting at Infosys - AiThority - April 2nd, 2020
- Artificial Intelligence turns a persons thoughts into text - Times of India - April 2nd, 2020
- The Limitations of Artificial Intelligence in Businesses - AZoRobotics - April 2nd, 2020
- VA Looking to Expand Usage of Artificial Intelligence Data - GovernmentCIO Media - April 2nd, 2020
- New blood test study uses artificial intelligence to identify cancer. But its not ready for patients yet. - Cancer Research UK - Science Blog - April 2nd, 2020
- artificial intelligence | Definition, Examples, and ... - March 28th, 2020
- What is Artificial Intelligence? How Does AI Work? | Built In - March 28th, 2020
- Benefits & Risks of Artificial Intelligence - Future of ... - March 28th, 2020
- Global Artificial Intelligence in Healthcare Market - Premium Insight, Competitive News Feed Analysis, Company Usability Profiles, Market Sizing &... - March 28th, 2020
- The Global Artificial Intelligence in Aviation Market is expected to grow from USD 214.36 Million in 2018 to USD 1,824.46 Million by the end of 2025... - March 28th, 2020
- Is artificial intelligence the answer to disease prevention? - The Burn-In - March 28th, 2020
- Why transparency is key to promoting trust in artificial intelligence - IT PRO - March 28th, 2020
- Coronavirus: Spain to use artificial intelligence to automate testing - ComputerWeekly.com - March 28th, 2020
- Bridging the gaps: joining human and artificial intelligence | Technology - Business Chief Canada - March 28th, 2020
- DIAGNOS Will Utilize its Artificial Intelligence Medical Platform FLAIRE in Response to the US White House - Call to Action to Analyse and Transform... - March 26th, 2020
- LiveMD Global Telehealth Platform launches artificial intelligence tracking and triaging tools to help combat COVID-19 (CoronaVirus) Pandemic -... - March 26th, 2020
- New Research from Newark Reveals Strong Adoption of Artificial Intelligence within the Internet of Things Ecosystem - Embedded Computing Design - March 26th, 2020
- AI vs COVID-19: Here are the AI tools and services fighting coronavirus - AI News - March 26th, 2020
- Stanford virtual conference to focus on COVID19 and artificial intelligence | Stanford News - Stanford University News - March 26th, 2020
- Artificial Intelligence in the energy sector: opportunities and challenges - WhaTech - March 26th, 2020
- 31 Companies, Products and People making Artificial Intelligence a Reality in 2020 - PR Web - March 26th, 2020
- KT zu Guttenberg, Artificial Intelligence and You - theTrumpet.com - March 26th, 2020
- BrainChip and Socionext Provide a New Low-Power Artificial Intelligence Platform for AI Edge Applications - Design and Reuse - March 26th, 2020
- Artificial Intelligence Chipsets Market report reviews overview with demographic data and industry growth trends by 2025 - WhaTech Technology and... - March 26th, 2020
- Richmond-based Blue Heron Capital invests in company that uses artificial intelligence to improve lung disease monitoring - Richmond.com - March 26th, 2020
- Artificial Intelligence is Becoming the Future of Investment Platforms - EnterpriseTalk - March 19th, 2020
- Is Your Company Using Artificial Intelligence To Transform An Industry? Nominations For The Forbes 2020 AI 50 List Are Now Open - Forbes - March 19th, 2020
- On the Role of Artificial Intelligence in Genomics to Enhance Precisio | PGPM - Dove Medical Press - March 19th, 2020
- Artificial intelligence myths: Reality check - Livemint - March 19th, 2020
- Battery Researchers Look to Artificial Intelligence to Slash Recharging Times - Greentech Media News - March 19th, 2020
- The Army Will Soon Be Able to Command Robot Tanks With Artificial Intelligence - The National Interest - March 19th, 2020
- Canon Medical's 3T MR System Receives FDA Clearance for Artificial Intelligence-Based Image Reconstruction Technology - BioSpace - March 19th, 2020
- Coronavirus: How Artificial Intelligence, Data Science And Technology Is Used To Fight The Pandemic - Forbes - March 19th, 2020
- Artificial intelligence: The new power dynamic of today - Daily Sabah - March 19th, 2020
- Rethinking Financial Services with Artificial Intelligence Tools - The Financial Brand - March 19th, 2020
- Artificial intelligence recruited to find clues about Covid-19 - The Star Online - March 19th, 2020
- IIT-M to reskill women in artificial intelligence - Campus Varta - March 19th, 2020
- San Diego-Based Company takes Digital Marketing to the next Level by Launching the First Artificial Intelligence Marketing Agency in the United States... - March 19th, 2020
- An Unexpected Ally in the War With Bacteria - The Atlantic - March 19th, 2020
- Compliance For A Digital World: BSA/AML The New ABC's: Artificial Intelligence, Blockchain And How Each Complements The Other - JD Supra - March 19th, 2020
- The next step in digital transformation: is Artificial Intelligence production-ready for green sand foundries? - Foundry-Planet.com - March 19th, 2020
- Insights into the North America Artificial Intelligence in Fashion Market to 2027 - Drivers, Restraints, Opportunities and Trends -... - March 19th, 2020
- Artificial Intelligence by CWI and Amsterdam UMC proposes the best radiation treatment plans in clinical practice for the first time - Centrum... - March 19th, 2020
- H2O.ai Named to the 2020 CB Insights AI 100 List of Most Innovative Artificial Intelligence Startups - Yahoo Finance - March 4th, 2020
- 'There's No Story That Stays Stable for Too Long.' How Artists Are Using Artificial Intelligence to Confront Modern Anxieties - TIME - March 4th, 2020
- Minister declares creation of artificial intelligence centres in Poland - The First News - March 4th, 2020
- Dont forget to consider GDPR when using artificial intelligence in the workplace - ComputerWeekly.com - March 4th, 2020
- Iktos and SRI International Announce Collaboration to Combine Artificial Intelligence and Novel Automated Discovery Platform for Accelerated... - March 4th, 2020
- Why we need to adapt existing EU laws to Artificial Intelligence - European Public Health Alliance - March 4th, 2020
- How a Portland nonprofit is using artificial intelligence to help save whales, giraffes, zebras - Seattle Times - March 4th, 2020
- Artificial Intelligence Infused with Big Data Creating a Tech-driven World - EnterpriseTalk - March 4th, 2020
- Gaming with Artificial Intelligence Technology in 2020 - ReadWrite - March 4th, 2020
- Global Artificial Intelligence-as-a-Service (AIaaS) Market 2020-2024 | Growing Adoption of Cloud Based Solutions to Boost Market Growth | Technavio -... - March 4th, 2020
- WorldMarkets Continues With the Success of Its Trading Artificial Intelligence - Live Bitcoin News - March 4th, 2020
- Why Artificial Intelligence Will Never Beat the Stock Market - Traders Magazine - March 4th, 2020
- Why Neuro-Symbolic Artificial Intelligence Is The AI Of The Future - Digital Trends - January 5th, 2020
- Welcome to the roaring 2020s, the artificial intelligence decade - GreenBiz - January 5th, 2020
- Top five projections in Artificial Intelligence for 2020 - Economic Times - January 5th, 2020
- A reality check on artificial intelligence: Can it match the hype? - PhillyVoice.com - January 5th, 2020
- Can medical artificial intelligence live up to the hype? - Los Angeles Times - January 5th, 2020
- How This Cofounder Created An Artificial Intelligence Styling Company To Help Consumers Shop - Forbes - January 5th, 2020
- The U.S. Patent and Trademark Office Takes on Artificial Intelligence - JD Supra - January 5th, 2020
- Baidu looks to work with Indian institutions on AI - BusinessLine - January 5th, 2020
- Top Movies Of 2019 That Depicted Artificial Intelligence (AI) - Analytics India Magazine - January 5th, 2020
- Shocking ways AI technology will revolutionise every day industries in YOUR lifetime - Express.co.uk - January 5th, 2020
- Artificial intelligence takes scam to a whole new level - The Jackson Sun - January 5th, 2020
- Global Industrial Artificial Intelligence Market 2019 Research by Business Analysis, Growth Strategy and Industry Development to 2024 - Food &... - January 5th, 2020