{"id":297513,"date":"2018-10-11T12:42:43","date_gmt":"2018-10-11T16:42:43","guid":{"rendered":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/uncategorized\/amazon-built-an-ai-to-evaluate-job-applicants-one-problem-it-seemed-sexist.php"},"modified":"2018-10-11T12:42:43","modified_gmt":"2018-10-11T16:42:43","slug":"amazon-built-an-ai-to-evaluate-job-applicants-one-problem-it-seemed-sexist","status":"publish","type":"post","link":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/futurism\/amazon-built-an-ai-to-evaluate-job-applicants-one-problem-it-seemed-sexist.php","title":{"rendered":"Amazon Built an AI to Evaluate Job Applicants. One Problem: It Seemed Sexist."},"content":{"rendered":"<p><\/p><h2>Gender Gap<\/h2><p>In 2014, Amazon built an AI to evaluate job applicants&rsquo;&nbsp;r&eacute;sum&eacute;s. By 2015, it realized the system had a major flaw: It didn&rsquo;t like women.<\/p><p>According to five sources who <a href=\"https:\/\/www.reuters.com\/article\/us-amazon-com-jobs-automation-insight\/amazon-scraps-secret-ai-recruiting-tool-that-showed-bias-against-women-idUSKCN1MK08G\">spoke to <em>Reuters<\/em><\/a>, Amazon spent years developing an algorithm that used machine learning to sift through job applicants in order to identify the best candidates.<\/p><p>But, in a decision that reads like a metaphor for the diversity-challenged tech sector, the company abandoned the effort in 2017 after it realized it couldn&rsquo;t guarantee the AI wouldn&rsquo;t discriminate against female applicants.<\/p><p>An Amazon spokesperson provided this statement to Futurism: &ldquo;This was never used by Amazon recruiters to evaluate candidates.&rdquo;<\/p><h2>Bad Data<\/h2><p>The problem, according to the unnamed Amazon sources, was that the company&rsquo;s developers trained the AI on r&eacute;sum&eacute;s submitted to the company over a 10-year period.&nbsp;Though the&nbsp;<em>Reuters<\/em> report didn&rsquo;t spell it out, it sounds like researchers were probably trying to train it to identify new r&eacute;sum&eacute;s that were similar to those of applicants who the company had hired in the past.<\/p><p>But because most Amazon employees are male &mdash; as of late last year, <a href=\"https:\/\/www.recode.net\/2017\/10\/21\/16512448\/amazon-gender-diversity-leadership-executives-jeff-bezos\" target=\"_blank\" rel=\"noopener\">men filled<\/a> 17 out of 18 of its top executive positions&nbsp;&mdash; the AI seemingly decided that men were preferable.<\/p><h2>Biased World<\/h2><p>Training AIs with biased data &mdash; and thereby producing biased AIs &mdash; is a major problem in machine learning.<\/p><p>A <a href=\"https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing\"><em>ProPublica&nbsp;<\/em>investigation<\/a> found that an algorithm that predicts the likelihood that criminals will offend again discriminated against black people. And that&rsquo;s to say nothing of the Microsoft-created Tay, an artificially intelligent Twitter chatbot that&nbsp;<a href=\"https:\/\/www.theguardian.com\/technology\/2016\/mar\/24\/tay-microsofts-ai-chatbot-gets-a-crash-course-in-racism-from-twitter\">quickly learned<\/a> from online pranksters to spew racist vitriol.<\/p><p>The tech industry now faces a huge challenge: It needs to figure out a way to create unbiased AIs when all the&nbsp;available training data comes from a biased world.<\/p><p><em>This story was updated with a statement from an Amazon spokesperson.<\/em><\/p><p><strong>READ MORE:&nbsp;<\/strong><a href=\"https:\/\/www.reuters.com\/article\/us-amazon-com-jobs-automation-insight\/amazon-scraps-secret-ai-recruiting-tool-that-showed-bias-against-women-idUSKCN1MK08G\">Amazon scraps secret AI recruiting tool that showed bias against women<\/a>[<em>Reuters<\/em>]<\/p><p><strong><em>More on biased AI:&nbsp;<a href=\"https:\/\/futurism.com\/microsoft-announces-tool-catch-biased-ai\">Microsoft Announces Tool To Catch Biased AI Because We Keep Making Biased AI<\/a><\/em><\/strong><\/p><p><img decoding=\"async\" src=\"https:\/\/wp-assets.futurism.com\/2018\/10\/amazon-women-bias-1200x630.png\" style=\"padding-left:10px; padding-right: 10px;\"><\/p><p>See the rest here:<br><a target=\"_blank\" rel=\"nofollow\" href=\"https:\/\/futurism.com\/sexist-ai-amazon\" title=\"Amazon Built an AI to Evaluate Job Applicants. One Problem: It Seemed Sexist.\">Amazon Built an AI to Evaluate Job Applicants. One Problem: It Seemed Sexist.<\/a><\/p>","protected":false},"excerpt":{"rendered":"<p> Gender Gap In 2014, Amazon built an AI to evaluate job applicants\u2019\u00a0r\u00e9sum\u00e9s. By 2015, it realized the system had a major flaw: It didn\u2019t like women <a href=\"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/futurism\/amazon-built-an-ai-to-evaluate-job-applicants-one-problem-it-seemed-sexist.php\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"limit_modified_date":"","last_modified_date":"","_lmt_disableupdate":"","_lmt_disable":"","footnotes":""},"categories":[11],"tags":[],"class_list":["post-297513","post","type-post","status-publish","format-standard","hentry","category-futurism"],"modified_by":null,"_links":{"self":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/posts\/297513"}],"collection":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/comments?post=297513"}],"version-history":[{"count":0,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/posts\/297513\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/media?parent=297513"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/categories?post=297513"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/tags?post=297513"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}