{"id":1028512,"date":"2024-05-21T02:34:07","date_gmt":"2024-05-21T06:34:07","guid":{"rendered":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/uncategorized\/openai-researcher-quits-flames-company-for-axing-team-working-to-prevent-superintelligent-ai-from-turning-against-humankind-2.php"},"modified":"2024-05-21T02:34:07","modified_gmt":"2024-05-21T06:34:07","slug":"openai-researcher-quits-flames-company-for-axing-team-working-to-prevent-superintelligent-ai-from-turning-against-humankind-2","status":"publish","type":"post","link":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/futurist\/openai-researcher-quits-flames-company-for-axing-team-working-to-prevent-superintelligent-ai-from-turning-against-humankind-2.php","title":{"rendered":"OpenAI Researcher Quits, Flames Company for Axing Team Working to Prevent Superintelligent AI From Turning Against Humankind"},"content":{"rendered":"<p><\/p><div><img width=\"300\" height=\"188\" src=\"https:\/\/wp-assets.futurism.com\/2024\/05\/openai-researcher-quits-criticism-superallignment-300x188.jpg\" class=\"attachment-medium size-medium wp-post-image\" alt=\"It might sound like a joke, but OpenAI has dissolved the team responsible for making sure advanced AI doesn't turn against humankind.\" decoding=\"async\" loading=\"lazy\" style=\"padding-left:10px; padding-right: 10px;\"><\/div><h2>OpenAI Shut<\/h2><p>It might sound like a joke, but OpenAI has dissolved the team responsible for making sure advanced AI doesn't turn against humankind.<\/p><p>Yes, you read that right. The objective of the team, <a href=\"https:\/\/openai.com\/index\/introducing-superalignment\/\">formed just last summer<\/a>, was to \"steer and control AI systems much smarter than us.\"<\/p><p>\"To solve this problem within four years, we&rsquo;re starting a new team, co-led by Ilya Sutskever and Jan Leike, and dedicating 20 percent of the compute we&rsquo;ve secured to date to this effort,\" the company wrote at the time. \"We&rsquo;re looking for excellent ML researchers and engineers to join us.\"<\/p><p>If those two names sound familiar, it's because Sutskever <a href=\"https:\/\/futurism.com\/the-byte\/ilya-sutskever-leaves-openai\">departed the company<\/a> under a dark cloud this week, prompting Leike to <a href=\"https:\/\/mashable.com\/article\/openai-alignment-resignation-comments\">quit in disgust<\/a>.<\/p><p>And now the other shoe has dropped: as <a href=\"https:\/\/www.wired.com\/story\/openai-superalignment-team-disbanded\/\">first reported by&nbsp;<em>Wired<\/em><\/a>, the entire team has now been dissolved.<\/p><h2>Terminator Prequel<\/h2><p>Sutskever, who was <a href=\"https:\/\/futurism.com\/the-byte\/ilya-sutskever-openai-limbo\">intimately involved<\/a> with last year's plot to out OpenAI CEO Sam Altman, has remained largely mum this week. But Leike has been publicly sounding off.<\/p><p>\"I joined because I thought OpenAI would be the best place in the world to do this research,\" he <a href=\"https:\/\/x.com\/janleike\/status\/1791498178346549382\">wrote on X-formerly-Twitter<\/a>. \"However, I have been disagreeing with OpenAI leadership about the company's core priorities for quite some time, until we finally reached a breaking point.\"<\/p><p>Among his gripes: that the company wasn't living up to its promises to dedicate technical resources to the effort.<\/p><p>\"Over the past few months my team has been sailing against the wind,\" he <a href=\"https:\/\/x.com\/janleike\/status\/1791498182125584843\">continued<\/a>. \"Sometimes we were struggling for compute and it was getting harder and harder to get this crucial research done.\"<\/p><p>But his objections also sound more existential than just company politics.<\/p><p>\"Building smarter-than-human machines is an inherently dangerous endeavor,\" <a href=\"https:\/\/x.com\/janleike\/status\/1791498183543251017\">Leike wrote<\/a>. \"OpenAI is shouldering an enormous responsibility on behalf of all of humanity.\"<\/p><p>\"But over the past years, safety culture and processes have taken a backseat to shiny products,\" he <a href=\"https:\/\/x.com\/janleike\/status\/1791498184671605209\">alleged<\/a>.<\/p><p>OpenAI, for its part, has been busy doing exactly that: this week, it <a href=\"https:\/\/futurism.com\/new-chatgpt-ai-camera-video\">showed off a new version of ChatGPT<\/a> that can respond to live video through a user's smartphone camera in an emotionally inflected voice that Altman <a href=\"https:\/\/futurism.com\/the-byte\/sam-altman-chatgpt-her\">compared to the 2013 romantic tragedy \"Her<\/a>.\"<\/p><p>\"It&rsquo;s a process of trust collapsing bit by bit, like dominoes falling one by one,\" one OpenAI employee <a href=\"https:\/\/www.vox.com\/future-perfect\/2024\/5\/17\/24158403\/openai-resignations-ai-safety-ilya-sutskever-jan-leike-artificial-intelligence\">told&nbsp;<em>Vox<\/em><\/a>.<\/p><p><strong>More on OpenAI:<\/strong> <a href=\"https:\/\/futurism.com\/the-byte\/fake-person-openai-fund\"><em>The Person Who Was in Charge of OpenAI's $175 Million Fund Appears to Be Fake<\/em><\/a><\/p><p>The post <a href=\"https:\/\/futurism.com\/openai-researcher-quits-criticism-superallignment\">OpenAI Researcher Quits, Flames Company for Axing Team Working to Prevent Superintelligent AI From Turning Against Humankind<\/a> appeared first on <a href=\"https:\/\/futurism.com\">Futurism<\/a>.<\/p><p>Original post:<\/p><p><a target=\"_blank\" href=\"https:\/\/futurism.com\/the-byte\/openai-researcher-quits-criticism-superallignment\" title=\"OpenAI Researcher Quits, Flames Company for Axing Team Working to Prevent Superintelligent AI From Turning Against Humankind\" rel=\"noopener\">OpenAI Researcher Quits, Flames Company for Axing Team Working to Prevent Superintelligent AI From Turning Against Humankind<\/a><\/p>","protected":false},"excerpt":{"rendered":"<p> OpenAI Shut It might sound like a joke, but OpenAI has dissolved the team responsible for making sure advanced AI doesn't turn against humankind. Yes, you read that right <a href=\"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/futurist\/openai-researcher-quits-flames-company-for-axing-team-working-to-prevent-superintelligent-ai-from-turning-against-humankind-2.php\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"limit_modified_date":"","last_modified_date":"","_lmt_disableupdate":"","_lmt_disable":"","footnotes":""},"categories":[10],"tags":[],"class_list":["post-1028512","post","type-post","status-publish","format-standard","hentry","category-futurist"],"modified_by":null,"_links":{"self":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/posts\/1028512"}],"collection":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/comments?post=1028512"}],"version-history":[{"count":0,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/posts\/1028512\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/media?parent=1028512"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/categories?post=1028512"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.euvolution.com\/futurist-transhuman-news-blog\/wp-json\/wp\/v2\/tags?post=1028512"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}