{"id":196613,"date":"2017-06-05T07:28:22","date_gmt":"2017-06-05T11:28:22","guid":{"rendered":"http:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/scientists-made-a-huge-library-of-atari-gameplay-to-give-ai-a-power-up-motherboard\/"},"modified":"2017-06-05T07:28:22","modified_gmt":"2017-06-05T11:28:22","slug":"scientists-made-a-huge-library-of-atari-gameplay-to-give-ai-a-power-up-motherboard","status":"publish","type":"post","link":"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/ai\/scientists-made-a-huge-library-of-atari-gameplay-to-give-ai-a-power-up-motherboard\/","title":{"rendered":"Scientists Made a Huge Library of Atari Gameplay to Give AI a Power Up &#8211; Motherboard"},"content":{"rendered":"<p><p>    Artificial intelligence is slowly proving that that video games    aren't a total waste of time, at least for machines: It's    through     learning to play games that AI algorithms can acquire all    sorts of generalizable skills,     like problem-solving.  <\/p>\n<p>    Now, computer scientists from RWTH Aachen University in Germany    and Microsoft Research have released the largest-ever database    of human playthroughs for some of the most popular games for    the Atari 2600. Artificial agents using deep learning    techniques will be able to pull patterns out of these    playthroughs and learn from them.  <\/p>\n<p>    Read More:     Why Artificial Intelligence Researchers Love 'Super Mario    Bros.'  <\/p>\n<p>    According to a paper posted to the arXiv preprint server    this week, which is undergoing peer review, the database    contains more than 45 hours of gameplay from five games:    Q*Bert, Ms. Pacman, Space Invaders, Video Pinball, and    Montezuma's Revenge. Video games are an increasingly    popular training ground for AI to solve general problems, like    how to quickly arrive at a course of action, or how to    effectively learn in an environment where the rewards for    learning are sparse, which is     notoriously the case for Montezuma's Revenge    .  <\/p>\n<p>    A massive database of human playthroughs could accelerate this    kind of research, making researchers' lives easier and    potentially producing more capable AI.  <\/p>\n<p>    \"When a person learns to play a game, you have lots of prior    information about the world around you; but when an AI agent    learns, it does it from scratch,\" said Vitaly    Kurin, a Master's student at RWTH Aachen University and    co-author of the paper, in an interview. \"When an AI agent    learns from human demonstration, it's like implicitly giving    the bot all of the information we have about the world, and    optimum strategies and behaviour. Everybody can use this    dataset and check their ideas and models.\"  <\/p>\n<p>    Kurin and his colleagues collected the database with a    browser-based Atari 2600 emulator paired with an app that    captures the player's input. They posted a link to the emulator    to Reddit and asked people to help with the experiment by    playing some video games, Kurin said. To make things faster and    easier, the app only recorded the initial game state and every    player input after that. The entire playthrough was then    reconstructed offline using the player's recorded actions on    the starting game state.  <\/p>\n<p>    That might seem like a lot of work, but the payoff for research    using the database could be huge. Machine learning using human    demonstrations has already shown itself to be an impressive    technique for quick learning. Researchers from the OpenAI    institute recently unveiled an AI system that     uses a single human demonstration in virtual reality to    teach itself how to stack toy blocks.  <\/p>\n<p>    \"Let's imagine you have an autonomous car that you want to    train to drive in the real world,\" Kurin said. \"What if we gave    the car a model that teaches it how to behave like a human? It    suddenly becomes less dangerous because it won't do some crazy    stuff after training completely from scratch.\"    It's enough to make me glad for my peanut human brainwhen I    play video games, it's just to relax. And that's fine with me.  <\/p>\n<p>    Subscribe to Science Solved    It , Motherboard's new show about the    greatest mysteries that were solved by science.  <\/p>\n<p><!-- Auto Generated --><\/p>\n<p>See more here:<\/p>\n<p><a target=\"_blank\" rel=\"nofollow\" href=\"https:\/\/motherboard.vice.com\/en_us\/article\/scientists-made-a-huge-library-of-atari-gameplay-to-give-ai-a-power-up\" title=\"Scientists Made a Huge Library of Atari Gameplay to Give AI a Power Up - Motherboard\">Scientists Made a Huge Library of Atari Gameplay to Give AI a Power Up - Motherboard<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p> Artificial intelligence is slowly proving that that video games aren't a total waste of time, at least for machines: It's through learning to play games that AI algorithms can acquire all sorts of generalizable skills, like problem-solving. Now, computer scientists from RWTH Aachen University in Germany and Microsoft Research have released the largest-ever database of human playthroughs for some of the most popular games for the Atari 2600 <a href=\"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/ai\/scientists-made-a-huge-library-of-atari-gameplay-to-give-ai-a-power-up-motherboard\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[187743],"tags":[],"class_list":["post-196613","post","type-post","status-publish","format-standard","hentry","category-ai"],"_links":{"self":[{"href":"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/wp-json\/wp\/v2\/posts\/196613"}],"collection":[{"href":"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/wp-json\/wp\/v2\/comments?post=196613"}],"version-history":[{"count":0,"href":"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/wp-json\/wp\/v2\/posts\/196613\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/wp-json\/wp\/v2\/media?parent=196613"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/wp-json\/wp\/v2\/categories?post=196613"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.euvolution.com\/prometheism-transhumanism-posthumanism\/wp-json\/wp\/v2\/tags?post=196613"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}