Why Did OpenAI Disband Its Robotics Team? – Analytics India Magazine

Last month, OpenAI cofounder Wojciech Zaremba said the company has disbanded its robotics team in a Weights & Biases podcast. I was actually working for several years on robotics. Recently, we changed the focus at OpenAI. I disbanded the robotics team. There are actually plenty of domains that are very rich with data. Ultimately that was holding us back, in the case of robotics, said Zaremba.

The decision was quite hard on him, but he later realised that this was best from a companys perspective (to achieve artificial general intelligence (AGI)). When we created robotics, we thought that we could go pretty far. We had self-generated data and reinforcement learning. But, at the moment, I believe that actually pre-training allows to give model 100x cheaper IQ points, and that might follow with other techniques, said Zaremba.

Citing GPT-3, Zaremba said pre-training in language models includes training machine learning models on unsupervised tasks such as next word predictions. But, in the case of robotics, we do not have such data, he added.

Initially, when OpenAI started robotics projects, Zaremba said they lacked clarity on how and what they wanted to build. But, over time, they got more clarity on things they wanted to focus on.

Besides the dearth of data, OpenAIs move away from robotics reflects the economic realities and capital intensive nature of the projects. Three years ago, Rethink Robotics shut down its operations. Last year, the maker of driverless trucks, Starsky Robot, also shut shop. Same year, SoftBank halted the production of its famed robot Pepper.

SoftBank acquired Boston Dynamics from Google in 2017 and recently sold the robotics company to Hyundai for $1.1 billion. Boston Dynamics caught the popular imagination with viral videos of its humanoid and dog-like robots.

Zaremba said building robots requires high computing capabilities. Plus, there are technical issues with running machines in real-time. There are two possibilities to successfully deploy robots. One is to collect a lot of data. Another possibility is that we need powerful video models like that of powerful text models, Zaremba said.

The notable powerful language models at present include Googles Switch Transformer, GPT-3, DistilBERT, Google Gshard, BAAIs Wu Dao 2.0, and GPT-J.

According to MITs The state of industrial robotics: Emerging technologies, challenges and key research directions, the key challenges holding back the robotics industry includes the high cost of integration, lack of standards, inflexibility, better balance of speed and safety, data protocols, and investments to enable technologies.

OpenAI first demonstrated its robotics work in October 2019, when it published research detailing a hand guided by an AI model with 13K years of cumulative experience, called Dactyl, which replicated a humans hand movement to solve the Rubiks cube. Our robot still hasnt perfected its technique though, as it solves the Rubiks Cube 60% of the time (and only 20% of the time for a maximally difficult scramble), according to OpenAI.

OpenAI, at the time, had said, as a result of ADR development, more developers will be able to divert from building task-specific robots to general-purpose machines. Indubitably, we are decades away from having a robot that will make its own decisions without human intervention, but leveraging ADR, developers can successfully attain it, as per OpenAI.

In April 2019, OpenAI hosted its first Robotic Symposium. The event brought together a diverse set of people from robotics and machine learning communities, alongside academics and industry leaders, to create a platform to exchange ideas and address open questions in building complex robot systems.

Four years ago, OpenAI had released Robotschool, open-source software for robot simulation, integrated with OpenAI Gym. In February 2018, it released eight simulated robotics environments and a Baselines implementation of Hindsight Experience Replay. OpenAI has used these environments to train models which work on physical robots.

Amit Raja Naik is a senior writer at Analytics India Magazine, where he dives deep into the latest technology innovations. He is also a professional bass player.

Read more here:

Why Did OpenAI Disband Its Robotics Team? - Analytics India Magazine