Picture a tray. On the tray is an assortment of shapes: Some cubes, others spheres. The shapes are made from a variety of different materials and represent an assortment of sizes. In total there are, perhaps, eight objects. My question: Looking at the objects, are there an equal number of large things and metal spheres?
Its not a trick question. The fact that it sounds as if it is is proof positive of just how simple it actually is. Its the kind of question that a preschooler could most likely answer with ease. But its next to impossible for todays state-of-the-art neural networks. This needs to change. And it needs to happen by reinventing artificial intelligence as we know it.
Thats not my opinion; its the opinion of David Cox, director of the MIT-IBM Watson A.I. Lab in Cambridge, MA. In a previous life, Cox was a professor at Harvard University, where his team used insights from neuroscience to help build better brain-inspired machine learning computer systems. In his current role at IBM, he oversees work on the companys Watson A.I. platform.Watson, for those who dont know, was the A.I. which famously defeated two of the top game show players in history at TV quiz show Jeopardy. Watson also happens to be a primarily machine-learning system, trained using masses of data as opposed to human-derived rules.
So when Cox says that the world needs to rethink A.I. as it heads into a new decade, it sounds kind of strange. After all, the 2010s has been arguably the most successful ten-year in A.I. history: A period in which breakthroughs happen seemingly weekly, and with no frosty hint of an A.I. winter in sight.This is exactly why he thinks A.I. needs to change, however. And his suggestion for that change, a currently obscure term called neuro-symbolic A.I., could well become one of those phrases were intimately acquainted with by the time the 2020s come to an end.
Neuro-symbolic A.I. is not, strictly speaking, a totally new way of doing A.I. Its a combination of two existing approaches to building thinking machines; ones which were once pitted against each as mortal enemies.
The symbolic part of the name refers to the first mainstream approach to creating artificial intelligence. From the 1950s through the 1980s, symbolic A.I. ruled supreme. To a symbolic A.I. researcher, intelligence is based on humans ability to understand the world around them by forming internal symbolic representations. They then create rules for dealing with these concepts, and these rules can be formalized in a way that captures everyday knowledge.
If the brain is analogous to a computer, this means that every situation we encounter relies on us running an internal computer program which explains, step by step, how to carry out an operation, based entirely on logic. Provided that this is the case, symbolic A.I. researchers believe that those same rules about the organization of the world could be discovered and then codified, in the form of an algorithm, for a computer to carry out.
Symbolic A.I. resulted in some pretty impressive demonstrations. For example, in 1964 the computer scientist Bertram Raphael developed a system called SIR, standing for Semantic Information Retrieval. SIR was a computational reasoning system that was seemingly able to learn relationships between objects in a way that resembled real intelligence. If you were to tell it that, for instance, John is a boy; a boy is a person; a person has two hands; a hand has five fingers, then SIR would answer the question How many fingers does John have? with the correct number 10.
there are concerning cracks in the wall that are starting to show.
Computer systems based on symbolic A.I. hit the height of their powers (and their decline) in the 1980s. This was the decade of the so-called expert system which attempted to use rule-based systems to solve real-world problems, such as helping organic chemists identify unknown organic molecules or assisting doctors in recommending the right dose of antibiotics for infections.
The underlying concept of these expert systems was solid. But they had problems. The systems were expensive, required constant updating, and, worst of all, could actually become less accurate the more rules were incorporated.
The neuro part of neuro-symbolic A.I. refers to deep learning neural networks. Neural nets are the brain-inspired type of computation which has driven many of the A.I. breakthroughs seen over the past decade. A.I. that can drive cars? Neural nets. A.I. which can translate text into dozens of different languages? Neural nets. A.I. which helps the smart speaker in your home to understand your voice? Neural nets are the technology to thank.
Neural networks work differently to symbolic A.I. because theyre data-driven, rather than rule-based. To explain something to a symbolic A.I. system means explicitly providing it with every bit of information it needs to be able to make a correct identification. As an analogy, imagine sending someone to pick up your mom from the bus station, but having to describe her by providing a set of rules that would let your friend pick her out from the crowd. To train a neural network to do it, you simply show it thousands of pictures of the object in question. Once it gets smart enough, not only will it be able to recognize that object; it can make up its own similar objects that have never actually existed in the real world.
For sure, deep learning has enabled amazing advances, David Cox told Digital Trends. At the same time, there are concerning cracks in the wall that are starting to show.
One of these so-called cracks relies on exactly the thing that has made todays neural networks so powerful: data. Just like a human, a neural network learns based on examples. But while a human might only need to see one or two training examples of an object to remember it correctly, an A.I. will require many, many more. Accuracy depends on having large amounts of annotated data with which it can learn each new task.
That makes them less good at statistically rare black swan problems. A black swan event, popularized by Nassim Nicholas Taleb, is a corner case that is statistically rare. Many of our deep learning solutions today as amazing as they are are kind of 80-20 solutions, Cox continued. Theyll get 80% of cases right, but if those corner cases matter, theyll tend to fall down. If you see an object that doesnt normally belong [in a certain place], or an object at an orientation thats slightly weird, even amazing systems will fall down.
Before he joined IBM, Cox co-founded a company, Perceptive Automata, that developed software for self-driving cars. The team had a Slack channel in which they posted funny images they had stumbled across during the course of data collection. One of them, taken at an intersection, showed a traffic light on fire. Its one of those cases that you might never see in your lifetime, Cox said. I dont know if Waymo and Tesla have images of traffic lights on fire in the datasets they use to train their neural networks, but Im willing to bet if they have any, theyll only have a very few.
Its one thing for a corner case to be something thats insignificant because it rarely happens and doesnt matter all that much when it does. Getting a bad restaurant recommendation might not be ideal, but its probably not going to be enough to even ruin your day. So long as the previous 99 recommendations the system made are good, theres no real cause for frustration. A self-driving car failing to respond properly at an intersection because of a burning traffic light or a horse-drawn carriage could do a lot more than ruin your day. It might be unlikely to happen, but if it does we want to know that the system is designed to be able to cope with it.
If you have the ability to reason and extrapolate beyond what weve seen before, we can deal with these scenarios, Cox explained. We know that humans can do that. If I see a traffic light on fire, I can bring a lot of knowledge to bear. I know, for example, that the light is not going to tell me whether I should stop or go. I know I need to be careful because [drivers around me will be confused.] I know that drivers coming the other way may be behaving differently because their light might be working. I can reason a plan of action that will take me where I need to go. In those kinds of safety-critical, mission-critical settings, thats somewhere I dont think that deep learning is serving us perfectly well yet. Thats why we need additional solutions.
The idea of neuro-symbolic A.I. is to bring together these approaches to combine both learning and logic. Neural networks will help make symbolic A.I. systems smarter by breaking the world into symbols, rather than relying on human programmers to do it for them. Meanwhile, symbolic A.I. algorithms will help incorporate common sense reasoning and domain knowledge into deep learning. The results could lead to significant advances in A.I. systems tackling complex tasks, relating to everything from self-driving cars to natural language processing. And all while requiring much less data for training.
Neural networks and symbolic ideas are really wonderfully complementary to each other, Cox said. Because neural networks give you the answers for getting from the messiness of the real world to a symbolic representation of the world, finding all the correlations within images. Once youve got that symbolic representation, you can do some pretty magical things in terms of reasoning.
For instance, in the shape example I started this article with, a neuro-symbolic system would use a neural networks pattern recognition capabilities to identify objects. Then it would rely on symbolic A.I. to apply logic and semantic reasoning to uncover new relationships. Such systems have already been proven to work effectively.
Its not just corner cases where this would be useful, either. Increasingly, it is important that A.I. systems are explainable when required. A neural network can carry out certain tasks exceptionally well, but much of its inner reasoning is black boxed, rendered inscrutable to those who want to know how it made its decision. Again, this doesnt matter so much if its a bot that recommends the wrong track on Spotify. But if youve been denied a bank loan, rejected from a job application, or someone has been injured in an incident involving an autonomous car, youd better be able to explain why certain recommendations have been made. Thats where neuro-symbolic A.I. could come in.
A few decades ago, the worlds of symbolic A.I. and neural networks were at odds with one another. The renowned figures who championed the approaches not only believed that their approach was right; they believed that this meant the other approach was wrong. They werent necessarily incorrect to do so. Competing to solve the same problems, and with limited funding to go around, both schools of A.I. appeared fundamentally opposed to each other. Today, it seems like the opposite could turn out to be true.
Its really fascinating to see the younger generation, Cox said. Most of my team are relatively junior people: fresh, excited, fairly recently out of their Ph.Ds. They just dont have any of that history. They just dont care [about the two approaches being pitted against each other] and not caring is really powerful because it opens you up and gets rid of those prejudices. Theyre happy to explore intersections They just want to do something cool with A.I.
Should all go according to plan, all of us will benefit from the results.
Read more from the original source:
- Break into artificial intelligence with this four-course ... - July 13th, 2020
- New Report from Corinium and FICO Signals Increased Demand for Artificial Intelligence in the Age of COVID-19 - PRNewswire - July 13th, 2020
- Burden of COVID-19 on the Market & Rehabilitation Plan | Artificial Intelligence (AI) Market in Manufacturing Industry 2019-2023 | The Increasing... - July 13th, 2020
- Where it Counts, U.S. Leads in Artificial Intelligence - Department of Defense - July 13th, 2020
- The path to real-world artificial intelligence - TechRepublic - July 13th, 2020
- Healthcare Artificial Intelligence Market Analysis Of Global Trends, Demand And Competition 2020-2028 - Cole of Duty - July 13th, 2020
- The journey that organizations should embark on to realize the true potential of AI - The Indian Express - July 13th, 2020
- Commentary: Artificial intelligence and automation would actually benefit Singapore - CNA - July 13th, 2020
- How Artificial Intelligence Innovations Induced Industrywide Advancements? - Analytics Insight - July 13th, 2020
- Break into artificial intelligence with this four-course online training for $35 - ZDNet - July 13th, 2020
- Integrating Artificial Intelligence in Treatment Planning - Imaging Technology News - July 13th, 2020
- Automotive Artificial Intelligence Industry Market Trend Analysis and Major Factors Forecast Report till 2025 - CueReport - July 13th, 2020
- Artificial Intelligence in Transportation Market, Share, Growth, Trends And Forecast To 2025 - Cole of Duty - July 13th, 2020
- Artificial Intelligence In Transportation Market 2020: Industry Analysis By Size, Share, Key Players, Growth Trends and Forecast Till 2025 - Apsters... - July 13th, 2020
- High Growth of Steady Explore Artificial Intelligence (AI) in Construction Market size, Growth analysis & forecast report to 2025 - 3rd Watch News - July 13th, 2020
- Enterprise Artificial Intelligence Market 2020: Challenges, Growth, Types, Applications, Revenue, Insights, Growth Analysis, Competitive Landscape,... - July 13th, 2020
- Artificial Intelligence in Construction Market will drastically increase in the Future | brandessenceresearch.biz - Cole of Duty - July 13th, 2020
- Top 12 Ways Artificial Intelligence Will Impact Healthcare - July 12th, 2020
- Using Artificial Intelligence to Address Criminal Justice ... - July 12th, 2020
- Augmented Intelligence is the New Intelligence - Analytics Insight - July 12th, 2020
- MULTIMEDIA UPDATE - New Research Reveals Adoption and Implementation of Artificial Intelligence in the Enterprise - GlobeNewswire - July 12th, 2020
- trusted computing artificial intelligence (AI) information warfare - Military & Aerospace Electronics - July 12th, 2020
- Artificial Intelligence will aid in better decision-making capacity - Livemint - July 12th, 2020
- COVID-19 Impact & Recovery Analysis - Artificial Intelligence Platforms Market 2020-2024 | Rise in Demand for AI-based Solutions to Boost Growth |... - July 12th, 2020
- COVID-19 and Artificial Intelligence: How the pandemic has re-ignited a focus on the software - Savannah Morning News - July 12th, 2020
- Second plenary meeting of the Ad Hoc Committee on Artificial Intelligence (CAHAI) - Council of Europe - July 12th, 2020
- LI startup predicts where COVID-19 will spike - Newsday - July 12th, 2020
- How Innovation is Changing the Artificial Intelligence in Telecommunication Market - 3rd Watch News - July 12th, 2020
- AI In Human Resources To AI or not to AI? - Analytics Insight - July 12th, 2020
- Ardigen Enters Into Research Collaboration With CVC to Apply Artificial Intelligence for Identification of T-cell Targets - PRNewswire - July 12th, 2020
- 'Make in India': Artificial Intelligence Company, AiBridge ML, Adds Handwriting and Image Recognition Capabilities to AiMunshi, the Popular Financial... - July 12th, 2020
- CORRECTION - OMNIQs Artificial Intelligence-Based Quest Shield Solution Selected by the Talmudical Academy of Baltimore - Financialbuzz.com - July 12th, 2020
- How Artificial Intelligence Could Lead to Better Investment Decisions - Barron's - July 12th, 2020
- European Parliament names MEPs on artificial intelligence, cancer plan and foreign interference committees - Science Business - July 12th, 2020
- Artificial Intelligence: worth the hype? - BusinessCloud - July 12th, 2020
- The Amalgamation of Human Brain and Artificial Intelligence - Analytics Insight - July 12th, 2020
- Latest Trends in the Field of Artificial Intelligence - Analytics Insight - July 11th, 2020
- The main beneficiaries of artificial intelligence success are IT departments themselves - ZDNet - July 11th, 2020
- Artificial Intelligence Robots Market is Anticipated to Cross US$ 15 Billion By 2025 MRE Analysis - Cole of Duty - July 11th, 2020
- Charting the Role of Artificial Intelligence in Shipping - BBN Times - July 11th, 2020
- Artificial Intelligence in Education System Market: Revenue Growth and Applications Insights till 2030 - Cole of Duty - July 11th, 2020
- COVID-19 Impact and Recovery Analysis | Artificial Intelligence (AI) Market In BFSI Sector 2019-2023 | Focus On Autonomous Banking to Boost Growth |... - July 8th, 2020
- Artificial Intelligence Powered COVID-19 Diagnosis Tool to Seek Lung Scan Images from India - The Weather Channel - July 8th, 2020
- Artificial intelligence should be used to augment human creativity - not replace it - Bizcommunity.com - July 8th, 2020
- Forums held ahead of World Artificial Intelligence Conference - Chinadaily USA - July 8th, 2020
- VeChain Is Attending the World Artificial Intelligence Conference 2020 Hosted - AiThority - July 8th, 2020
- ContractPodAi and Bowmans Partner to Bring Artificial Intelligence-Powered Contract Management to the African Market - Business Wire - July 8th, 2020
- How Machine Learning Will Impact the Future of Software Development and Testing - ReadWrite - July 8th, 2020
- Artificial Intelligence (AI) Definition - Investopedia - May 31st, 2020
- The Temptations Of Artificial Intelligence Technology And The Price Of Admission - Forbes - May 31st, 2020
- Artificial intelligence offers a chance to optimize COVID-19 treatment in international partnership - Vanderbilt University News - May 31st, 2020
- Reality Check: The Benefits of Artificial Intelligence - AiThority - May 31st, 2020
- Thanks To Renewables And Machine Learning, Google Now Forecasts The Wind - Forbes - May 31st, 2020
- Artificial intelligence is hopelessly biased - and that's how it will stay - TechRadar India - May 31st, 2020
- Top Artificial Intelligence Trends that will Change the Decade - Analytics Insight - May 31st, 2020
- Art and artifice - The Indian Express - May 31st, 2020
- The Role of Artificial Intelligence in Ethical Hacking | EC-Council Official Blog - EC-Council Blog - May 31st, 2020
- Microsoft is cutting dozens of MSN news production workers and replacing them with artificial intelligence - Seattle Times - May 31st, 2020
- Artificial intelligence software improves accuracy, doubles speed in evaluating CT scans of advanced cancer - UAB News - May 31st, 2020
- Coronavirus tests the value of artificial intelligence in medicine - FierceHealthcare - May 31st, 2020
- The Use of Artificial Intelligence by Investment Advisers: Considerations Based on an Advisers Fiduciary Duties - JD Supra - May 31st, 2020
- Lecturer in Artificial Intelligence for Digital Infrastructures job with UNIVERSITY OF BRISTOL | 208485 - Times Higher Education (THE) - May 31st, 2020
- Artificial Intelligence (AI) Market to Reach USD 202.57 Billion by 2026; Rising Demand for Cloud-based Applications to Aid Growth: Fortune Business... - May 31st, 2020
- Walmart Employees Are Out to Show Its Anti-Shoplifting AI Doesn't Work - WIRED - May 31st, 2020
- How artificial intelligence is keeping time-critical shipments on track during pandemic - FreightWaves - May 31st, 2020
- Coronavirus Update: Recent FTC Guidance on the Use of Artificial Intelligence and Algorithms in the Age of COVID-19 - Government Contracts Legal Forum - May 31st, 2020
- COVID-19 Impact: A Mix of Challenges and Opportunities | Artificial Intelligence-as-a-Service (AIaaS) Market 2020-2024 | Growing Adoption of Cloud... - May 31st, 2020
- IIT-Ropar and TSW Launch a PG Programme in Artificial Intelligence - THE WEEK - May 31st, 2020
- MS in Artificial Intelligence | Artificial Intelligence - May 19th, 2020
- What is Artificial Intelligence? | Azure Blog and Updates ... - May 19th, 2020
- What Are the Advantages of Artificial Intelligence ... - May 19th, 2020
- AI Tutorial | Artificial Intelligence Tutorial - Javatpoint - May 19th, 2020
- It's Called Artificial Intelligencebut What Is Intelligence? - WIRED - May 19th, 2020
- Powering the Artificial Intelligence Revolution - HPCwire - May 19th, 2020
- Artificial intelligence is struggling to cope with how the world has changed - ZDNet - May 19th, 2020
- An AI future set to take over post-Covid world - The Indian Express - May 19th, 2020
- A New Way To Think About Artificial Intelligence With This ETF - MarketWatch - May 19th, 2020
- Artificial intelligence-based imaging reconstruction may lead to incorrect diagnoses, experts caution - Radiology Business - May 19th, 2020
- Artificial Intelligence in the Covid Frontline - Morningstar - May 19th, 2020
- Patent Analytics Market to Reach USD 1,668.4 Million by 2027; Integration of Machine Learning and Artificial Intelligence to Spur Business... - May 19th, 2020