The ability to reason abstractly about events as they unfold is a defining feature of human intelligence. We know instinctively that crying and writing are means of communicating, and that a panda falling from a tree and a plane landing are variations on descending.
Organizing the world into abstract categories does not come easily to computers, but in recent years researchers have inched closer by training machine learning models on words and images infused with structural information about the world, and how objects, animals, and actions relate. In a new study at the European Conference on Computer Vision this month, researchers unveiled a hybrid language-vision model that can compare and contrast a set of dynamic events captured on video to tease out the high-level concepts connecting them.
Their model did as well as or better than humans at two types of visual reasoning tasks picking the video that conceptually best completes the set, and picking the video that doesnt fit. Shown videos of a dog barking and a man howling beside his dog, for example, the model completed the set by picking the crying baby from a set of five videos. Researchers replicated their results on two datasets for training AI systems in action recognition: MITs Multi-Moments in Time and DeepMinds Kinetics.
We show that you can build abstraction into an AI system to perform ordinary visual reasoning tasks close to a human level, says the studys senior author Aude Oliva, a senior research scientist at MIT, co-director of the MIT Quest for Intelligence, and MIT director of the MIT-IBM Watson AI Lab. A model that can recognize abstract events will give more accurate, logical predictions and be more useful for decision-making.
As deep neural networks become expert at recognizing objects and actions in photos and video, researchers have set their sights on the next milestone: abstraction, and training models to reason about what they see. In one approach, researchers have merged the pattern-matching power of deep nets with the logic of symbolic programs to teach a model to interpret complex object relationships in a scene. Here, in another approach, researchers capitalize on the relationships embedded in the meanings of words to give their model visual reasoning power.
Language representations allow us to integrate contextual information learned from text databases into our visual models, says study co-author Mathew Monfort, a research scientist at MITs Computer Science and Artificial Intelligence Laboratory (CSAIL). Words like running, lifting, and boxing share some common characteristics that make them more closely related to the concept exercising, for example, than driving.
Using WordNet, a database of word meanings, the researchers mapped the relation of each action-class label in Moments and Kinetics to the other labels in both datasets. Words like sculpting, carving, and cutting, for example, were connected to higher-level concepts like crafting, making art, and cooking. Now when the model recognizes an activity like sculpting, it can pick out conceptually similar activities in the dataset.
This relational graph of abstract classes is used to train the model to perform two basic tasks. Given a set of videos, the model creates a numerical representation for each video that aligns with the word representations of the actions shown in the video. An abstraction module then combines the representations generated for each video in the set to create a new set representation that is used to identify the abstraction shared by all the videos in the set.
To see how the model would do compared to humans, the researchers asked human subjects to perform the same set of visual reasoning tasks online. To their surprise, the model performed as well as humans in many scenarios, sometimes with unexpected results. In a variation on the set completion task, after watching a video of someone wrapping a gift and covering an item in tape, the model suggested a video of someone at the beach burying someone else in the sand.
Its effectively covering, but very different from the visual features of the other clips, says Camilo Fosco, a PhD student at MIT who is co-first author of the study with PhD student Alex Andonian. Conceptually it fits, but I had to think about it.
Limitations of the model include a tendency to overemphasize some features. In one case, it suggested completing a set of sports videos with a video of a baby and a ball, apparently associating balls with exercise and competition.
A deep learning model that can be trained to think more abstractly may be capable of learning with fewer data, say researchers. Abstraction also paves the way toward higher-level, more human-like reasoning.
One hallmark of human cognition is our ability to describe something in relation to something else to compare and to contrast, says Oliva. Its a rich and efficient way to learn that could eventually lead to machine learning models that can understand analogies and are that much closer to communicating intelligently with us.
Other authors of the study are Allen Lee from MIT, Rogerio Feris from IBM, and Carl Vondrick from Columbia University.
Follow this link:
- The Next Generation Of Artificial Intelligence - Forbes - October 16th, 2020
- St. Louis Is Grappling With Artificial Intelligence's Promise And Potential Peril - St. Louis Public Radio - October 16th, 2020
- Looper column: Artificial intelligence, humanity and the future - SouthCoastToday.com - October 16th, 2020
- For artificial intelligence to flourish, governments need to think ahead about its responsible use - Firstpost - October 16th, 2020
- MediFind Selected as Finalist for Best in Artificial Intelligence in the Shorty Social Good Awards - The Wellsboro Gazette - October 16th, 2020
- The relentless threat of artificial intelligence taking our jobs away - Mint - October 16th, 2020
- Will artificial intelligence technology change the dairy industry - positivelyosceola.com - October 16th, 2020
- Penn Medicine researchers use artificial intelligence to identify early signs of Alzheimer's Disease - Express Computer - October 16th, 2020
- Futurism Reinforces Its Next-Gen Business Commerce Platform With Advanced Machine Learning and Artificial Intelligence Capabilities - Yahoo Finance - October 16th, 2020
- SparkCognition Advances the Science of Artificial Intelligence with 85 Patents - PRNewswire - October 16th, 2020
- Dont Be Afraid, BMW Promises To Keep Artificial Intelligence (AI) On A Tight Leash With These 7 Principles - CarScoops - October 16th, 2020
- Artificial Intelligence in Government: Global Markets 2020-2025 - ResearchAndMarkets.com - Business Wire - August 31st, 2020
- Import Screening Pilot Unleashes the Power of Data - FDA.gov - August 31st, 2020
- Supercharge vegetation management and outage prediction with artificial intelligence - Utility Dive - August 31st, 2020
- Automation, artificial intelligence to be central in the post-Covid world - Economic Times - August 31st, 2020
- Artificial Intelligence Is the Next Top Gun - Bloomberg - August 31st, 2020
- Defense Innovation Unit Teaching Artificial Intelligence to Detect Cancer - Department of Defense - August 31st, 2020
- How Artificial Intelligence is changing the way we search and find online - ITProPortal - August 31st, 2020
- TikTok Assets Cant Be Sold Without Chinas Approval - Bloomberg - August 31st, 2020
- Artificial Intelligence in Oil and Gas Market Global Size, Growth and Demand 2020 to 2030 - The News Brok - August 31st, 2020
- Rage Against the Algorithm: the Risks of Overestimating Military Artificial Intelligence - Chatham House - August 31st, 2020
- U of I to lead two of seven new national artificial intelligence institutes - University of Illinois News - August 31st, 2020
- Holocaust survivors will be able to share their stories after death thanks to a new project - 60 Minutes - CBS News - August 31st, 2020
- Funding boost for artificial intelligence in NHS to speed up diagnosis of deadly diseases - GOV.UK - August 31st, 2020
- Artificial Intelligence Identifies 80,000 Spiral Galaxies Promises More Astronomical Discoveries in the Future - SciTechDaily - August 31st, 2020
- Is Artificial intelligence the Future of IT Help Desk? - Analytics Insight - August 10th, 2020
- Experts Are Divided Over Future Of Artificial Intelligence But Agree On Its Growing Impact - Outlook India - August 10th, 2020
- "Artificial Intelligence Will Make Medicine Better in the Long Run" - Biophotonics.World - August 10th, 2020
- How machine learning and artificial intelligence can drive clinical innovation - PharmaLive - August 10th, 2020
- Top Artificial Intelligence and Robotics Investments in July 2020 - Analytics Insight - August 10th, 2020
- Job interviews: Recruiters are using artificial intelligence to analyse what you say to find the right hire - TechRepublic - August 10th, 2020
- The next frontier of human-robot relationships is building trust - Scroll.in - August 8th, 2020
- Game-Changing Artificial Intelligence Solution by PhotoShelter to Revolutionize Social Media Workflow as Premier Lacrosse League Returns to the Field... - August 8th, 2020
- How Artificial Intelligence is Helping to Fight against Coronavirus in India? - Analytics Insight - August 8th, 2020
- BLOG: How to capitalise on the Artificial Intelligence theme - Your Money - Your Money - August 8th, 2020
- Artificial Intelligence and Its Partners - Modern Diplomacy - August 8th, 2020
- Artificial intelligence isnt destroying jobs, its making them more inclusive - The Globe and Mail - August 8th, 2020
- RadNet and Hologic Announce Collaboration to Advance the Development of Artificial Intelligence Tools in Breast Health - GlobeNewswire - August 7th, 2020
- COVID-19 Impacts: Artificial Intelligence-as-a-Service (AIaaS) Market Will Accelerate at a CAGR of Over 48% Through 2020-2024|Growing Adoption of... - August 7th, 2020
- Artificial Intelligence in Business: The New Normal in Testing Times - Analytics Insight - August 7th, 2020
- VIEW: Digitisation in pathology and the promise of artificial intelligence - CNBCTV18 - August 7th, 2020
- What It Means to Be Human in the Age of Artificial Intelligence - Medium - August 7th, 2020
- Not so Artificial Intelligence When is AI really AI? - EFTM - August 3rd, 2020
- IMD to explore artificial intelligence to improve forecasting, predict extreme weather events - Firstpost - August 3rd, 2020
- Examples of Failure in Artificial Intelligence - ReadWrite - August 3rd, 2020
- IMD plans to use artificial intelligence in weather forecasting - The Financial Express - August 3rd, 2020
- MLOps: What You Need To Know - Forbes - August 3rd, 2020
- Postdoctoral Research Associate in Artificial Intelligence job with DURHAM UNIVERSITY | 215559 - Times Higher Education (THE) - August 3rd, 2020
- How do CEO's Succeed with Artificial Intelligence at their Workplace? - Analytics Insight - August 3rd, 2020
- The future of Artificial Intelligence and what it means to the Enterprise? - Analytics Insight - August 3rd, 2020
- Artificial intelligence helps lead decisions over Intelligent automation and - 401kTV - August 3rd, 2020
- Artificial Intelligence and civil liability. Who pays the damages? - Lexology - August 3rd, 2020
- The AI-boost: Using more artificial intelligence will boost GDP growth - The Financial Express - August 3rd, 2020
- $19.9B Artificial Intelligence in Retail Industry, 2027 - Rising Focus on Blockchain and Adoption of 5G Technology - Yahoo Finance - August 3rd, 2020
- Artificial Intelligence Loses Some Of Its Edginess, But Is Poised To Take Off - Forbes - July 31st, 2020
- How artificial intelligence is transforming the world in the current pandemic situation? - Geospatial World - July 31st, 2020
- The NBA will use artificial intelligence and a tap-to-cheer app feature to help fans stuck at home get in the game - CNN - July 31st, 2020
- Different Scopes Of Artificial Intelligence To Dive In With! - Inventiva - July 31st, 2020
- Gatling Exploration to use artificial intelligence to identify possible gold targets at the Larder project in Ontario - Proactive Investors USA &... - July 31st, 2020
- Elon Musk Thinks that Artificial Intelligence Will Be 'Vastly Smarter' Than Humans in 5 Years - News18 - July 31st, 2020
- Church body recommends restrictions on Artificial Intelligence - The Tablet - July 31st, 2020
- How the Coronavirus Pandemic Is Breaking Artificial Intelligence and How to Fix It - Gizmodo - July 31st, 2020
- Using artificial intelligence to smell the roses - UC Riverside - July 30th, 2020
- Shield AI Recognized As One of the Most Promising Artificial Intelligence Companies - PR Web - July 30th, 2020
- Artificial intelligence needs an update on ethics to be able to help humanity in times of crisis - Economic Times - July 30th, 2020
- Reshaping Artificial Intelligence with the Help of Affordances - Analytics Insight - July 29th, 2020
- WISeKey to Showcase its Cybersecurity Solutions for Artificial Intelligence Used in Drones and Robots at SIDO 2020 - GlobeNewswire - July 28th, 2020
- GPT-3: The Next Revolution in Artificial Intelligence - Analytics Insight - July 28th, 2020
- FLY AI: the role of artificial intelligence in aviation - Airport Technology - July 28th, 2020
- Four university experts use Artificial Intelligence to discover that children don't like going to school on Mondays in Milton Keynes - Milton Keynes... - July 28th, 2020
- UF Announces $70 Million Artificial Intelligence Partnership with NVIDIA - University of Florida - July 28th, 2020
- People are using artificial intelligence to help sort out their divorce. Would you? - The Conversation AU - July 28th, 2020
- Artificial Intelligence Is the Hope 2020 Needs - Bloomberg - July 28th, 2020
- Top Five Data Privacy Issues that Artificial Intelligence and Machine Learning Startups Need to Know - insideBIGDATA - July 28th, 2020
- I Am a Model and I Know That Artificial Intelligence Will Eventually Take My Job - Vogue.com - July 28th, 2020
- Artificial Intelligence in Manufacturing Market Worth $16.7 Billion by 2026 - Exclusive Report by MarketsandMarkets - PRNewswire - July 28th, 2020
- The Global Artificial Intelligence in Accounting Market is expected to grow from USD 884.99 Million in 2019 to USD 4,779.11 Million by the end of 2025... - July 28th, 2020
- Imint is the Swedish firm that gives Chinese smartphones an edge in video production - TechCrunch - July 26th, 2020
- UF students, get used to this topic: artificial intelligence - Tampa Bay Times - July 26th, 2020
- Odisha to use artificial intelligence in organisation audit in big way - The New Indian Express - July 26th, 2020