There is a growing perception that AI will be a transformative technology for international security. The current U.S. National Security Strategy names artificial intelligence as one of a small number of technologies that will be critical to the countrys future. Senior defense officials have commented that the United States is at an inflection point in the power of artificial intelligence and even that AI might be the first technology to change the fundamental nature of war.
However, there is still little clarity regarding just how artificial intelligence will transform the security landscape. One of the most important open questions is whether applications of AI, such as drone swarms and software vulnerability discovery tools, will tend to be more useful for conducting offensive or defensive military operations. If AI favors the offense, then a significant body of international relations theory suggests that this could have destabilizing effects. States could find themselves increasingly able to use force and increasingly frightened of having force used against them, making arms-racing and war more likely. If AI favors the defense, on the other hand, then it may act as a stabilizing force.
Anticipating the impact of AI on the so-called offense-defense balance across different military domains could be extremely valuable. It could help us to foresee new threats to stability before they arise and act to mitigate them, for instance by pursuing specific arms agreements or prioritizing the development of applications with potential stabilizing effects.
Unfortunately, the historical record suggests that attempts to forecast changes in the offense-defense balance are often unsuccessful. It can even be difficult to detect the changes that newly adopted technologies have already caused. In the lead-up to the First World War, for instance, most analysts failed to recognize that the introduction of machine guns and barbed wire had tilted the offense-defense balance far toward defense. The years of intractable trench warfare that followed came as a surprise to the states involved.
While there are clearly limits on the ability to anticipate shifts in the offense-defense balance, some forms of technological change have more predictable effects than others. In particular, as we argue in a recent paper, changes that essentially scale up existing capabilities are likely to be much easier to analyze than changes that introduce fundamentally new capabilities. Substantial insight into the impacts of AI can be achieved by focusing on this kind of quantitative change.
Two Kinds of Technological Change
In a classic analysis of arms races, Samuel Huntington draws a distinction between qualitative and quantitative changes in military capabilities. A qualitative change involves the introduction of what might be considered a new form of force. A quantitative change involves the expansion of an existing form of force.
Although this is a somewhat abstract distinction, it is easy to illustrate with concrete examples. The introduction of dreadnoughts in naval surface warfare in the early twentieth century is most naturally understood as a qualitative change in naval technology. In contrast, the subsequent naval arms race which saw England and Germany competing to manufacture ever larger numbers of dreadnoughts represented a quantitative change.
Attempts to understand changes in the offense-defense balance tend to focus almost exclusively on the effects of qualitative changes. Unfortunately, the effects of such qualitative changes are likely to be especially difficult to anticipate. One particular reason why foresight about such changes is difficult is that the introduction of a new form of force from the tank to the torpedo to the phishing attack will often warrant the introduction of substantially new tactics. Since these tactics emerge at least in part through a process of trial and error, as both attackers and defenders learn from the experience of conflict, there is a limit to how much can ultimately be foreseen.
Although quantitative technological changes are given less attention, they can also in principle have very large effects on the offense-defense balance. Furthermore, these effects may exhibit certain regularities that make them easier to anticipate than the effects of qualitative change. Focusing on quantitative change may then be a promising way forward to gain insight into the potential impact of artificial intelligence.
How Numbers Matter
To understand how quantitative changes can matter, and how they can be predictable, it is useful to consider the case of a ground invasion. If the sizes of two armies double in the lead-up to an invasion, for example, then it is not safe to assume that the effect will simply cancel out and leave the balance of forces the same as it was prior to the doubling. Rather, research on combat dynamics suggests that increasing the total number of soldiers will tend to benefit the attacker when force levels are sufficiently low and benefit the defender when force levels are sufficiently high. The reason is that the initial growth in numbers primarily improves the attackers ability to send soldiers through poorly protected sections of the defenders border. Eventually, however, the border becomes increasingly saturated with ground forces, eliminating the attackers ability to exploit poorly defended sections.
Figures 1: A simple model illustrating the importance of force levels. The ability of the attacker (in red) to send forces through poorly defended sections of the border rises and then falls as total force levels increase.
This phenomenon is also likely to arise in many other domains where there are multiple vulnerable points that a defender hopes to protect. For example, in the cyber domain, increasing the number of software vulnerabilities that both an attacker and defender can each discover will benefit the attacker at first. The primary effect will initially be to increase the attackers ability to discover vulnerabilities that the defender has failed to discover and patch. In the long run, however, the defender will eventually discover every vulnerability that can be discovered and leave behind nothing for the attacker to exploit.
In general, growth in numbers will often benefit the attacker when numbers are sufficiently low and benefit the defender when they are sufficiently high. We refer to this regularity as offensive-then-defensive scaling and suggest that it can be helpful for predicting shifts in the offense-defense balance in a wide range of domains.
Artificial Intelligence and Quantitative Change
Applications of artificial intelligence will undoubtedly be responsible for an enormous range of qualitative changes to the character of war. It is easy to imagine states such as the United States and China competing to deploy ever more novel systems in a cat-and-mouse game that has little to do with quantity. An emphasis on qualitative advantage over quantitative advantage is a fairly explicit feature of the American military strategy and has been since at least the so-called Second Offset strategy that emerged in the middle of the Cold War.
However, some emerging applications of artificial intelligence do seem to lend themselves most naturally to competition on the basis of rapidly increasing quantity. Armed drone swarms are one example. Paul Scharre has argued that the military utility of these swarms may lie in the fact that they offer an opportunity to substitute quantity for quality. A large swarm of individually expendable drones may be able to overwhelm the defenses of individual weapon platforms, such as aircraft carriers, by attacking from more directions or in more waves than the platforms defenses are capable of managing. If this method of attack is in fact viable, one could see a race to build larger and larger swarms that ultimately results in swarms containing billions of drones. The phenomenon of offensive-then-defensive scaling suggests that growing swarm sizes could initially benefit attackers who can focus their attention increasingly intensely on less well-defended targets and parts of targets before potentially allowing defensive swarms to win out if sufficient growth in numbers occurs.
Automated vulnerability discovery tools also stand out as another relevant example, which have the potential to vastly increase the number of software vulnerabilities that both attackers and defenders can discover. The DARPA Cyber Grand Challenge recently showcased machine systems autonomously discovering, patching, and exploiting software vulnerabilities. Recent work on novel techniques such as deep reinforcement fuzzing also suggests significant promise. The computer security expert Bruce Schneier has suggested that continued progress will ultimately make it feasible to discover and patch every single vulnerability in a given piece of software, shifting the cyber offense-defense balance significantly toward defense. Before this point, however, there is reason for concern that these new tools could initially benefit attackers most of all.
Forecasting the Impact of Technology
The impact of AI on the offense-defense balance remains highly uncertain. The greatest impact might come from an as-yet-unforeseen qualitative change. Our contribution here is to point out one particularly precise way in which AI could impact the offense-defense balance, through quantitative increases of capabilities in domains that exhibit offensive-then-defensive scaling. Even if this idea is mistaken, it is our hope that by understanding it, researchers are more likely to see other impacts. In foreseeing and understanding these potential impacts, policymakers could be better prepared to mitigate the most dangerous consequences, through prioritizing the development of applications that favor defense, investigating countermeasures, or constructing stabilizing norms and institutions.
Work to understand and forecast the impacts of technology is hard and should not be expected to produce confident answers. However, the importance of the challenge means that researchers should still try while doing so in a scientific, humble way.
This publication was made possible (in part) by a grant to the Center for a New American Security from Carnegie Corporation of New York. The statements made and views expressed are solely the responsibility of the author(s).
Ben Garfinkel is a DPhil scholar in International Relations, University of Oxford, and research fellow at the Centre for the Governance of AI, Future of Humanity Institute.
Allan Dafoe is associate professor in the International Politics of AI, University of Oxford, and director of the Centre for the Governance of AI, Future of Humanity Institute. For more information, see http://www.governance.ai and http://www.allandafoe.com.
Image: U.S. Air Force (Photo by Tech. Sgt. R.J. Biermann)
See the original post here:
- artificial intelligence | Definition, Examples, and ... - March 28th, 2020
- What is Artificial Intelligence? How Does AI Work? | Built In - March 28th, 2020
- Benefits & Risks of Artificial Intelligence - Future of ... - March 28th, 2020
- Return On Artificial Intelligence: The Challenge And The Opportunity - Forbes - March 28th, 2020
- VA Looking to Expand Usage of Artificial Intelligence Data - GovernmentCIO Media - March 28th, 2020
- Global Artificial Intelligence in Healthcare Market - Premium Insight, Competitive News Feed Analysis, Company Usability Profiles, Market Sizing &... - March 28th, 2020
- The Global Artificial Intelligence in Aviation Market is expected to grow from USD 214.36 Million in 2018 to USD 1,824.46 Million by the end of 2025... - March 28th, 2020
- Is artificial intelligence the answer to disease prevention? - The Burn-In - March 28th, 2020
- Why transparency is key to promoting trust in artificial intelligence - IT PRO - March 28th, 2020
- Coronavirus: Spain to use artificial intelligence to automate testing - ComputerWeekly.com - March 28th, 2020
- Bridging the gaps: joining human and artificial intelligence | Technology - Business Chief Canada - March 28th, 2020
- DIAGNOS Will Utilize its Artificial Intelligence Medical Platform FLAIRE in Response to the US White House - Call to Action to Analyse and Transform... - March 26th, 2020
- LiveMD Global Telehealth Platform launches artificial intelligence tracking and triaging tools to help combat COVID-19 (CoronaVirus) Pandemic -... - March 26th, 2020
- New Research from Newark Reveals Strong Adoption of Artificial Intelligence within the Internet of Things Ecosystem - Embedded Computing Design - March 26th, 2020
- AI vs COVID-19: Here are the AI tools and services fighting coronavirus - AI News - March 26th, 2020
- Stanford virtual conference to focus on COVID19 and artificial intelligence | Stanford News - Stanford University News - March 26th, 2020
- Artificial Intelligence in the energy sector: opportunities and challenges - WhaTech - March 26th, 2020
- 31 Companies, Products and People making Artificial Intelligence a Reality in 2020 - PR Web - March 26th, 2020
- KT zu Guttenberg, Artificial Intelligence and You - theTrumpet.com - March 26th, 2020
- BrainChip and Socionext Provide a New Low-Power Artificial Intelligence Platform for AI Edge Applications - Design and Reuse - March 26th, 2020
- Artificial Intelligence Chipsets Market report reviews overview with demographic data and industry growth trends by 2025 - WhaTech Technology and... - March 26th, 2020
- Richmond-based Blue Heron Capital invests in company that uses artificial intelligence to improve lung disease monitoring - Richmond.com - March 26th, 2020
- Artificial Intelligence is Becoming the Future of Investment Platforms - EnterpriseTalk - March 19th, 2020
- Is Your Company Using Artificial Intelligence To Transform An Industry? Nominations For The Forbes 2020 AI 50 List Are Now Open - Forbes - March 19th, 2020
- On the Role of Artificial Intelligence in Genomics to Enhance Precisio | PGPM - Dove Medical Press - March 19th, 2020
- Artificial intelligence myths: Reality check - Livemint - March 19th, 2020
- Battery Researchers Look to Artificial Intelligence to Slash Recharging Times - Greentech Media News - March 19th, 2020
- The Army Will Soon Be Able to Command Robot Tanks With Artificial Intelligence - The National Interest - March 19th, 2020
- Canon Medical's 3T MR System Receives FDA Clearance for Artificial Intelligence-Based Image Reconstruction Technology - BioSpace - March 19th, 2020
- Coronavirus: How Artificial Intelligence, Data Science And Technology Is Used To Fight The Pandemic - Forbes - March 19th, 2020
- Artificial intelligence: The new power dynamic of today - Daily Sabah - March 19th, 2020
- Rethinking Financial Services with Artificial Intelligence Tools - The Financial Brand - March 19th, 2020
- Artificial intelligence recruited to find clues about Covid-19 - The Star Online - March 19th, 2020
- IIT-M to reskill women in artificial intelligence - Campus Varta - March 19th, 2020
- San Diego-Based Company takes Digital Marketing to the next Level by Launching the First Artificial Intelligence Marketing Agency in the United States... - March 19th, 2020
- An Unexpected Ally in the War With Bacteria - The Atlantic - March 19th, 2020
- Compliance For A Digital World: BSA/AML The New ABC's: Artificial Intelligence, Blockchain And How Each Complements The Other - JD Supra - March 19th, 2020
- The next step in digital transformation: is Artificial Intelligence production-ready for green sand foundries? - Foundry-Planet.com - March 19th, 2020
- Insights into the North America Artificial Intelligence in Fashion Market to 2027 - Drivers, Restraints, Opportunities and Trends -... - March 19th, 2020
- Artificial Intelligence by CWI and Amsterdam UMC proposes the best radiation treatment plans in clinical practice for the first time - Centrum... - March 19th, 2020
- H2O.ai Named to the 2020 CB Insights AI 100 List of Most Innovative Artificial Intelligence Startups - Yahoo Finance - March 4th, 2020
- 'There's No Story That Stays Stable for Too Long.' How Artists Are Using Artificial Intelligence to Confront Modern Anxieties - TIME - March 4th, 2020
- Minister declares creation of artificial intelligence centres in Poland - The First News - March 4th, 2020
- Dont forget to consider GDPR when using artificial intelligence in the workplace - ComputerWeekly.com - March 4th, 2020
- Iktos and SRI International Announce Collaboration to Combine Artificial Intelligence and Novel Automated Discovery Platform for Accelerated... - March 4th, 2020
- Why we need to adapt existing EU laws to Artificial Intelligence - European Public Health Alliance - March 4th, 2020
- How a Portland nonprofit is using artificial intelligence to help save whales, giraffes, zebras - Seattle Times - March 4th, 2020
- Artificial Intelligence Infused with Big Data Creating a Tech-driven World - EnterpriseTalk - March 4th, 2020
- Gaming with Artificial Intelligence Technology in 2020 - ReadWrite - March 4th, 2020
- Global Artificial Intelligence-as-a-Service (AIaaS) Market 2020-2024 | Growing Adoption of Cloud Based Solutions to Boost Market Growth | Technavio -... - March 4th, 2020
- WorldMarkets Continues With the Success of Its Trading Artificial Intelligence - Live Bitcoin News - March 4th, 2020
- Why Artificial Intelligence Will Never Beat the Stock Market - Traders Magazine - March 4th, 2020
- Why Neuro-Symbolic Artificial Intelligence Is The AI Of The Future - Digital Trends - January 5th, 2020
- Welcome to the roaring 2020s, the artificial intelligence decade - GreenBiz - January 5th, 2020
- Top five projections in Artificial Intelligence for 2020 - Economic Times - January 5th, 2020
- A reality check on artificial intelligence: Can it match the hype? - PhillyVoice.com - January 5th, 2020
- Can medical artificial intelligence live up to the hype? - Los Angeles Times - January 5th, 2020
- Illinois regulates artificial intelligence like HireVues used to analyze online job Interviews - Vox.com - January 5th, 2020
- How This Cofounder Created An Artificial Intelligence Styling Company To Help Consumers Shop - Forbes - January 5th, 2020
- The U.S. Patent and Trademark Office Takes on Artificial Intelligence - JD Supra - January 5th, 2020
- Baidu looks to work with Indian institutions on AI - BusinessLine - January 5th, 2020
- Top Movies Of 2019 That Depicted Artificial Intelligence (AI) - Analytics India Magazine - January 5th, 2020
- Shocking ways AI technology will revolutionise every day industries in YOUR lifetime - Express.co.uk - January 5th, 2020
- Artificial intelligence takes scam to a whole new level - The Jackson Sun - January 5th, 2020
- Global Industrial Artificial Intelligence Market 2019 Research by Business Analysis, Growth Strategy and Industry Development to 2024 - Food &... - January 5th, 2020
- IIT Hyderabad to collaborate with Telangana government on artificial intelligence - India Today - January 5th, 2020
- THE AI IN TRANSPORTATION REPORT: How automakers can use artificial intelligence to cut costs, open new revenue - Business Insider India - January 5th, 2020
- Revisiting the rise of A.I.: How far has artificial intelligence come since 2010? - Digital Trends - December 30th, 2019
- Artificial intelligence is helping us talk to animals (yes, really) - Wired.co.uk - December 30th, 2019
- Artificial Intelligence Identifies Previously Unknown Features Associated with Cancer Recurrence - Imaging Technology News - December 30th, 2019
- AI IN BANKING: Artificial intelligence could be a near $450 billion opportunity for banks - here are the strat - Business Insider India - December 30th, 2019
- Artificial Intelligence Is Rushing Into Patient Care - And Could Raise Risks - Scientific American - December 30th, 2019
- Quantum leap: Why we first need to focus on the ethical challenges of artificial intelligence - Economic Times - December 30th, 2019
- In 2020, lets stop AI ethics-washing and actually do something - MIT Technology Review - December 30th, 2019
- The Power Of Purpose: How We Counter Hate Used Artificial Intelligence To Battle Hate Speech Online - Forbes - December 30th, 2019
- The skills needed to land the hottest tech job of 2020 - Business Insider Nordic - December 30th, 2019
- In the 2020s, human-level A.I. will arrive, and finally ace the Turing test - Inverse - December 30th, 2019
- Samsung to announce its Neon artificial intelligence project at CES 2020 - Firstpost - December 30th, 2019
- How Artificial Intelligence Is Totally Changing Everything - HowStuffWorks - December 26th, 2019
- Artificial intelligence jobs on the rise, along with everything else AI - ZDNet - December 26th, 2019