It appears that many of the deep tech" algorithms the world is excited about will run into physical barriers before they reach their true promise. Take Bitcoin. A cryptocurrency based on blockchain technology, it has a sophisticated algorithm that grows in complexity, as very few new Bitcoin are mintedthrough a digital process called mining". For a simple description of Bitcoin and blockchain, you could refer to an earlier Mint column of mine.
Bitcoins assurance of validity is achieved by its proving" algorithm, which is designed to continually increase in mathematical complexityand hence the computing power needed to process itevery time a Bitcoin is mined. Individual miners are continually doing work to assess the validity of each Bitcoin transaction and confirm whether it adheres to the cryptocurrencys rules. They earn small amounts of new Bitcoin for their efforts. The complexity of getting several miners to agree on the same history of transactions (and thereby validate them) is managed by the same miners who try outpacing one another to create a valid block".
The machines that perform this work consume huge amounts of energy. According to Digiconomist.net, each transaction uses almost 544KWh of electrical energyenough to provide for the average US household for almost three weeks. The total energy consumption of the Bitcoin network alone is about 64 TWh, enough to provide for all the energy needs of Switzerland. The website also tracks the carbon footprint and electronic waste left behind by Bitcoin, which are both startlingly high. This exploitation of resources is unsustainable in the long run, and directly impacts global warming. At a more mundane level, the costs of mining Bitcoin can outstrip the rewards.
But cryptocurrencies are not the worlds only hogs of computing power. Many Artificial Intelligence (AI) deep learning neural" algorithms also place crushing demands on the planets digital processing capacity.
A neural network" attempts to mimic the functioning of the human brain and nervous system in AI learning models. There are many of these. The two most widely used are recursive neural networks, which develop a memory pattern, and convolutional neural networks, which develop spatial reasoning. The first is used for tasks such as language translation, and the second for image processing. These use enormous computing power, as do other AI neural network models that help with deep learning".
Frenetic research has been going into new chip architectures for these to handle the ever-increasing complexity of AI models more efficiently. Todays computers are binary", meaning they depend on the two simple states of a transistor bitwhich could be either on or off, and thus either a 0 or 1 in binary notation. Newer chips try to achieve efficiency through other architectures. This will ostensibly help binary computers execute algorithms more efficiently. These chips are designed as graphic-processing units, since they are more capable of dealing with AIs demands than central processing units, which are the mainstay of most devices.
In a parallel attempt to get beyond binary computing, firms such as DWave, Google and IBM are working on a different class of machines called quantum computers, which make use of the so-called qubit" , with each qubit able to hold 0 and 1 values simultaneously. This enhances computing power. The problem with these, though, is that they are far from seeing widespread adoption. First off, they are not yet sophisticated enough to manage todays AI models efficiently, and second, they need to be maintained at temperatures that are close to absolute zero (-273 celsius). This refrigeration, in turn, uses up enormous amounts of electrical energy.
Clearly, advances in both binary chip design and quantum computing are not keeping pace with the increasing sophistication of deep tech algorithms.
In a research paper, Neil Thompson of the Massachusetts Institute of Technology and others analyse five widely-used AI application areas and show that advances in each of these fields of use come at a huge cost, since they are reliant on massive increases in computing capability. The authors argue that extrapolating this reliance forward reveals that current progress is rapidly becoming economically, technically and environmentally unsustainable.
Sustained progress in these applications will require changes to their deep learning algorithms and/or moving away from deep learning to other machine learning models that allow greater efficiency in their use of computing capability. The authors further argue that we are currently in an era where improvements in hardware performance are slowing, which means that this shift away from deep neural networks is now all the more urgent.
Thompson et al argue that the economic, environmental and purely technical costs of providing all this additional computing power will soon constrain deep learning and a range of applications, making the achievement of key milestones impossible, if current trajectories hold.
We are designing increasingly sophisticated algorithms, but we dont yet have computers that are sophisticated enough to match their demands efficiently. Without significant changes in how AI models are built, the usefulness of AI and other forms of deep tech is likely to hit a wall soon.
Siddharth Pai is founder of Siana Capital, a venture fund management company focused on deep science and tech in India
Subscribe to newsletters
* Enter a valid email
* Thank you for subscribing to our newsletter.
Originally posted here:
Deep tech may stumble on insufficient computing power - Livemint
- The Quantum Computer Revolution Is Closer Than You May Think - National Review - May 3rd, 2017 [May 3rd, 2017]
- Time Crystals Could be the Key to the First Quantum Computer - TrendinTech - May 3rd, 2017 [May 3rd, 2017]
- quantum computing - WIRED UK - May 3rd, 2017 [May 3rd, 2017]
- Chinese scientists build world's first quantum computing machine - India Today - May 3rd, 2017 [May 3rd, 2017]
- Here's How We Can Achieve Mass-Produced Quantum Computers - ScienceAlert - June 6th, 2017 [June 6th, 2017]
- D-Wave partners with U of T to move quantum computing along - Financial Post - June 6th, 2017 [June 6th, 2017]
- Team develops first blockchain that can't be hacked by quantum computer - Siliconrepublic.com - June 6th, 2017 [June 6th, 2017]
- Telstra just wants a quantum computer to offer as-a-service - ZDNet - June 6th, 2017 [June 6th, 2017]
- Research collaborative pursues advanced quantum computing - Phys.Org - June 6th, 2017 [June 6th, 2017]
- Quantum Computing Market Forecast 2017-2022 | Market ... - June 6th, 2017 [June 6th, 2017]
- Quantum Computing Is Real, and D-Wave Just Open ... - WIRED - June 7th, 2017 [June 7th, 2017]
- FinDEVr London: Preparing for the Dark Side of Quantum Computing - GlobeNewswire (press release) - June 9th, 2017 [June 9th, 2017]
- Purdue, Microsoft to Collaborate on Quantum Computer - Photonics.com - June 9th, 2017 [June 9th, 2017]
- Scientists May Have Found a Way to Combat Quantum Computer Blockchain Hacking - Futurism - June 9th, 2017 [June 9th, 2017]
- Microsoft and Purdue work on scalable topological quantum computer - Next Big Future - June 12th, 2017 [June 12th, 2017]
- HYPRES Expands Efforts in Quantum Computing with Launch of European Subsidiary SeeQC - Business Wire (press release) - June 12th, 2017 [June 12th, 2017]
- From the Abacus to Supercomputers to Quantum Computers - Duke Today - June 13th, 2017 [June 13th, 2017]
- Accenture, Biogen, 1QBit Launch Quantum Computing App to ... - HIT Consultant - June 14th, 2017 [June 14th, 2017]
- The US and China "Quantum Computing Arms Race" Will Change Long-Held Dynamics in Commerce, Intelligence ... - PR Newswire (press release) - June 14th, 2017 [June 14th, 2017]
- Quantum Computing Technologies markets will reach $10.7 billion by 2024 - PR Newswire (press release) - June 14th, 2017 [June 14th, 2017]
- A Hybrid of Quantum Computing and Machine Learning Is Spawning New Ventures - IEEE Spectrum - June 14th, 2017 [June 14th, 2017]
- KPN CISO details Quantum computing attack dangers - Mobile World Live - June 16th, 2017 [June 16th, 2017]
- Get ahead in quantum computing AND attract Goldman Sachs - eFinancialCareers - June 16th, 2017 [June 16th, 2017]
- Accenture, 1QBit partner for drug discovery through quantum ... - ZDNet - June 16th, 2017 [June 16th, 2017]
- Toward optical quantum computing - MIT News - June 17th, 2017 [June 17th, 2017]
- Quantum computing, the machines of tomorrow | The Japan Times - The Japan Times - June 17th, 2017 [June 17th, 2017]
- Its time to decide how quantum computing will help your ... - June 18th, 2017 [June 18th, 2017]
- Israel Enters Quantum Computer Race, Placing Encryption at Ever-Greater Risk - Sputnik International - June 20th, 2017 [June 20th, 2017]
- Prototype device enables photon-photon interactions at room ... - Phys.Org - June 20th, 2017 [June 20th, 2017]
- Dow and 1QBit Announce Collaboration Agreement on Quantum Computing - Business Wire (press release) - June 21st, 2017 [June 21st, 2017]
- Imperfect crystals may be perfect storage method for quantum computing - Digital Trends - June 21st, 2017 [June 21st, 2017]
- Dow Chemical, 1QBit Ink Quantum Computing Development Deal - Zacks.com - June 22nd, 2017 [June 22nd, 2017]
- Google on track for quantum computer breakthrough by end of 2017 - New Scientist - June 22nd, 2017 [June 22nd, 2017]
- USC to lead project to build super-speedy quantum computers - USC News - June 24th, 2017 [June 24th, 2017]
- The Quantum Computer Factory That's Taking on Google and IBM ... - WIRED - June 24th, 2017 [June 24th, 2017]
- The weird science of quantum computing, communications and encryption - C4ISR & Networks - June 27th, 2017 [June 27th, 2017]
- Multi-coloured photons in 100 dimensions may make quantum ... - Cosmos - June 30th, 2017 [June 30th, 2017]
- Global Quantum Computing Market Growth at a CAGR of 35.12 ... - PR Newswire (press release) - June 30th, 2017 [June 30th, 2017]
- Qudits: The Real Future of Quantum Computing? - IEEE Spectrum - IEEE Spectrum - June 30th, 2017 [June 30th, 2017]
- New method could enable more stable and scalable quantum ... - Phys.Org - June 30th, 2017 [June 30th, 2017]
- Quantum computers are about to get real | Science News - Science News Magazine - June 30th, 2017 [June 30th, 2017]
- Quantum Computing - Scientific American - June 30th, 2017 [June 30th, 2017]
- Australia's ambitious plan to win the quantum race - ZDNet - July 3rd, 2017 [July 3rd, 2017]
- How quantum mechanics can change computing - The Conversation - The Conversation US - August 24th, 2017 [August 24th, 2017]
- UNSW joins with government and business to keep quantum computing technology in Australia - The Australian Financial Review - August 24th, 2017 [August 24th, 2017]
- UNSW launches Australia's first hardware quantum computing company with investments from federal and NSW ... - OpenGov Asia - August 24th, 2017 [August 24th, 2017]
- Finns chill out quantum computers with qubit refrigerator to cut out errors - ZDNet - August 24th, 2017 [August 24th, 2017]
- Hype and cash are muddying public understanding of quantum ... - The Conversation AU - August 24th, 2017 [August 24th, 2017]
- IEEE Approves Standards Project for Quantum Computing ... - insideHPC - August 24th, 2017 [August 24th, 2017]
- Silicon Quantum Computing launched to commercialise UNSW ... - ZDNet - August 24th, 2017 [August 24th, 2017]
- The Era of Quantum Computing Is Here. Outlook: Cloudy ... - January 30th, 2018 [January 30th, 2018]
- The Era of Quantum Computing Is Here. Outlook: Cloudy | WIRED - February 6th, 2018 [February 6th, 2018]
- Quantum computing in the NISQ era and beyond - February 6th, 2018 [February 6th, 2018]
- What is quantum computing? - Definition from WhatIs.com - February 6th, 2018 [February 6th, 2018]
- Quantum computers - WIRED UK - February 19th, 2018 [February 19th, 2018]
- Is Quantum Computing an Existential Threat to Blockchain ... - February 21st, 2018 [February 21st, 2018]
- What is Quantum Computing? Webopedia Definition - March 25th, 2018 [March 25th, 2018]
- Quantum Computing Explained - WIRED UK - April 15th, 2018 [April 15th, 2018]
- Quantum computing: A simple introduction - Explain that Stuff - June 2nd, 2018 [June 2nd, 2018]
- What are quantum computers and how do they work? WIRED ... - June 22nd, 2018 [June 22nd, 2018]
- How Quantum Computers Work - July 22nd, 2018 [July 22nd, 2018]
- The reality of quantum computing could be just three years ... - September 12th, 2018 [September 12th, 2018]
- The 3 Types of Quantum Computers and Their Applications - November 24th, 2018 [November 24th, 2018]
- Quantum Computing - VLAB - January 27th, 2019 [January 27th, 2019]
- Quantum Computing | Centre for Quantum Computation and ... - January 27th, 2019 [January 27th, 2019]
- Microsofts quantum computing network takes a giant leap ... - March 7th, 2019 [March 7th, 2019]
- IBM hits quantum computing milestone, may see 'Quantum ... - March 7th, 2019 [March 7th, 2019]
- Quantum technology - Wikipedia - March 13th, 2019 [March 13th, 2019]
- Quantum Computing | D-Wave Systems - April 18th, 2019 [April 18th, 2019]
- Microsoft will open-source parts of Q#, the programming ... - May 7th, 2019 [May 7th, 2019]
- What Is Quantum Computing? The Complete WIRED Guide | WIRED - May 8th, 2019 [May 8th, 2019]
- The five pillars of Edge Computing -- and what is Edge computing anyway? - Information Age - October 1st, 2019 [October 1st, 2019]
- Moore's Law Is Dying. This Brain-Inspired Analogue Chip Is a Glimpse of What's Next - Singularity Hub - October 1st, 2019 [October 1st, 2019]
- Experts Gather at Fermilab for International Workshop on Cryogenic Electronics for Quantum Systems - Quantaneo, the Quantum Computing Source - October 1st, 2019 [October 1st, 2019]
- Princeton announces initiative to propel innovations in quantum science and technology - Princeton University - October 1st, 2019 [October 1st, 2019]
- Detecting Environmental 'Noise' That Can Damage The Quantum State of Qubits - In Compliance - October 1st, 2019 [October 1st, 2019]
- Quantum Computing beginning talks with clients on its quantum asset allocation application - Proactive Investors USA & Canada - October 1st, 2019 [October 1st, 2019]
- What is quantum computing? The next era of computational evolution, explained - Digital Trends - October 1st, 2019 [October 1st, 2019]
- IT sees the Emergence of Quantum Computing as a Looming Threat to Keeping Valuable Information Confidential - Quantaneo, the Quantum Computing Source - October 23rd, 2019 [October 23rd, 2019]
- More wrong answers get quantum computers to find the right one - Futurity: Research News - October 23rd, 2019 [October 23rd, 2019]