For all the supercomputing trends revealed on recent TOP500 lists, the most worrisome is the decline in performance growth that has taken place over the over the last several years worrisome not only because performance is the lifeblood of the HPC industry, but also because there is no definitive cause of the slowdown.
TOP500 aggregate performance (blue), top system performance (red), and last system performance (orange). Credit Erich Strohmaier
That said, there are a few smoking guns worth considering. An obvious one is Moores Law, or rather the purported slowing of Moores Law. Performance increases in supercomputer hardware relies on a combination of getting access to more powerful computer chips and putting more of them into a system. The latter explains why aggregate performance on the TOP500 list historically grew somewhat faster than the rate of Moores Law.
But this no longer appears to be the case. Since 2013 or thereabouts, the annual aggregate performance increase on the TOP500 list has fallen not just below its historical rate of growth, but the Moores Law rate as well. As you can see from the chart below, performance growth has had its ups and downs over the years, but the recent dip appears to indicate a new trend.
TOP500 rate of performance increase. Credit Erich Strohmaier
So if Moores Law is slowing, why dont users just order bigger system with more servers? Well they are system core counts are certainly rising but there are a number of disincentives to simply throwing more servers at the problem. A major limitation is power.
And although power data on the list is sketchier than performance data, there is a clear trend toward increased energy usage. For example, over the last 10 years, the supercomputer with the largest power draw increased from around 2.0 KW in 2007 (ASC Purple) to more than 17.8 KW in 2017 (Tianhe-2). In fact, three of the largest systems today use more than 10 KW. The systems in middle of the list appear to be sucking more energy as well, although the increase is not so pronounced as it is for the biggest systems.
Theres nothing inherently wrong with building supercomputers that chew through tens of megawatts of electricity. But given the cost of power, there just wont be very many of them. The nominal goal of building the first exascale supercomputers in the 20 to 30 MW range ensures there will be only a handful of such machines in the world.
The problem with using additional electricity is not just that it costs more, and thus there is less money to spend on buying more hardware, but once you grow beyond the power budget of your datacenter, youre stuck. At that point, you either have to build a bigger facility, wait until the hardware becomes more energy efficiency, or burst some of your workload to the cloud. All of those scenarios lead to the slower performance growth we see on the TOP500.
It also leads to reduced system turnover, which is another recent trend that appears to have clearly established itself. Looking at the chart below, the time an average system spends on list has tripled since 2008, and is about double the historical average. Its almost certain that this means users are hanging on to their existing systems for longer periods of times.
TOP500 of averagelifetime of system on list. Credit Erich Strohmaier
None of this bodes well for supercomputer makers. Cray, the purest HPC company in the world, has been seeing some of the effects of stretching out system procurements. Since 2016 at least, the company has experienced a contraction in the number of systems they are able bid on (although, theyve been able to compensate to some degree with better win rates). Crays recent forays into cloud computing and AI are two ways they are looking to establish revenue streams that are not reliant traditional HPC system sales.
Analysts firms Intersect360 Research and Hyperion (formerly IDC) remain bullish about the HPC market, although compared to a few years ago their growth projections have been shaved back. Hyperion is forecasting a 5.8 percent compound annual growth rate (CAGR) for HPC servers over the next five years, but thats full a point and half lower than the 7.3 percent CAGR they were talking about in 2012. Meanwhile Intersect360 Research is currently projecting a 4.7 percent CAGR for server hardware, while in 2010 they were forecasting a 7.0 percent growth rate (although that included everything, not just servers).
The demand for greater computing power from both researchers and commercial users appears to be intact, which makes the slowdown in performance growth all the more troubling. This same phenomenon appears to be some of what is behind the current trend toward more diverse architectures and heterogeneity. The most popular new processors: GPUs, Xeon Phis, and to a lesser extent, FPGAs, all exhibit better performance per watt characteristics than the multicore CPUs they nominally replace. The interest in the ARM architecture is along these same lines.
Of course, all of these processors will be subject to the erosion of Moores Law. So unless a more fundamental technology or architectural approach emerges to take change the power-performance calculus, slower growth will persist. That wont wipe out HPC usage, any more than the flat growth of enterprise computing wiped out businesses. It will just be the new normal until something else comes along.
See more here:
TOP500 Meanderings: Sluggish Performance Growth May Portend Slowing HPC Market - TOP500 News
- HD Moores Law - Video - July 24th, 2012 [July 24th, 2012]
- Moores Law - Transistor Graph - Video - July 24th, 2012 [July 24th, 2012]
- Moores Lane road construction project begins - October 2nd, 2012 [October 2nd, 2012]
- Orono man totals pickup while reaching for cellphone - October 2nd, 2012 [October 2nd, 2012]
- 2 in Charlotte face fake ID charges - October 4th, 2012 [October 4th, 2012]
- Why there may be more to computing than Moores Law - October 11th, 2012 [October 11th, 2012]
- VR pioneer invents 'illumination-as-a-service' - October 12th, 2012 [October 12th, 2012]
- What is reality...M theory vs Moores law creating real universe vs creating a virtual one - Video - October 30th, 2012 [October 30th, 2012]
- The Rayz/Moores Law @ Put-in-Bay Final Countdown - Video - October 30th, 2012 [October 30th, 2012]
- Moores Law @ Beer Barrel Put-in-Bay Hip Hop Medley - Video - October 30th, 2012 [October 30th, 2012]
- Good explanation of the singularity - Video - October 30th, 2012 [October 30th, 2012]
- What you MUST know about the future - Video - October 30th, 2012 [October 30th, 2012]
- Computer Apple 1 How to tell value KK4WW - Video - October 30th, 2012 [October 30th, 2012]
- Rise of the transapients - Video - October 30th, 2012 [October 30th, 2012]
- Moores Law Music Performing Bruce Springsteen - Video - October 30th, 2012 [October 30th, 2012]
- Moore's Law Ice Cream Man - Video - October 30th, 2012 [October 30th, 2012]
- Moores Law performs Vehicle at PIB - Video - October 30th, 2012 [October 30th, 2012]
- Explaining Moores Law [HD] - MOCustoms.co.uk - Video - October 30th, 2012 [October 30th, 2012]
- Global Challenge Part Fifty - Video - October 30th, 2012 [October 30th, 2012]
- Towards next-generation devices through computer nanomaterial design for semiconductor spintronics - Video - October 30th, 2012 [October 30th, 2012]
- Aiming to establish new spintronics - Video - October 30th, 2012 [October 30th, 2012]
- Correlated electronic materials - Video - October 30th, 2012 [October 30th, 2012]
- Energy Efficient Electronics: Searching for the Milli-Volt Switch - Video - October 30th, 2012 [October 30th, 2012]
- Moores Law - Video - October 30th, 2012 [October 30th, 2012]
- Geeking out aero-style for a hundred bucks - Dan Shapiro - Video - October 30th, 2012 [October 30th, 2012]
- moores law visualization - Video - October 30th, 2012 [October 30th, 2012]
- how moores law affects conrad shawcross - Video - October 30th, 2012 [October 30th, 2012]
- The Everton Autobiography: How the Blues nearly signed the great Ferenc Puskas & when police action thwarted Goodison ... - November 2nd, 2012 [November 2nd, 2012]
- Letters: Guardian 'surrender' on self-regulation - November 7th, 2012 [November 7th, 2012]
- Academics take issue with Guardian editorial on press regulation - November 9th, 2012 [November 9th, 2012]
- Area deaths - November 22nd, 2012 [November 22nd, 2012]
- clip 2012 12 02 19;00;19 - Video - December 4th, 2012 [December 4th, 2012]
- Police news: Twice as many helmeted motorcyclists crash since law repeal, kids pair with emergency responders during ... - December 5th, 2012 [December 5th, 2012]
- Clallam burglaries are on the rise - December 6th, 2012 [December 6th, 2012]
- When exotic investments are too good to be true - December 10th, 2012 [December 10th, 2012]
- Top headlines: Man in custody in deadly drive-by shooting, Genesee County commissioner says judge can pay back ... - December 12th, 2012 [December 12th, 2012]
- Paul Raschke - Obituary - December 12th, 2012 [December 12th, 2012]
- Pitt County Grand Jury - December 17th, 2012 [December 17th, 2012]
- Connecticut school shooting prompts Genesee County schools, police to take extra precautions - December 18th, 2012 [December 18th, 2012]
- MEN Sport review of the year 2012 - December 18th, 2012 [December 18th, 2012]
- 'The police weren't laughing:' Text message 'joke' of gunfire frightens Grand Blanc, county schools deal with 'end of ... - December 20th, 2012 [December 20th, 2012]
- Top headlines: Schools closed in Genesee County amid violence rumors, Flint church holds candlelight vigil - December 21st, 2012 [December 21st, 2012]
- More than $1 million worth of drugs seized in Salisbury - December 21st, 2012 [December 21st, 2012]
- Anatomy of the school-closing decision: Rumors of violence led to all Genesee County schools shutting for two days - December 21st, 2012 [December 21st, 2012]
- Solo rock stars die sooner than those in bands - December 21st, 2012 [December 21st, 2012]
- Lecturer's private research not 'held' by university for purposes of FOI disclosure, rules Tribunal - December 22nd, 2012 [December 22nd, 2012]
- Liverpool Local News: Liverpool John Moores University to handout record £2.1m after trebling student scholarship kitty - December 26th, 2012 [December 26th, 2012]
- University and College News: Liverpool John Moores University to handout record £2.1m after trebling student ... - December 26th, 2012 [December 26th, 2012]
- Storm whips into Northeast bringing snow, rain - December 28th, 2012 [December 28th, 2012]
- Genesee County sheriff says fireplace blockage may have allowed carbon monoxide buildup - December 28th, 2012 [December 28th, 2012]
- Moores Law Experiment 2 - Video - September 18th, 2013 [September 18th, 2013]
- The Skanner Newspaper - Remember the Moores at Christmastime - December 20th, 2013 [December 20th, 2013]
- HowStuffWorks "How Moore's Law Works" - Computer - December 20th, 2013 [December 20th, 2013]
- Minneapolis Housing Trend Favors More Residential Home Office Use - December 31st, 2013 [December 31st, 2013]
- Kendal solicitor wins place with top law firm - January 1st, 2014 [January 1st, 2014]
- Prince George’s County home sales - January 3rd, 2014 [January 3rd, 2014]
- Obituary: Loyce Tapp - January 5th, 2014 [January 5th, 2014]
- More charges for WSU grad arrested with bombs - January 11th, 2014 [January 11th, 2014]
- Chemical weapons charge added to man with dozens of bombs - January 11th, 2014 [January 11th, 2014]
- Myths of Moore's Law - CNET News - January 16th, 2014 [January 16th, 2014]
- Team 10 saves war medals from auction - January 22nd, 2014 [January 22nd, 2014]
- Dad who abducted kids, fled to Cuba found insane - January 23rd, 2014 [January 23rd, 2014]
- Calendar: Jan. 23 to 26 - January 23rd, 2014 [January 23rd, 2014]
- After baby's death in Perry County, parents seek answers - January 23rd, 2014 [January 23rd, 2014]
- Simulations to enable novel lithographic patterning techniques - January 28th, 2014 [January 28th, 2014]
- Sullivan sued by victim’s parents - January 30th, 2014 [January 30th, 2014]
- Palm Beach murderer James Sulllivan sued to recover $13.5 million he was ordered to pay 20 years ago for killing his ... - January 30th, 2014 [January 30th, 2014]
- Group: Adult jail no place for juveniles - January 31st, 2014 [January 31st, 2014]
- Sotomayor Presides Over Moot Court Raising Privacy Questions - January 31st, 2014 [January 31st, 2014]
- Harbour Grace mayor under pressure over staffing crisis - February 4th, 2014 [February 4th, 2014]
- Colleens Dream Foundation Grants Over $12,000 to UC San Diego Moores Cancer Center to Fund Ovarian Cancer Research - February 4th, 2014 [February 4th, 2014]
- Crossbar nanowire chips combine to form tiny CPU for ... - February 6th, 2014 [February 6th, 2014]
- New Mexico Blocks Vote on Legalized Pot - February 12th, 2014 [February 12th, 2014]
- Calendar Feb. 17 to Feb.19 - February 18th, 2014 [February 18th, 2014]
- Calendar: Feb. 20 to 23 - February 20th, 2014 [February 20th, 2014]
- IBM Atomic Shorts The end of Moores law 00 12 - Video - February 28th, 2014 [February 28th, 2014]
- MIT Research Looks to Extend Moores Law - March 1st, 2014 [March 1st, 2014]
- Indiana Guardsman's bomb-possession charge moved to federal court - March 4th, 2014 [March 4th, 2014]
- Bomb case moved to federal court - March 5th, 2014 [March 5th, 2014]
- Will 100 become the new 60? - March 9th, 2014 [March 9th, 2014]