Companies looking to capitalize on the performance promise of Intels Optane persistent memory have been trying to vet the performance claims and calculate TCO for years now. On August 27, Intel put out a press release that led with the following tidbit (bear with us, this gets more interesting):
Intel today announced Baidu is architecting the in-memory database of its Feed Stream services to harness the high-capacity and high-performance capabilities of Intel Optane DC persistent memory. Paired with 2nd Gen Intel Xeon Scalable processors, building a new memory platform based on Intel Optane DC persistent memory allows Baidu to lower its total cost of ownership (TCO) while delivering more personalized search results to users.
If your eyes glazed over during the last few seconds, here are the key points:
VentureBeat started covering Optane (or, more accurately, the 3D XPoint media underlying Optane) four years ago. At that time, Intel boasted that the new memory technology was 10 times denser than conventional DRAM, 1,000 times faster than the fastest NAND SSD, and 1,000 times the endurance of NAND. However, at the same IDF presentation it was announced, Optane as demonstrated was only 7.23 times faster than the fastest available NAND SSD chips.
A year and a half later, following the announcement of the first Optane-based SSDs, tech analyst Jack Gold noted, Because it is significantly less expensive than DRAM and can have 15X 20X the memory capacity per die (e.g., 8GB vs. 128GB) while achieving speeds at least 10X that of NAND, it is an ideal intermediary memory element where adding more relatively fast memory can significantly increase overall system performance at a lower cost than stacking it with large amounts of DRAM.
Two and a half years later, thats still Optanes promise: near-DRAM performance for less cost per gigabyte than DRAM while facilitating a huge jump in system memory capacities. To grossly oversimplify matters, lots of DDR4 means that large workloads can stay in RAM and not incur the disk swaps to distant storage that can slaughter latency and throughput. So, yes, Optane PMMs are slower than DRAM, but theyre faster than NAND, and eliminating disk swapping for active workload data should yield significantly improved application performance.
Which takes us back to our article opening: Intel launched Optane DC persistent memory in early April 2019, and its a reasonable bet that buyers like Baidu had access to pre-production parts before the launch date. How, then, have we reached September with nary a results-based case study for Optane PMM in sight?
Where are the real-world numbers that prove the promise?
Total cost of ownership (TCO) discussions depend in part on, well, costs. When someone says that an Optane PMM-with-DRAM configuration (because you need both, not just Optane) yields better TCO than an all-DRAM configuration, your first impulse might be to check pricing on both and compare. Theres no reason to do that here on these pages today, because costs change and thats the point.
DRAM prices are extremely volatile, said Michael Yang, analyst and director of research at Informa Tech (formerly IHS Markit). It can double or halve in a year. Two years ago, DRAM would have been three times more than Optane. Today, theres barely any cost premium, only 20% or 30% more so cheap you can almost argue theres parity. Theres not enough difference for people to rearchitect their server farm, for sure. Thats why Intel is moving the argument away from cost.
Another factor in this shifting narrative may be the imminent arrival of DDR5 next year, which Yang says may double DIMM capacities. DDR5 is also expected to scale to double the data rates of DDR4.
If Yang sounds as if hes arguing against Optane, dont jump to conclusions. Hes an admirer of Optane technology in general and believes it holds much potential. However, he would like to see Optanes promise being delivered and observe how Optane scales going forward. Hes also quick to point out that Optane PMM isnt for everybody.
We are certainly seeing data become more valuable, and real-time analytics are on the rise, he said. Optane PMM will be the right solution for some, but not all, workloads by providing the right mix of performance and cost.
To perhaps extrapolate from Yangs sentiments, bear in mind that many, if not most, server configurations never max out their memory potential. These systems go to their graves with open RAM slots and will never need Optane PMM. Similarly, keep a wary eye on sweeping marketing messages. Yes, Optane PMM may be amazing for the elephantine workloads that could be generated by, say, smart city systems. With cameras running on every corner, and everything from automotive traffic control to retail advertising using those HD video feeds in real time, the need for Optane PMM in such applications may be critical.
But how many of those smart cities exist today?
Perhaps thats an unfair question. After all, do we need to bring up that 640K ought to be enough for anyone? Just because the immediate need for Optane may be limited doesnt mean it will stay that way. And how much easier (and cheaper) will it be to build those smart city systems if appropriate hardware and software solutions are readily available?
Also, modern-day Intel is almost phobic about making statements that cant be amply defended with a ream of citations. The company doesnt know what its customers paid for their RAM or prior platforms, so it cant make statements about case studies showing X% improvement unless the customer hands Intel that information and many enterprises, especially cloud companies, are loathe to disclose their internal platform details.
And while were talking cost of ownership, note that theres more to TCO than per-gigabyte costs. Consider a server running multiple virtual machines. If those VMs are limited by the amount of available system memory and its common for application owners to seize more than enough memory, just in case then it logically follows that increasing system memory will allow for more VMs per server. Potentially, fewer physical servers will be needed to run the same number of VMs, thus providing lower hardware costs, lower energy consumption, lower administration and maintenance, and on and on.
We spoke with Kristie Mann, Intels senior director of product management for persistent memory, and she shared with us some of the few definite statistics now emerging from early Optane PMM adopters.
These stories are cherry picked by Intel, but were presenting them here only to illustrate that results are beginning to creep into the market. Your mileage may vary, and in fact, your business may not need Optane at all today.
Still, non-volatile media suitable for system memory and/or ultra-fast storage was going to reach the market eventually, and Intel appears to have both a viable technology and the muscle to push its adoption. As with the arrival ofmost new technologies, though, adoption will likely come with a lot of resistance and the need for market education.
This is a product unlike anything weve had in the past, said Mann. Youve seen multiple tiers of storage for years. We need to do the same thing with memory because of two things. One, the rate of data generation is increasing very quickly, to the point where businesses cant quickly and adequately process that data and turn it into business insights. And two, the scaling of DRAM capacity is slowing. Weve seen the stretching out of the Moores Law timeframe for CPU architecture, and now were seeing the same thing with DRAM. Add it up, and memory cant keep pace with rising data workloads over the next five years. Thats why we need a two-tier memory system.
Above: Source: Flash Memory Summit 2015
With tiered storage, users need to right-size their SSD capacity, often using it as a sort of cache for hotter data more likely to be sought than the data kept on cold, archival disk media. According to Intel, the same principle applies with memory. Again, this isnt an either/or case of DRAM versus Optane PMM. The two work together, with DRAM serving as the faster cache to Optanes slower but far more capacious mass memory.
The obvious question for businesses follows: How much DRAM do I actually need? Surprisingly, relatively few people know, and the tools to find the answer arent within easy reach.
The answer to this question varies by data set and workload, so its very difficult to provide one-size-fits-all guidance, said Mann. Were working on building some new tools from our existing internal tools. We can check cache miss rates, latency, bandwidth all these real-time things we can analyze while a workload is running. But our tools are made for engineers, not the average customer. So, over the next couple quarters, well come out with more advanced tools customers can use to help understand their workload characteristics and effectively balance their memory investments.
Above: Source: IDC
Recognizing flash as a strong alternative to hard disk technology, the founders of SanDisk filed a patent on flash-based SSDs in 1989 and shipped the first such drive in 1991. Arguably, the first enterprise SSD arrived in 2008, and you can see from the IDC/Seagate numbers in the above graphic how long it took for SSDs to make a serious dent in the worlds storage totals. System memory may now face a similar adoption trend.
This isnt to say that the game has already gone to Intel. For instance, Samsungs Z-SSD has strong potential, and the 3D XPoint media underlying Optane is being licensed by Micron (perhaps under the name QuantX) to other storage manufacturers.
Intels thesis, though, seems sound. One way or another, its time we had a leap in capability. Now, we just need the results made public to prove that the promise of Optane is real and that we have a clear path forward for a world drowning in data.
Read this article:
Optane persistent memory: Breakthrough or broken promise? - VentureBeat
- HD Moores Law - Video - July 24th, 2012 [July 24th, 2012]
- Moores Law - Transistor Graph - Video - July 24th, 2012 [July 24th, 2012]
- Moores Lane road construction project begins - October 2nd, 2012 [October 2nd, 2012]
- Orono man totals pickup while reaching for cellphone - October 2nd, 2012 [October 2nd, 2012]
- 2 in Charlotte face fake ID charges - October 4th, 2012 [October 4th, 2012]
- Why there may be more to computing than Moores Law - October 11th, 2012 [October 11th, 2012]
- VR pioneer invents 'illumination-as-a-service' - October 12th, 2012 [October 12th, 2012]
- What is reality...M theory vs Moores law creating real universe vs creating a virtual one - Video - October 30th, 2012 [October 30th, 2012]
- The Rayz/Moores Law @ Put-in-Bay Final Countdown - Video - October 30th, 2012 [October 30th, 2012]
- Moores Law @ Beer Barrel Put-in-Bay Hip Hop Medley - Video - October 30th, 2012 [October 30th, 2012]
- Good explanation of the singularity - Video - October 30th, 2012 [October 30th, 2012]
- What you MUST know about the future - Video - October 30th, 2012 [October 30th, 2012]
- Computer Apple 1 How to tell value KK4WW - Video - October 30th, 2012 [October 30th, 2012]
- Rise of the transapients - Video - October 30th, 2012 [October 30th, 2012]
- Moores Law Music Performing Bruce Springsteen - Video - October 30th, 2012 [October 30th, 2012]
- Moore's Law Ice Cream Man - Video - October 30th, 2012 [October 30th, 2012]
- Moores Law performs Vehicle at PIB - Video - October 30th, 2012 [October 30th, 2012]
- Explaining Moores Law [HD] - MOCustoms.co.uk - Video - October 30th, 2012 [October 30th, 2012]
- Global Challenge Part Fifty - Video - October 30th, 2012 [October 30th, 2012]
- Towards next-generation devices through computer nanomaterial design for semiconductor spintronics - Video - October 30th, 2012 [October 30th, 2012]
- Aiming to establish new spintronics - Video - October 30th, 2012 [October 30th, 2012]
- Correlated electronic materials - Video - October 30th, 2012 [October 30th, 2012]
- Energy Efficient Electronics: Searching for the Milli-Volt Switch - Video - October 30th, 2012 [October 30th, 2012]
- Moores Law - Video - October 30th, 2012 [October 30th, 2012]
- Geeking out aero-style for a hundred bucks - Dan Shapiro - Video - October 30th, 2012 [October 30th, 2012]
- moores law visualization - Video - October 30th, 2012 [October 30th, 2012]
- how moores law affects conrad shawcross - Video - October 30th, 2012 [October 30th, 2012]
- The Everton Autobiography: How the Blues nearly signed the great Ferenc Puskas & when police action thwarted Goodison ... - November 2nd, 2012 [November 2nd, 2012]
- Letters: Guardian 'surrender' on self-regulation - November 7th, 2012 [November 7th, 2012]
- Academics take issue with Guardian editorial on press regulation - November 9th, 2012 [November 9th, 2012]
- Area deaths - November 22nd, 2012 [November 22nd, 2012]
- clip 2012 12 02 19;00;19 - Video - December 4th, 2012 [December 4th, 2012]
- Police news: Twice as many helmeted motorcyclists crash since law repeal, kids pair with emergency responders during ... - December 5th, 2012 [December 5th, 2012]
- Clallam burglaries are on the rise - December 6th, 2012 [December 6th, 2012]
- When exotic investments are too good to be true - December 10th, 2012 [December 10th, 2012]
- Top headlines: Man in custody in deadly drive-by shooting, Genesee County commissioner says judge can pay back ... - December 12th, 2012 [December 12th, 2012]
- Paul Raschke - Obituary - December 12th, 2012 [December 12th, 2012]
- Pitt County Grand Jury - December 17th, 2012 [December 17th, 2012]
- Connecticut school shooting prompts Genesee County schools, police to take extra precautions - December 18th, 2012 [December 18th, 2012]
- MEN Sport review of the year 2012 - December 18th, 2012 [December 18th, 2012]
- 'The police weren't laughing:' Text message 'joke' of gunfire frightens Grand Blanc, county schools deal with 'end of ... - December 20th, 2012 [December 20th, 2012]
- Top headlines: Schools closed in Genesee County amid violence rumors, Flint church holds candlelight vigil - December 21st, 2012 [December 21st, 2012]
- More than $1 million worth of drugs seized in Salisbury - December 21st, 2012 [December 21st, 2012]
- Anatomy of the school-closing decision: Rumors of violence led to all Genesee County schools shutting for two days - December 21st, 2012 [December 21st, 2012]
- Solo rock stars die sooner than those in bands - December 21st, 2012 [December 21st, 2012]
- Lecturer's private research not 'held' by university for purposes of FOI disclosure, rules Tribunal - December 22nd, 2012 [December 22nd, 2012]
- Liverpool Local News: Liverpool John Moores University to handout record £2.1m after trebling student scholarship kitty - December 26th, 2012 [December 26th, 2012]
- University and College News: Liverpool John Moores University to handout record £2.1m after trebling student ... - December 26th, 2012 [December 26th, 2012]
- Storm whips into Northeast bringing snow, rain - December 28th, 2012 [December 28th, 2012]
- Genesee County sheriff says fireplace blockage may have allowed carbon monoxide buildup - December 28th, 2012 [December 28th, 2012]
- Moores Law Experiment 2 - Video - September 18th, 2013 [September 18th, 2013]
- The Skanner Newspaper - Remember the Moores at Christmastime - December 20th, 2013 [December 20th, 2013]
- HowStuffWorks "How Moore's Law Works" - Computer - December 20th, 2013 [December 20th, 2013]
- Minneapolis Housing Trend Favors More Residential Home Office Use - December 31st, 2013 [December 31st, 2013]
- Kendal solicitor wins place with top law firm - January 1st, 2014 [January 1st, 2014]
- Prince George’s County home sales - January 3rd, 2014 [January 3rd, 2014]
- Obituary: Loyce Tapp - January 5th, 2014 [January 5th, 2014]
- More charges for WSU grad arrested with bombs - January 11th, 2014 [January 11th, 2014]
- Chemical weapons charge added to man with dozens of bombs - January 11th, 2014 [January 11th, 2014]
- Myths of Moore's Law - CNET News - January 16th, 2014 [January 16th, 2014]
- Team 10 saves war medals from auction - January 22nd, 2014 [January 22nd, 2014]
- Dad who abducted kids, fled to Cuba found insane - January 23rd, 2014 [January 23rd, 2014]
- Calendar: Jan. 23 to 26 - January 23rd, 2014 [January 23rd, 2014]
- After baby's death in Perry County, parents seek answers - January 23rd, 2014 [January 23rd, 2014]
- Simulations to enable novel lithographic patterning techniques - January 28th, 2014 [January 28th, 2014]
- Sullivan sued by victim’s parents - January 30th, 2014 [January 30th, 2014]
- Palm Beach murderer James Sulllivan sued to recover $13.5 million he was ordered to pay 20 years ago for killing his ... - January 30th, 2014 [January 30th, 2014]
- Group: Adult jail no place for juveniles - January 31st, 2014 [January 31st, 2014]
- Sotomayor Presides Over Moot Court Raising Privacy Questions - January 31st, 2014 [January 31st, 2014]
- Harbour Grace mayor under pressure over staffing crisis - February 4th, 2014 [February 4th, 2014]
- Colleens Dream Foundation Grants Over $12,000 to UC San Diego Moores Cancer Center to Fund Ovarian Cancer Research - February 4th, 2014 [February 4th, 2014]
- Crossbar nanowire chips combine to form tiny CPU for ... - February 6th, 2014 [February 6th, 2014]
- New Mexico Blocks Vote on Legalized Pot - February 12th, 2014 [February 12th, 2014]
- Calendar Feb. 17 to Feb.19 - February 18th, 2014 [February 18th, 2014]
- Calendar: Feb. 20 to 23 - February 20th, 2014 [February 20th, 2014]
- IBM Atomic Shorts The end of Moores law 00 12 - Video - February 28th, 2014 [February 28th, 2014]
- MIT Research Looks to Extend Moores Law - March 1st, 2014 [March 1st, 2014]
- Indiana Guardsman's bomb-possession charge moved to federal court - March 4th, 2014 [March 4th, 2014]
- Bomb case moved to federal court - March 5th, 2014 [March 5th, 2014]
- Will 100 become the new 60? - March 9th, 2014 [March 9th, 2014]