A new version of a standard backed by major cloud providers and chip companies could change the way some of the worlds largest datacenters and fastest supercomputers are built.
The CXL Consortium on Tuesday announced a new specification called CXL 3.0 also known as Compute Express Link 3.0 that eliminates more chokepoints that slow down computation in enterprise computing and datacenters.
The new spec provides a communication link between chips, memory and storage in systems, and it is two times faster than its predecessor called CXL 2.0.
CXL 3.0 also has improvements for more fine-grained pooling and sharing of computing resources for applications such as artificial intelligence.
CXL 3.0 is all about improving bandwidth and capacity, and can better provision and manage computing, memory and storage resources, said Kurt Lender, the co-chair of the CXL marketing work group (and senior ecosystem manager at Intel), in an interview with HPCwire.
Hardware and cloud providers are coalescing around CXL, which has steamrolled other competing interconnects. This week, OpenCAPI, an IBM-backed interconnect standard, merged with CXL Consortium, following the footsteps of Gen-Z, which did the same in 2020.
CXL released the first CXL 1.0 specification in 2019, and quickly followed it up with CXL 2.0, which supported PCIe 5.0, which is found in a handful of chips such as Intels Sapphire Rapids and Nvidias Hopper GPU.
The CXL 3.0 spec is based on PCIe 6.0, which was finalized in January. CXL has a data transfer speed of up to 64 gigatransfers per second, which is the same as PCIe 6.0.
The CXL interconnect can link up chips, storage and memory that are near and far from each other, and that allows system providers to build datacenters as one giant system, said Nathan Brookwood, principal analyst at Insight 64.
CXLs ability to support the expansion of memory, storage and processing in a disaggregated infrastructure gives the protocol a step-up over rival standards, Brookwood said.
Datacenter infrastructures are moving to a decoupled structure to meet the growing processing and bandwidth needs for AI and graphics applications, which require large pools of memory and storage. AI and scientific computing systems also require processors beyond just CPUs, and organizations are installing AI boxes, and in some cases, quantum computers, for more horsepower.
CXL 3.0 improves bandwidth and capacity with better switching and fabric technologies, CXL Consortiums Lender said.
CXL 1.1 was sort of in the node, then with 2.0, you can expand a little bit more into the datacenter. And now you can actually go across racks, you can do decomposable or composable systems, with the fabric technology that weve brought with CXL 3.0, Lender said.
At the rack level, one can make CPU or memory drawers as separate systems, and improvements in CXL 3.0 provide more flexibility and options in switching resources compared to previous CXL specifications.
Typically, servers have a CPU, memory and I/O, and can be limited in physical expansion. In disaggregated infrastructure, one can take a cable to a separate memory tray through a CXL protocol without relying on the popular DDR bus.
You can decompose or compose your datacenter as you like it. You have the capability of moving resources from one node to another, and dont have to do as much overprovisioning as we do today, especially with memory, Lender said, adding its a matter of you can grow systems and sort of interconnect them now through this fabric and through CXL.
The CXL 3.0 protocol uses the electricals of the PCI-Express 6.0 protocol, along with its protocols for I/O and memory. Some improvements include support for new processors and endpoints that can take advantage of the new bandwidth. CXL 2.0 had single-level switching, while 3.0 has multi-level switching, which provides more latency on the fabric.
You can actually start looking at memory like storage you could have hot memory and cold memory, and so on. You can have different tiering and applications can take advantage of that, Lender said.
The protocol also accounts for the ever-changing infrastructure of datacenters, providing more flexibility on how system administrators want to aggregate and disaggregate processing units, memory and storage. The new protocol opens more channels and resources for new types of chips that include SmartNICs, FPGAs and IPUs that may require access to more memory and storage resources in datacenters.
HPC composable systems youre not bound by a box. HPC loves clusters today. And [with CXL 3.0] now you can do coherent clusters and low latency. The growth and flexibility of those nodes is expanding rapidly, Lender said.
The CXL 3.0 protocol can support up to 4,096 nodes, and has a new concept of memory sharing between different nodes. That is an improvement from a static setup in older CXL protocols, where memory could be sliced and attached to different hosts, but could not be shared once allocated.
Now we have sharing where multiple hosts can actually share a segment of memory. Now you can actually look at quick, efficient data movement between hosts if necessary, or if you have an AI-type application that you want to hand data from one CPU or one host to another, Lender said.
The new feature allows peer-to-peer connection between nodes and endpoints in a single domain. That sets up a wall in which traffic can be isolated to move only between nodes connected to each other. That allows for faster accelerator-to-accelerator or device-to-device data transfer, which is key in building out a coherent system.
If you think about some of the applications and then some of the GPUs and different accelerators, they want to pass information quickly, and now they have to go through the CPU. With CXL 3.0, they dont have to go through the CPU this way, but the CPU is coherent, aware of whats going on, Lender said.
The pooling and allocation of memory resources is managed by a software called Fabric Manager. The software can sit anywhere in the system or hosts to control and allocate memory, but it could ultimately impact software developers.
If you get to the tiering level, and when you start getting all the different latencies in the switching, thats where there will have to be some application awareness and tuning of application. I think we certainly have that capability today, Lender said.
It could be two to four years before companies start releasing CXL 3.0 products, and the CPUs will need to be aware of CXL 3.0, Lender said. Intel built in support for CXL 1.1 in its Sapphire Rapids chip, which is expected to start shipping in volume later this year. The CXL 3.0 protocol is backward compatible with the older versions of the interconnect standard.
CXL products based on earlier protocols are slowly trickling into the market. SK Hynix this week introduced its first DDR5 DRAM-based CXL (Compute Express Link) memory samples, and will start manufacturing CXL memory modules in volume next year. Samsung has also introduced CXL DRAM earlier this year.
While products based on CXL 1.1 and 2.0 protocols are on a two-to-three-year product release cycle, CXL 3.0 products could take a little longer as it takes on a more complex computing environment.
CXL 3.0 could actually be a little slower because of some of the Fabric Manager, the software work. Theyre not simple systems when you start getting into fabrics, people are going to want to do proof of concepts and prove out the technology first. Its going to probably be a three-to-four year timeframe, Lender said.
Some companies already started work on CXL 3.0 verification IP six to nine months ago, and are finetuning the tools to the final specification, Bender said.
The CXL has a board meeting in October to discuss the next steps, which could also involve CXL 4.0. The standards organization for PCIe, called the PCI-Special Interest Group, last month announced it was planning PCIe 7.0, which increases the data transfer speed to 128 gigatransfers per second, which is double that of PCIe 6.0.
Lender was cautious about how PCIe 7.0 could potentially fit into a next-generation CXL 4.0. CXL has its own set of I/O, memory and cache protocols.
CXL sits on the electricals of PCIe so I cant commit or absolutely guarantee that [CXL 4.0] will run on 7.0. But thats the intent to use the electricals, Lender said.
Under that case, one of the tenets of CXL 4.0 will be to double the bandwidth by going to PCIe 7.0, but beyond that, everything else will be what we do more fabric or do different tunings, Lender said.
CXL has been on an accelerated pace, with three specification releases since its formation in 2019. There was confusion in the industry on the best high-speed, coherent I/O bus, but the focus has now coagulated around CXL.
Now we have the fabric. There are pieces of Gen-Z and OpenCAPI that arent even in CXL 3.0, so will we incorporate those? Sure, well look at doing that kind of work moving forward, Lender said.
Continued here:
CXL Brings Datacenter-sized Computing with 3.0 Standard, Thinks Ahead to 4.0 - HPCwire
- D-Wave Introduces New Fast Anneal Feature, Extending Quantum Computing Performance Gains - Yahoo Finance - April 20th, 2024 [April 20th, 2024]
- Major First: Quantum Information Produced, Stored, And Retrieved - ScienceAlert - April 20th, 2024 [April 20th, 2024]
- Horizon Quantum Computing to Establish First-of-a-Kind Hardware Testbed - The Quantum Insider - April 20th, 2024 [April 20th, 2024]
- Quantum Cloud Computing Secured in New Breakthrough at Oxford - TechRepublic - April 20th, 2024 [April 20th, 2024]
- Quantum Computing Could be the Next Revolution - Fair Observer - April 20th, 2024 [April 20th, 2024]
- Horizon Quantum Computing to Pioneer Multi-Vendor Quantum Hardware Testbed - HPCwire - April 20th, 2024 [April 20th, 2024]
- These 10 quantum computing companies have pulled in the most VC cash - PitchBook News & Analysis - April 20th, 2024 [April 20th, 2024]
- D-Wave Launches Fast Anneal Feature for Enhanced Quantum Computing Performance - Quantum Computing Report - April 20th, 2024 [April 20th, 2024]
- Software Specialist Horizon Quantum to Build First-of-a-Kind Hardware Testbed - HPCwire - April 20th, 2024 [April 20th, 2024]
- Illuminating Futures: Celebrating Achievements and Exploring Quantum Computing at This is IT! Event - Royal Examiner - April 20th, 2024 [April 20th, 2024]
- Horizon Quantum Computing to Establish First-of-a-Kind Hardware Testbed - The Bakersfield Californian - April 20th, 2024 [April 20th, 2024]
- A Weakness in One of the NIST PQC Algorithms Was Not Uncovered After All - Quantum Computing Report - April 20th, 2024 [April 20th, 2024]
- Commodore 64 claimed to outperform IBM's quantum system sarcastic researchers say 1 MHz computer is faster ... - Tom's Hardware - April 20th, 2024 [April 20th, 2024]
- Quantum computing: a new frontier for the broadcast and media industry - RedShark News - April 20th, 2024 [April 20th, 2024]
- 3 Steps Businesses Should Take to Prepare for Quantum Computing Disruption - TechSpective - April 20th, 2024 [April 20th, 2024]
- Orientum Publishes 'Quantum Finance Algorithm' Paper on ArXiv - The Quantum Insider - April 20th, 2024 [April 20th, 2024]
- Quantum Linear Solvers for Redundant Baseline Calibration - AZoQuantum - April 20th, 2024 [April 20th, 2024]
- 'Almost very close' to nuclear weapon: Federal cyber officials brace for quantum computing surprise - Washington Times - April 20th, 2024 [April 20th, 2024]
- D-Wave fast anneal extends quantum computing performance ... - eeNews Europe - April 20th, 2024 [April 20th, 2024]
- Horizon Quantum Computing to Set Up Its Own Hardware Testbed for Tight Integration Between the Hardware and Software Stacks - Quantum Computing Report - April 20th, 2024 [April 20th, 2024]
- Global Quantum Technology Market Research 2024-2029 with Assessment of Companies Focused on Quantum ... - Daily Host News - April 20th, 2024 [April 20th, 2024]
- The experimental demonstration of a verifiable blind quantum computing protocol - Phys.org - April 20th, 2024 [April 20th, 2024]
- Researchers create 'quantum drums' to store qubits one step closer to groundbreaking internet speed and security - Tom's Hardware - April 20th, 2024 [April 20th, 2024]
- Access to burgeoning quantum technology field could be widened by educational model - Phys.org - April 20th, 2024 [April 20th, 2024]
- 'Quantum memory' could make the internet super fast and secure - Futurity: Research News - April 20th, 2024 [April 20th, 2024]
- Senate bill aims to bring more private sector participation to federal AI innovation - Nextgov/FCW - April 20th, 2024 [April 20th, 2024]
- Quantum Computing Leaps Forward with Groundbreaking Error Correction - yTech - April 4th, 2024 [April 4th, 2024]
- Microsoft and Quantinuum Pave the Way for Reliable Quantum Computing - yTech - April 4th, 2024 [April 4th, 2024]
- Breakthrough in Quantum Information Communication Achieved by Tokyo Researchers - yTech - April 4th, 2024 [April 4th, 2024]
- Microsoft Advances in Quantum Computing with Error-Reduction Breakthrough - yTech - April 4th, 2024 [April 4th, 2024]
- Quantinuum H2 Paves the Way for Reliable Quantum Computing - yTech - April 4th, 2024 [April 4th, 2024]
- Why Quantum Computers Will Never Break Bitcoin - Palm Beach Research Group - April 4th, 2024 [April 4th, 2024]
- Microsoft and Quantinuum boast quantum computing breakthrough - DIGIT.FYI - April 4th, 2024 [April 4th, 2024]
- Microsoft and Quantinuum announce breakthrough in quantum computing 14 thousand experiments without errors - ITC - April 4th, 2024 [April 4th, 2024]
- Revolutionizing Quantum Computing: Breakthroughs in Quantum Error Correction - AZoQuantum - April 4th, 2024 [April 4th, 2024]
- Quantum Computing Recharged With Electromagnetic Ion Trap Innovation - SciTechDaily - April 4th, 2024 [April 4th, 2024]
- Next-Generation Quantum Leap Achieved by Microsoft and Quantinuum - yTech - April 4th, 2024 [April 4th, 2024]
- Microsoft and Quantinuum announce development of next-generation technology that reduces 'noise' by 800 times ... - GIGAZINE - April 4th, 2024 [April 4th, 2024]
- BTQ Technologies Corp. Partners with the Australian Quantum Software Network to Advance Quantum Computing and ... - PR Newswire - April 4th, 2024 [April 4th, 2024]
- Quantinuum and Microsoft Leap towards Quantum Superiority with Noise Reduction Breakthrough - yTech - April 4th, 2024 [April 4th, 2024]
- The 3 Best Quantum Computing Stocks to Buy in Q2 2024 - InvestorPlace - April 4th, 2024 [April 4th, 2024]
- What Are the Implications of Quantum Computing for the Future of Data Security? - socPub - April 4th, 2024 [April 4th, 2024]
- Cosmic rays, XR, and 'multiverse' quantum computing welcome to EIC's deeptech Scaling Club - TNW - April 4th, 2024 [April 4th, 2024]
- Wall Street Favorites: 3 Quantum Computing Stocks with Strong Buy Ratings for February 2024 - InvestorPlace - February 26th, 2024 [February 26th, 2024]
- Never-Repeating Tiles Can Safeguard Quantum Information - Quanta Magazine - February 26th, 2024 [February 26th, 2024]
- Fractional Electrons: MIT's New Graphene Breakthrough Is Shaping the Future of Quantum Computing - SciTechDaily - February 26th, 2024 [February 26th, 2024]
- Qubits are notoriously prone to failure but building them from a single laser pulse may change this - Livescience.com - February 26th, 2024 [February 26th, 2024]
- New Phase of Matter Created During Experiments with Exotic Particles in Quantum Processor - The Debrief - February 26th, 2024 [February 26th, 2024]
- Harnessing the Power of Neutrality: Comparing Neutral-Atom Quantum Computing With Other Modalities - The Quantum Insider - February 26th, 2024 [February 26th, 2024]
- Apple is already defending iMessage against tomorrow's quantum computing attacks - The Verge - February 26th, 2024 [February 26th, 2024]
- Government of Canada Supports Xanadu to Accelerate Quantum Computing Research and Education - HPCwire - February 26th, 2024 [February 26th, 2024]
- U.S. weighs National Quantum Initiative Reauthorization Act - TechTarget - February 26th, 2024 [February 26th, 2024]
- The Current State of Quantum Computing - Securities.io - February 26th, 2024 [February 26th, 2024]
- Superconducting qubit promises breakthrough in quantum computing - Advanced Science News - February 26th, 2024 [February 26th, 2024]
- Quantum Computing Breakthrough: New Fusion of Materials Has All the Components Required for a Unique Type of ... - SciTechDaily - February 26th, 2024 [February 26th, 2024]
- 3 Quantum Computing Stocks That Could Be Multibaggers in the Making: February Edition - InvestorPlace - February 26th, 2024 [February 26th, 2024]
- DCD Podcast - The fundamentals of quantum computing, with Yuval Boger, QuEra - DCD - DatacenterDynamics - February 26th, 2024 [February 26th, 2024]
- Apple to launch PQ3 update for iMessage, bolstering encryption against quantum computing - ReadWrite - February 26th, 2024 [February 26th, 2024]
- Illinois governor's proposed $53B budget includes funds for migrants, quantum computing and schools - The Associated Press - February 26th, 2024 [February 26th, 2024]
- How is Quantum Technology Developing in Ireland? A Conversation with John Durcan, IDA Ireland - AZoQuantum - February 26th, 2024 [February 26th, 2024]
- Quantum Poker: The States of Colorado and Illinois are Betting on Quantum - Quantum Computing Report - February 26th, 2024 [February 26th, 2024]
- One of those transformational investments: $15M brings quantum computing to SC - WIS News 10 - February 26th, 2024 [February 26th, 2024]
- Apple is future-proofing iMessage with post-quantum cryptography - Cointelegraph - February 26th, 2024 [February 26th, 2024]
- Singapore warns banks to prepare for quantum computing cyber threat - Finextra - February 26th, 2024 [February 26th, 2024]
- New Superconducting Flowermon Superconducting Qubit Designed to Greatly Increase Coherence Times - Quantum Computing Report - February 26th, 2024 [February 26th, 2024]
- Apple Ramps Up iMessage Security to Fight Looming Quantum Computing Threat - PCMag - February 26th, 2024 [February 26th, 2024]
- IONQ Stock Outlook: Why This Quantum Computing Play Could Be a Long-Term Winner - InvestorPlace - February 26th, 2024 [February 26th, 2024]
- Apple future-proofing iMessage to protect against the scary future of quantum computing hacking - TechRadar - February 26th, 2024 [February 26th, 2024]
- Apple to upgrade iMessage with measures against future quantum computing hacking - The Indian Express - February 26th, 2024 [February 26th, 2024]
- FedDev Ontario invests $17 million in 12 companies to advance quantum computing - IT World Canada - February 26th, 2024 [February 26th, 2024]
- Apple Bolsters iMessage Encryption Amid Quantum Computing Threats - Telecom Lead - February 26th, 2024 [February 26th, 2024]
- The 3 Most Undervalued Quantum Computing Stocks to Buy in January - InvestorPlace - January 21st, 2024 [January 21st, 2024]
- The Week's 10 Biggest Funding Rounds: Quantinuum And Flexport Lock Up Huge Rounds - Crunchbase News - January 21st, 2024 [January 21st, 2024]
- US users top list after Chinas state-of-the-art quantum computer goes global - South China Morning Post - January 21st, 2024 [January 21st, 2024]
- Mitsui to invest in Quantinuum, a leading global quantum computing company, and sign a distributorship agreement for ... - Mitsui - January 21st, 2024 [January 21st, 2024]
- Breakthrough in quantum computing with stable room temperature qubits - Advanced Science News - January 21st, 2024 [January 21st, 2024]
- Why IONQ Is Not a Stock to Buy (Yet) - InvestorPlace - January 21st, 2024 [January 21st, 2024]
- Davos and the global state of quantum - POLITICO - January 21st, 2024 [January 21st, 2024]
- High-Frequency Transactions: Collaborating with Quantum AI? Features Film Threat - Film Threat - January 21st, 2024 [January 21st, 2024]
- Quantum Computing: Revolution on the Horizon? | by Shan | Jan, 2024 - Medium - January 21st, 2024 [January 21st, 2024]