Meta has confirmed Hammerspace is its data orchestration software supplier, supporting 49,152 Nvidia H100 GPUs split into two equal clusters.
The parent of Facebook, Instgram and other social media platforms, says its long-term vision is to create artificial general intelligence (AGI) that is open and built responsibly so that it can be widely available for everyone to benefit from. The blog authors say: Marking a major investment in Metas AI future, we are announcing two 24k GPU clusters. We are sharing details on the hardware, network, storage, design, performance, and software that help us extract high throughput and reliability for various AI workloads.
Hammerspace has been saying for some weeks that it has a huge hyperscaler AI customer, which we suspected to be Meta, and now Meta has described the role of Hammerspace in two Llama 3 AI training systems.
Metas bloggers say: These clusters support our current and next generation AI models, including Llama 3, the successor to Llama 2, our publicly released LLM, as well as AI research and development across GenAI and other areas.
A precursor AI Research SuperCluster, with 16,000 Nvidia A100 GPUs, was used to build Metas gen 1 AI models and continues to play an important role in the development of Llama and Llama 2, as well as advanced AI models for applications ranging from computer vision, NLP, and speech recognition, to image generation, and even coding. That cluster uses Pure Storage FlashArray and FlashBladeall-flash arrays.
Metas two newer and larger clusters are diagrammed in the blog:
They support models larger and more complex than that could be supported in the RSC and pave the way for advancements in GenAI product development and AI research. The scale here is overwhelming as they help handle hundreds of trillions of AI model executions per day.
The two clusters each start with 24,576 Nvidia H100 GPUs. One has an RDMA over RoCE 400 Gbps Ethernet network system, using Arista 7800 switches with Wedge400 and Minipack2 OCP rack switches, while the other has an Nvidia Quantum2 400Gbps InfiniBand setup.
Metas Grand Teton OCP hardware chassis houses the GPUs, which rely on Metas Tectonic distributed, flash-optimized and exabyte scale storage system.
This is accessed though a Meta-developed Linux Filesystem in Userspace (FUSE) API and used for AI model data needs and model checkpointing. The blog says: This solution enables thousands of GPUs to save and load checkpoints in a synchronized fashion (a challenge for any storage solution) while also providing a flexible and high-throughput exabyte scale storage required for data loading.
Meta has partnered with Hammerspace to co-develop and land a parallel network file system (NFS) deployment to meet the developer experience requirements for this AI cluster Hammerspace enables engineers to perform interactive debugging for jobs using thousands of GPUs as code changes are immediately accessible to all nodes within the environment. When paired together, the combination of our Tectonic distributed storage solution and Hammerspace enable fast iteration velocity without compromising on scale.
The Hammerspace diagramabove provides its view of the co-developed AI cluster storage system.
Both the Tectonic and Hammerspace-backed storage deployments use Metas YV3 Sierra Point server fitted with the highest-capacity E1.S format SSDs available. These are OCP servers customized to achieve the right balance of throughput capacity per server, rack count reduction, and associated power efficiency as well as fault tolerance.
Meta is not stopping here. The blog authors say: This announcement is one step in our ambitious infrastructure roadmap. By the end of 2024, were aiming to continue to grow our infrastructure build-out that will include 350,000 NVIDIA H100 GPUs as part of a portfolio that will feature compute power equivalent to nearly 600,000 H100s.
Go here to see the original:
- Creating 'good' AGI that won't kill us all: Crypto's Artificial Superintelligence Alliance - Cointelegraph - March 29th, 2024 [March 29th, 2024]
- Beyond the Buzz: Clear Language is Necessary for Clear Policy on AI | TechPolicy.Press - Tech Policy Press - March 29th, 2024 [March 29th, 2024]
- Whoever develops artificial general intelligence first wins the whole game - ForexLive - March 29th, 2024 [March 29th, 2024]
- AGI and Democracy - Ash Center - March 29th, 2024 [March 29th, 2024]
- Elon Musk Believes 'Super Intelligence' Is Inevitable and Could End Humanity - Observer - March 29th, 2024 [March 29th, 2024]
- What was (A)I made for? - by The Ink - The.Ink - March 29th, 2024 [March 29th, 2024]
- The evolution of artificial intelligence (AI) spending by the U.S. government | Brookings - Brookings Institution - March 29th, 2024 [March 29th, 2024]
- Fetch.ai, Ocean Protocol and SingularityNET to Partner on Decentralized AI - PYMNTS.com - March 29th, 2024 [March 29th, 2024]
- Unveiling Sam Altman's Insights from Lex Fridman Interview - hackernoon.com - March 29th, 2024 [March 29th, 2024]
- Scientists create AI models that can talk to each other and pass on skills with limited human input - Livescience.com - March 29th, 2024 [March 29th, 2024]
- Will AI save humanity? U.S. tech fest offers reality check - Japan Today - March 18th, 2024 [March 18th, 2024]
- Artificial general intelligence and higher education - Inside Higher Ed - March 18th, 2024 [March 18th, 2024]
- The Madness of the Race to Build Artificial General Intelligence - Truthdig - March 18th, 2024 [March 18th, 2024]
- Companies Like Morgan Stanley Are Already Making Early Versions of AGI - Observer - March 18th, 2024 [March 18th, 2024]
- Types of Artificial Intelligence That You Should Know in 2024 - Simplilearn - March 18th, 2024 [March 18th, 2024]
- US government warns AI may be an 'extinction-level threat' to humans - TweakTown - March 18th, 2024 [March 18th, 2024]
- Amazon's VP of AGI: Arrival of AGI Not 'Moment in Time' SXSW 2024 - AI Business - March 14th, 2024 [March 14th, 2024]
- What is general intelligence in the world of AI and computers? The race for the artificial mind explained - PC Gamer - March 14th, 2024 [March 14th, 2024]
- Beyond human intelligence: Claude 3.0 and the quest for AGI - VentureBeat - March 14th, 2024 [March 14th, 2024]
- DeepMind Co-founder on AGI and the AI Race - SXSW 2024 - AI Business - March 14th, 2024 [March 14th, 2024]
- Rejuve.Bio Launches Groundbreaking Crowd Fund on NetCapital to Pioneer the Future of Artificial General ... - PR Newswire - March 14th, 2024 [March 14th, 2024]
- Employees at Top AI Labs Fear Safety Is an Afterthought - TIME - March 14th, 2024 [March 14th, 2024]
- Among the A.I. Doomsayers - The New Yorker - March 14th, 2024 [March 14th, 2024]
- Artificial Superintelligence Could Arrive by 2027, Scientist Predicts - Futurism - March 14th, 2024 [March 14th, 2024]
- OpenAI, Salesforce and Others Boost Efforts for Ethical AI - PYMNTS.com - March 14th, 2024 [March 14th, 2024]
- Google DeepMind C.E.O. Demis Hassabis on the Path From Chatbots to A.G.I. - The New York Times - February 24th, 2024 [February 24th, 2024]
- Bill Foster, a particle physicist-turned-congressman, on why he's worried about artificial general intelligence - FedScoop - February 24th, 2024 [February 24th, 2024]
- Generative AI Defined: How It Works, Benefits and Dangers - TechRepublic - February 24th, 2024 [February 24th, 2024]
- AI and You: OpenAI's Sora Previews Text-to-Video Future, First Ivy League AI Degree - CNET - February 24th, 2024 [February 24th, 2024]
- Vitalik Buterin and Sandeep Nailwal headline decentralized agi summit @ Ethdenver tackling threats of centralized AI - Grit Daily - February 24th, 2024 [February 24th, 2024]
- What is AI? A-to-Z Glossary of Essential AI Terms in 2024 - Tech.co - February 22nd, 2024 [February 22nd, 2024]
- With Sora, OpenAI highlights the mystery and clarity of its mission | The AI Beat - VentureBeat - February 22nd, 2024 [February 22nd, 2024]
- Why, Despite All the Hype We Hear, AI Is Not One of Us - Walter Bradley Center for Natural and Artificial Intelligence - February 22nd, 2024 [February 22nd, 2024]
- What is Artificial General Intelligence (AGI) and Why It's Not Here Yet: A Reality Check for AI Enthusiasts - Unite.AI - February 22nd, 2024 [February 22nd, 2024]
- Forget Artificial General Intelligence (AGI) the big impact is already here and its called AI agents - IT World Canada - February 22nd, 2024 [February 22nd, 2024]
- Future of Artificial Intelligence: Predictions and Impact on Society - Medriva - February 22nd, 2024 [February 22nd, 2024]
- Bret Taylor and Clay Bavor talk AI startups, AGI, and job disruptions - Semafor - February 22nd, 2024 [February 22nd, 2024]
- 3 scary breakthroughs AI will make in 2024 - Livescience.com - January 2nd, 2024 [January 2nd, 2024]
- What Is Artificial Intelligence (AI)? - Council on Foreign Relations - January 2nd, 2024 [January 2nd, 2024]
- 6. AI in Everyday Life How Artificial Intelligence is Impacting Society - Medium - January 2nd, 2024 [January 2nd, 2024]
- 2023 Was A Breakout Year for AI - What Can We Expect Looking Forward? - Securities.io - January 2nd, 2024 [January 2nd, 2024]
- 2024 Tech Predictions: From Sci-Fi Fantasy to Reality - Exploring Cinematic Tech Prophecies - Medium - January 2nd, 2024 [January 2nd, 2024]
- AGI predictions for 2024. The major LLM players, as well as | by Paul Pallaghy, PhD | Dec, 2023 - Medium - January 2nd, 2024 [January 2nd, 2024]
- 10 Scary Breakthroughs AI Will Make in 2024 | by AI News | Dec, 2023 - Medium - January 2nd, 2024 [January 2nd, 2024]
- Top 5 Myths About AI Debunked. Unraveling the Truth: Separating AI | by Michiel Meire | Dec, 2023 - Medium - January 2nd, 2024 [January 2nd, 2024]
- AI Revolution: Unleashing the Power of Artificial Intelligence in Our Lives - Medium - January 2nd, 2024 [January 2nd, 2024]
- Superintelligence Unleashed: Navigating the Perils and Promises of Tomorrow's AI Landscape with - Medium - January 2nd, 2024 [January 2nd, 2024]
- AI in taxation: Transforming or replacing? - Times of Malta - January 2nd, 2024 [January 2nd, 2024]
- ChatGPT egg balancing task convinced Microsoft that AGI is closer - Business Insider - May 18th, 2023 [May 18th, 2023]
- Can We Stop Runaway A.I.? - The New Yorker - May 18th, 2023 [May 18th, 2023]
- Microsoft's 'Sparks of AGI' ignite debate on humanlike AI - The Jerusalem Post - May 18th, 2023 [May 18th, 2023]
- Artificial General Intelligence is the Answer, says OpenAI CEO - Walter Bradley Center for Natural and Artificial Intelligence - May 18th, 2023 [May 18th, 2023]
- AI glossary: words and terms to know about the booming industry - NBC News - May 18th, 2023 [May 18th, 2023]
- Is medicine ready for AI? Doctors, computer scientists, and ... - MIT News - May 18th, 2023 [May 18th, 2023]
- What marketers should keep in mind when adopting AI - MarTech - May 18th, 2023 [May 18th, 2023]
- Zoom Invests in and Partners With Anthropic to Improve Its AI ... - PYMNTS.com - May 18th, 2023 [May 18th, 2023]
- Hippocratic AI launches With $50M to power healthcare chatbots - VatorNews - May 18th, 2023 [May 18th, 2023]
- The Potential of AI in Tax Practice Relies on Understanding its ... - Thomson Reuters Tax & Accounting - May 18th, 2023 [May 18th, 2023]
- How AI Knows Things No One Told It - Scientific American - May 18th, 2023 [May 18th, 2023]
- Operation HOPE and CAU Host ChatGPT Creator to Discuss AI - Black Enterprise - May 18th, 2023 [May 18th, 2023]
- Paper Claims AI May Be a Civilization-Destroying "Great Filter" - Futurism - May 18th, 2023 [May 18th, 2023]
- Vintage AI Predictions Show Our Hopes and Fears Aren't New ... - Gizmodo - May 18th, 2023 [May 18th, 2023]
- AIs Impact on Journalism - Signals AZ - May 18th, 2023 [May 18th, 2023]
- What is Augmented Intelligence? Explanation and Examples - Techopedia - May 18th, 2023 [May 18th, 2023]
- 'Godfather' of AI is now having second thoughts - The B.C. Catholic - May 18th, 2023 [May 18th, 2023]
- Top Philippine universities - Philstar.com - May 18th, 2023 [May 18th, 2023]
- The Politics of Artificial Intelligence (AI) - National and New Jersey ... - InsiderNJ - May 18th, 2023 [May 18th, 2023]
- People warned AI is becoming like a God and a 'catastrophe' is ... - UNILAD - May 18th, 2023 [May 18th, 2023]
- "Zero tolerance" for hallucinations - Dr. Vishal Sikka on how Vianai builds AI applications, and the mixed emotions of the AI hype cycle -... - May 18th, 2023 [May 18th, 2023]