Artificial-intelligence workloads are intrinsically data-intensive. They need massive amounts of data to train and produce valuable insights. So storage becomes a key consideration for running these AI applications. First, they need to run where the data resides, which varies in distributed environments. And then those informationalgems that result from the AI algorithms need to be stored somewhere.
Flash storage has a multi-dimensional performance that can take any size of file or workload and run through it without creating storage-related bottlenecks. Two IT leaders in high-performance computing, Nvidia Corp.and Pure Storage Inc., saw these demands in their customers. In response, they joined forces and created AIRI, an AI-ready infrastructure that can help unlock data intelligence.
You know, a lot of it comes from our customers, saidCharlie Boyle(pictured right), vice president and general manager of DGX Systems at Nvidia. Thats how we first started with Pure. Its our joint customer saying we need this stuff to work really fast. Theyre making a massive investment with us in computing. And so if youre going to run those systems at 100%, you need storage that can feed them.If the customer has data, we want it to be as simple as possible for them to run AI.
Boyle and Brian Schwarz (pictured left), vice president of product management at Pure Storage, spoke with Dave Vellante (@dvellante) and Lisa Martin (@LisaMartinTV), co-hosts of theCUBE, SiliconANGLE Medias mobile livestreaming studio, during the Pure//Accelerate event in Austin, Texas. They discussed theNvidia and Pure Storage partnership, the adoption of AIRI, and AI advancements in the industry(see the full interview with transcript here). (* Disclosure below.)
[Editors note: The following answers have been condensed for clarity.]
Martin: Give us a little bit of an overview of where Pure and Nvidia are.
Schwarz: It really was born out of work with mutual customers. We brought out the FlashBlade product. Obviously, Nvidia was in the market with DGXs for AI, and we really started to see overlap in a bunch of initial [AI] deployments. So thats really kind of where the partnership was born. And, obviously, the AI data hub is the piece that we really talked about at this years Accelerate.
Martin: Tell us a little bit about the adoption [of AIRI] and what customers are able to do with this AI-ready infrastructure?
Boyle: [Early customers] had been using storage for years, and AI was kind of new to them, and they needed that recipe. So the early customer experiences turned into AIRI the solution. And the whole point of it is to simplify AI.
AI sounds kind of scary to a lot of folks, and the data scientists really just need to be productive. They dont care about infrastructure, but IT has to support this. So IT was very familiar with Pure Storage. They used them for years for high-performance data, and as they brought in the Nvidiacompute to work with that, having a solution that we both supported was super important to the IT practitioners.
Vellante: How do you see the landscape? Are you seeing pretty aggressive adoption or is it still early?
Boyle: So, every customer is at a different point. Theres definitely a lot of people that are still early, but weve seen a lot of production use cases. So depending on the industry, it really depends on where people are in the maturity curve. But really our message out to the enterprise is start now, whether youve got one data scientist or youve got some community data scientists, theres no reason to wait on AI.
Vellante: So, what are the key considerations for getting started?
Schwarz: So I think understanding the business value creation problem is a really important step. And many people go through an early stage of experimentation a prototyping stage before they go into a mass-production use case. Its a very classic IT adoption curve.
If you look forward over the next 15 to 20 years, theres a massive amount of AI coming, and it is a new form of computing the GPU-driven computing. And the whole point about AIRI is getting the ingredients right to have this new set of infrastructure have storage, network, compute, and the software stack.
Martin: For other customers in different industries, how do you help them even understand the AI pipeline?
Boyle: A lot of it is understanding your data, and thats where Pure and the [AI] data hub comes in. And then formulate a question like, what could I do if I knew this thing? Because thats all about AI and deep learning. Its coming up with insights that arent natural when you just stare at the data. How can the system understand what you want. And then what are the things that you didnt expect to find that AI is showing you about your data. AI can unlock things that you may not have pondered yourself.
And one of the biggest aha moments that Ive seen in customers in the past year or so is just how quickly by using GPU computing they can actually look at their data, do something useful with it, and then move on to the next thing. So, that rapid experimentation is what AI is all about.
Vellante: Youre not going to help but run into [machine intelligence]; its going to be part of your everyday life. Your thoughts?
Boyle: We all use AI every day; you just dont know it. Its the voice recognition system, getting your answer right the first time all in less than a second. Before thatd be like you talked to an IVR system, wait, then you go to an operator; and now people are getting such a better user experience out of AI-backed systems.
Vellante: The AI leaders are applying machine intelligence to that data. How has this modern storage that we heard about this morning affected that customers abilities to really put data at their core?
Schwarz: I think one of the real opportunities, particularly with flash, is to consolidate data into a smaller number of larger, kind of islands of data, because thats where you can really drive the insights. And historically in a disk-driven world, you would never try to consolidate your data, because there were too many bad performance implications of trying to do that. The difference with flash is theres so much performance at the core of it, at the foundation of it.
Martin: I want to ask you about distributed environments. You know customers have so much choice for everything these days. On-prem, hosted, SaaS, public cloud. What are some of the trends that youre seeing?
Schwarz: The first thing I always tell people is, wheres your data gravity? Moving very large sets of data is actually still a hard challenge today. So running your AI where your data is being generated is a good first principle. The second thing is about giving people flexibility. So trying to use a consistent set of infrastructure and software and tooling that allows people to migrate and change over time is an important strategy.
Vellante: So, ideally, on-prem versus cloud implementations shouldnt be different but are they today?
Boyle: So, at the lowest level, there are always technical differences, but at the layer that customers are using it, we run one software stack, no matter where youre running. Its the same in the Nvidiasoftware stack. And its really [about] running AI where your data is.
Vellante: Now that youve been in the market for a while, what are Pures competitive differentiators?
Schwarz: Why do we think [flash] is a great fit for an AI use case? One is the flexibility of the performance we call it multi-dimensional performance. Small files, large files, meta data-intensive workloads, FlashBladecan do them all. Its a ground-up design, its super flexible on performance, but also, more importantly, I would argue simplicity is a real hallmark of who we are.
Watch the complete video interview below, and be sure to check out more of SiliconANGLEs and theCUBEs coverage of the Pure//Accelerate event. (* Disclosure: TheCUBE is a paid media partner for the Pure//Accelerate event. Neither Pure Storage Inc., the sponsor for theCUBEs event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
Wed like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we dont have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary onSiliconANGLE along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams attheCUBE take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.
If you like the reporting, video interviews and other ad-free content here,please take a moment to check out a sample of the video content supported by our sponsors,tweet your support, and keep coming back toSiliconANGLE.
Continue reading here:
Q&A: High-performance flash key to unlocking data-intense AI workloads - SiliconANGLE News
- Classic reasoning systems like Loom and PowerLoom vs. more modern systems based on probalistic networks - November 8th, 2009 [November 8th, 2009]
- Using Amazon's cloud service for computationally expensive calculations - November 8th, 2009 [November 8th, 2009]
- Software environments for working on AI projects - November 8th, 2009 [November 8th, 2009]
- New version of my NLP toolkit - November 8th, 2009 [November 8th, 2009]
- Semantic Web: through the back door with HTML and CSS - November 8th, 2009 [November 8th, 2009]
- Java FastTag part of speech tagger is now released under the LGPL - November 8th, 2009 [November 8th, 2009]
- Defining AI and Knowledge Engineering - November 8th, 2009 [November 8th, 2009]
- Great Overview of Knowledge Representation - November 8th, 2009 [November 8th, 2009]
- Something like Google page rank for semantic web URIs - November 8th, 2009 [November 8th, 2009]
- My experiences writing AI software for vehicle control in games and virtual reality systems - November 8th, 2009 [November 8th, 2009]
- The URL for this blog has changed - November 8th, 2009 [November 8th, 2009]
- I have a new page on Knowledge Management - November 8th, 2009 [November 8th, 2009]
- N-GRAM analysis using Ruby - November 8th, 2009 [November 8th, 2009]
- Good video: Knowledge Representation and the Semantic Web - November 8th, 2009 [November 8th, 2009]
- Using the PowerLoom reasoning system with JRuby - November 8th, 2009 [November 8th, 2009]
- Machines Like Us - November 8th, 2009 [November 8th, 2009]
- RapidMiner machine learning, data mining, and visualization tool - November 8th, 2009 [November 8th, 2009]
- texai.org - November 8th, 2009 [November 8th, 2009]
- NLTK: The Natural Language Toolkit - November 8th, 2009 [November 8th, 2009]
- My OpenCalais Ruby client library - November 8th, 2009 [November 8th, 2009]
- Ruby API for accessing Freebase/Metaweb structured data - November 8th, 2009 [November 8th, 2009]
- Protégé OWL Ontology Editor - November 8th, 2009 [November 8th, 2009]
- New version of Numenta software is available - November 8th, 2009 [November 8th, 2009]
- Very nice: Elsevier IJCAI AI Journal articles now available for free as PDFs - November 8th, 2009 [November 8th, 2009]
- Verison 2.0 of OpenCyc is available - November 8th, 2009 [November 8th, 2009]
- What’s Your Biggest Question about Artificial Intelligence? [Article] - November 8th, 2009 [November 8th, 2009]
- Minimax Search [Knowledge] - November 8th, 2009 [November 8th, 2009]
- Decision Tree [Knowledge] - November 8th, 2009 [November 8th, 2009]
- More AI Content & Format Preference Poll [Article] - November 8th, 2009 [November 8th, 2009]
- New Planners Solve Rescue Missions [News] - November 8th, 2009 [November 8th, 2009]
- Neural Network Learns to Bluff at Poker [News] - November 8th, 2009 [November 8th, 2009]
- Pushing the Limits of Game AI Technology [News] - November 8th, 2009 [November 8th, 2009]
- Mining Data for the Netflix Prize [News] - November 8th, 2009 [November 8th, 2009]
- Interview with Peter Denning on the Principles of Computing [News] - November 8th, 2009 [November 8th, 2009]
- Decision Making for Medical Support [News] - November 8th, 2009 [November 8th, 2009]
- Neural Network Creates Music CD [News] - November 8th, 2009 [November 8th, 2009]
- jKilavuz - a guide in the polygon soup [News] - November 8th, 2009 [November 8th, 2009]
- Artificial General Intelligence: Now Is the Time [News] - November 8th, 2009 [November 8th, 2009]
- Apply AI 2007 Roundtable Report [News] - November 8th, 2009 [November 8th, 2009]
- What Would You do With 80 Cores? [News] - November 8th, 2009 [November 8th, 2009]
- Software Finds Learning Language Child's Play [News] - November 8th, 2009 [November 8th, 2009]
- Artificial Intelligence in Games [Article] - November 8th, 2009 [November 8th, 2009]
- Artificial Intelligence Resources - November 8th, 2009 [November 8th, 2009]
- Alan Turing: Mathematical Biologist? - April 25th, 2012 [April 25th, 2012]
- BBC Horizon: The Hunt for AI ( Artificial Intelligence ) - Video - April 30th, 2012 [April 30th, 2012]
- Can computers have true artificial intelligence" Masonic handshake" 3rd-April-2012 - Video - April 30th, 2012 [April 30th, 2012]
- Kevin B. Korb - Interview - Artificial Intelligence and the Singularity p3 - Video - April 30th, 2012 [April 30th, 2012]
- Artificial Intelligence - 6 Month Anniversary - Video - April 30th, 2012 [April 30th, 2012]
- Science Breakthroughs - April 30th, 2012 [April 30th, 2012]
- Hitman: Blood Money - Part 49 - Stupid Artificial Intelligence! - Video - April 30th, 2012 [April 30th, 2012]
- Research Members Turned Off By HAARP Artificial Intelligence - Video - April 30th, 2012 [April 30th, 2012]
- Artificial Intelligence Lecture No. 5 - Video - April 30th, 2012 [April 30th, 2012]
- The Artificial Intelligence Laboratory, 2012 - Video - April 30th, 2012 [April 30th, 2012]
- Charlie Rose - Artificial Intelligence - Video - April 30th, 2012 [April 30th, 2012]
- Expert on artificial intelligence to speak at EPIIC Nights dinner - May 4th, 2012 [May 4th, 2012]
- Filipino software engineers complete and best thousands on Stanford’s Artificial Intelligence Course - May 4th, 2012 [May 4th, 2012]
- Vodafone xone™ Hackathon Challenges Developers and Entrepreneurs to Build a New Generation of Artificial Intelligence ... - May 4th, 2012 [May 4th, 2012]
- Rocket Fuel Packages Up CPG Booster - May 4th, 2012 [May 4th, 2012]
- 2 Filipinos finishes among top in Stanford’s Artificial Intelligence course - May 5th, 2012 [May 5th, 2012]
- Why Your Brain Isn't A Computer - May 5th, 2012 [May 5th, 2012]
- 2 Pinoy software engineers complete Stanford's AI course - May 7th, 2012 [May 7th, 2012]
- Percipio Media, LLC Proudly Accepts Partnership With MIT's Prestigious Computer Science And Artificial Intelligence ... - May 10th, 2012 [May 10th, 2012]
- Google Driverless Car Ok'd by Nevada - May 10th, 2012 [May 10th, 2012]
- Moving Beyond the Marketing Funnel: Rocket Fuel and Forrester Research Announce Free Webinar - May 10th, 2012 [May 10th, 2012]
- Rocket Fuel Wins 2012 San Francisco Business Times Tech & Innovation Award - May 13th, 2012 [May 13th, 2012]
- Internet Week 2012: Rocket Fuel to Speak at OMMA RTB - May 16th, 2012 [May 16th, 2012]
- How to Get the Most Out of Your Facebook Ads -- Rocket Fuel's VP of Products, Eshwar Belani, to Lead MarketingProfs ... - May 16th, 2012 [May 16th, 2012]
- The Digital Disruptor To Banking Has Just Gone International - May 16th, 2012 [May 16th, 2012]
- Moving Beyond the Marketing Funnel: Rocket Fuel Announce Free Webinar Featuring an Independent Research Firm - May 23rd, 2012 [May 23rd, 2012]
- MASA Showcases Latest Version of MASA SWORD for Homeland Security Markets - May 23rd, 2012 [May 23rd, 2012]
- Bluesky Launches Drones for Aerial Surveying - May 23rd, 2012 [May 23rd, 2012]
- Artificial Intelligence: What happened to the hunt for thinking machines? - May 25th, 2012 [May 25th, 2012]
- Bubble Robots Move Using Lasers [VIDEO] - May 25th, 2012 [May 25th, 2012]
- UHV assistant professors receive $10,000 summer research grants - May 27th, 2012 [May 27th, 2012]
- Artificial intelligence: science fiction or simply science? - May 28th, 2012 [May 28th, 2012]
- Exetel taps artificial intelligence - May 29th, 2012 [May 29th, 2012]
- Software offers brain on the rain - May 29th, 2012 [May 29th, 2012]
- New Dean of Science has high hopes for his faculty - May 30th, 2012 [May 30th, 2012]
- Cognitive Code Announces "Silvia For Android" App - May 31st, 2012 [May 31st, 2012]
- A Rat is Smarter Than Google - June 5th, 2012 [June 5th, 2012]