Microsoft is reportedly working on its own AI chips that can be used to train large language models and avoid a costly reliance on Nvidia. The Information reports that Microsoft has been developing the chips in secret since 2019, and some Microsoft and OpenAI employees already have access to them to test how well they perform for the latest large language models like GPT-4.
Nvidia is the key supplier of AI server chips right now, with companies racing to buy up these chips and estimates suggesting OpenAI will need more than 30,000 of Nvidias A100 GPUs for the commercialization of ChatGPT. Nvidias latest H100 GPUs are selling for more than $40,000 on eBay, illustrating the demand for high-end chips that can help deploy AI software.
While Nvidia races to build as many as possible to meet demand, Microsoft is reportedly looking in-house and hoping it can save money on its AI push. Microsoft has reportedly accelerated its work on codename Athena, a project to build its own AI chips. While its not clear if Microsoft will ever make these chips available to its Azure cloud customers, the software maker is reportedly planning to make its AI chips available more broadly inside Microsoft and OpenAI as early as next year. Microsoft also reportedly has a road map for the chips that includes multiple future generations.
Microsofts custom SQ1 processor. Photo by Amelia Holowaty Krales / The Verge
Microsofts own AI chips arent said to be direct replacements for Nvidias, but the in-house efforts could cut costs significantly as Microsoft continues its push to roll out AI-powered features in Bing, Office apps, GitHub, and elsewhere.
Microsoft has also been working on its own ARM-based chips for several years. Bloomberg reported in late 2020 that Microsoft was looking at designing its own ARM-based processors for servers and possibly even a future Surface device. We havent seen those ARM chips emerge yet, but Microsoft hasworked with AMD and Qualcommfor custom chips for its Surface Laptop and Surface Pro X devices.
If Microsoft is working on its own AI chips, it would be the latest in a line of tech giants. Amazon, Google, and Meta also have their own in-house chips for AI, but many companies are still relying on Nvidia chips to power the latest large language models.
More here:
Microsoft reportedly working on its own AI chips that may rival Nvidia's - The Verge
- Deepfake porn could be a growing problem amid AI race - The Associated Press - April 20th, 2023 [April 20th, 2023]
- AI cameras: More than 2 on two-wheelers, even if children, will invite fine - Onmanorama - April 20th, 2023 [April 20th, 2023]
- How artificial intelligence is matching drugs to patients - BBC - April 20th, 2023 [April 20th, 2023]
- These are the tech jobs most threatened by ChatGPT and A.I. - CNBC - April 20th, 2023 [April 20th, 2023]
- Will Generative AI Supplant or Supplement Hollywoods Workforce? - Variety - April 20th, 2023 [April 20th, 2023]
- Marrying Human Interaction and AI with Navid Alipour - Healio - April 20th, 2023 [April 20th, 2023]
- Competition authorities need to move fast and break up AI - Financial Times - April 20th, 2023 [April 20th, 2023]
- 5 AI Projects to Try Right Now - IGN - April 20th, 2023 [April 20th, 2023]
- Financial Services Will Embrace Generative AI Faster Than You Think - Andreessen Horowitz - April 20th, 2023 [April 20th, 2023]
- Grandma exploit tricks Discords AI chatbot into breaking its rules - Polygon - April 20th, 2023 [April 20th, 2023]
- US FTC leaders will target AI that violates civil rights or is deceptive - Reuters - April 20th, 2023 [April 20th, 2023]
- Why open-source generative AI models are an ethical way forward ... - Nature.com - April 20th, 2023 [April 20th, 2023]
- Religion against the machine: Pope Francis takes on AI - Euronews - April 20th, 2023 [April 20th, 2023]
- Fujitsu launches AI platform Fujitsu Kozuchi, streamlining access to ... - Fujitsu - April 20th, 2023 [April 20th, 2023]
- Commonwealth joins forces with global tech organisations to ... - Commonwealth - April 20th, 2023 [April 20th, 2023]
- In this era of AI photography, I no longer believe my eyes - The Guardian - April 20th, 2023 [April 20th, 2023]
- AI is the word as Alphabet and Meta get ready for earnings - MarketWatch - April 20th, 2023 [April 20th, 2023]
- Google CEO Sundar Pichai warns society to brace for impact of A.I. acceleration, says its not for a company to decide' - CNBC - April 20th, 2023 [April 20th, 2023]
- Purdue launches nation's first Institute of Physical AI (IPAI), recruiting ... - Purdue University - April 20th, 2023 [April 20th, 2023]
- We soon wont tell the difference between AI and human music so can pop survive? - The Guardian - April 20th, 2023 [April 20th, 2023]
- Atlassian brings an AI assistant to Jira and Confluence - TechCrunch - April 20th, 2023 [April 20th, 2023]
- How DARPA wants to rethink the fundamentals of AI to include trust - The Register - April 20th, 2023 [April 20th, 2023]
- Dating an AI? Artificial Intelligence dating app founder predicts the future of AI relationships - Fox News - April 20th, 2023 [April 20th, 2023]
- Snapchat expands chatbot powered by ChatGPT to all users, creates AI-generated images - Fox Business - April 20th, 2023 [April 20th, 2023]
- ChatGPT sparks AI investment bonanza - DW (English) - April 20th, 2023 [April 20th, 2023]
- AI-generated spam may soon be flooding your inbox -- and it will be personalized to be especially persuasive - The Conversation - April 20th, 2023 [April 20th, 2023]