Intel and IBM Introduce Gaudi 3 AI Accelerator to IBM Cloud to Help Scale Enterprise AI
What's new: IBM and Intel announced a collaboration to bring Intel® Gaudi® 3 AI accelerators as a service on IBM Cloud. The service, expected to be available in early 2025, is aimed at cost-effectively extending enterprise AI and driving innovation backed by security and resilience. The collaboration also enables support for Gaudi 3 within IBM's watsonx AI and data platform. IBM Cloud is the first cloud service provider (CSP) to adopt Gaudi 3, and the service will be available for both hybrid and on-premise environments.
“Unleashing the full potential of AI requires an open, collaborative ecosystem that gives customers choice and accessible solutions,” said Justin Hotard, executive vice president and general manager, Intel Data Center and AI. “By integrating our Gaudi 3 AI accelerators and Xeon CPUs with IBM Cloud, we are creating new AI capabilities to meet the demand for affordable, secure and innovative AI computing solutions.”
Why it matters: Generative AI has the potential to accelerate transformation, but the computing power required makes it clear that availability, performance, cost, energy efficiency and security are top priorities for enterprises. Through this collaboration, Intel and IBM aim to lower the total cost of ownership to leverage and scale AI while improving performance. Gaudi 3, integrated with 5th Gen Xeon, supports enterprise AI workloads in the cloud and data center, giving clients visibility and control of their software stack and simplifying workload and application management. IBM Cloud and Gaudi 3 aim to enable clients to scale enterprise AI workloads more cost-effectively while prioritizing performance, security and resiliency.
For generative AI inference workloads, IBM plans to enable support for Gaudi 3 within IBM's watsonx AI and data platform, giving watsonx clients additional AI infrastructure resources to scale AI workloads across hybrid cloud environments and optimizing price and performance for model inference.
“IBM is committed to helping our clients drive AI and hybrid cloud innovation by delivering solutions that meet their business needs. IBM Cloud's commitment to security and resiliency helps drive our hybrid cloud and AI strategies for IBM's enterprise clients,” said Alan Peacock, general manager, IBM Cloud. “By leveraging Intel's Gaudi 3 accelerators on IBM Cloud, we can provide our clients with flexible enterprise AI solutions that aim to optimize cost performance. We are opening up potential new AI business opportunities designed to help our clients test, innovate and deploy AI inference solutions more cost-effectively.”
How it works: IBM and Intel are working together to help clients across industries, including highly regulated ones, leverage IBM Cloud security and compliance capabilities to deliver Gaudi 3 services, making AI more accessible to businesses.
Scalability and flexibility: IBM Cloud and Intel offer a scalable, flexible solution that allows clients to adjust computing resources as needed, potentially resulting in cost savings and operational efficiency. Enhanced performance and security: By integrating Gaudi 3 into IBM Cloud Virtual Servers for VPC, x86-based businesses can run applications faster and more securely than before the integration, resulting in an improved user experience.
What's next: Intel and IBM have a long-standing collaboration, from developing the IBM PC to creating enterprise AI solutions with Gaudi 3. IBM Cloud with Gaudi 3 is expected to be generally available in early 2025. Stay tuned for more updates from Intel and IBM in the coming months.
For more information on Intel Gaudi 3 accelerators, please visit https://www.intel.com/content/www/us/en/products/details/processors/ai-accelerators/gaudi3.html.