VMware Collaborates with Intel to Unlock Private AI Everywhere - Seite 2

Boost AI Performance and get a More Secure AI Infrastructure with Lower TCO

VMware Private AI brings compute capacity and AI models to where enterprise data is created, processed, and consumed, whether in a public cloud, enterprise data center, or at the edge, in support of traditional AI/ML workloads and generative AI. VMware and Intel are enabling the fine-tuning of task specific models in minutes to hours and the inferencing of large language models at faster than human communication using the customer’s private corporate data. VMware and Intel now make it possible to fine-tune smaller, economical state of the art models which are easier to update and maintain on shared virtual systems, which can then be delivered back to the IT resource pool when the batch AI jobs are complete. Use cases such as AI-assisted code generation, experiential customer service centers recommendation systems, and classical machine statistical analytics can now be co-located on the same general purpose servers running the application.

VMware and Intel are designing a reference architecture that combines Intel’s AI software suite, Intel Xeon processors, and Data Center GPUs with VMware Cloud Foundation to enable customers to build and deploy private AI models on the infrastructure they have, thereby reducing total cost of ownership and addressing concerns of environmental sustainability. This VMware Private AI reference architecture with Intel AI will include:

• 4th Gen Intel Xeon processors with Intel Advanced Matrix Extensions (Intel AMX) deliver up to 10x significant out-of-box performance improvements using standard industry frameworks and libraries, end-to-end data science productivity tools, and optimized AI models.
• Intel Data Center GPU Max contains up to 128 Xe cores and is Intel’s foundational GPU compute building block targeted at the most demanding AI workloads. Intel Max Series GPUs will be available in several form factors to address different customer needs.
• Intel’s AI software suite is packaged with end-to-end open source software and optional licensing components to enable developers to run full AI pipeline workflows from data preparation to fine-tuning to inference, accelerate building multi-node scaling and deploying AI on enterprise IT infrastructure. The open oneAPI framework enables processors and hardware accelerator-agnostic software development, allowing developers to write code once and run it across different architectures, eliminating the need for multiple code bases and specialized languages. Intel’s Transformer Extensions and PyTorch Extension’s deep integration with developer favorite open source Hugging Face libraries provide automated optimization recipes for fine-tuning and compressing models for efficient inference.

VMware Cloud Foundation brings consistent enterprise-class infrastructure, operational simplicity, and enhanced security to VMware Private AI through capabilities such as: