Intel has launched the Xeon 6 processors and Gaudi 3 AI Accelerators, enhancing artificial intelligence (AI) workflows for enterprise customers and data centres.
The company revealed these developments on Tuesday, stating that the new hardware aims to improve throughput and cost efficiency, ensuring better performance per watt and a reduced total cost of ownership.
Intel Xeon 6 Processor Unveiled
Intel’s latest Xeon 6 processor, equipped with new performance cores (P-cores), is designed specifically for data centres, not retail consumers. It powers cloud servers, helping enterprises manage more demanding workloads.
Intel reports that the Xeon 6 processor delivers twice the performance of its predecessor due to a higher core count. It also doubles the memory bandwidth and enhances AI acceleration capabilities. The processor efficiently supports large language models (LLMs), meeting AI performance demands from edge computing to data centres and cloud environments.
Launch of Intel Gaudi 3 AI Accelerators
The Gaudi 3 represents Intel’s newest generation of AI Accelerators, specifically engineered to boost AI operations, particularly deep learning, machine learning, and neural networks. This includes support for GPUs, ASICs, FPGAs, and NPUs.
The Gaudi 3 features 64 Tensor processor cores and eight matrix multiplication engines (MMEs) designed to fast-track deep neural network calculations. It has 128GB of HBM2e memory suitable for training and inference tasks and 24 200GB Ethernet ports to facilitate server scalability.
Intel’s AI Accelerator is compatible with the PyTorch framework and supports advanced Hugging Face transformer and diffuser models. The company has partnered with IBM to integrate Gaudi 3 into IBM Clouds and collaborates with Dell Technologies, which uses the infrastructure in its data centres.
