TL;DR
Intel and AMD have announced the release of ACE, a new set of CPU extensions designed to optimize AI tasks. These extensions leverage existing AVX10 registers and add dedicated matrix multiplication silicon, promising better efficiency and easier development for AI workloads on x86 CPUs.
Intel and AMD have announced the release of the ACE CPU extensions, a new technical standard aimed at improving AI workload efficiency on x86 processors. This development is significant as it enables more power-efficient and streamlined AI processing directly on CPUs, which is critical for applications that do not rely on GPUs or require low latency. The extensions leverage existing AVX10 registers and introduce dedicated silicon for matrix multiplication, promising substantial improvements in performance and development simplicity.
The ACE extensions are designed to enhance the capabilities of current x86 processors by providing dedicated hardware for matrix multiplication, a core operation in AI workloads. They utilize the AVX10 instruction set, which already supports 512-bit data inputs, allowing seamless integration with existing CPU designs. According to Tom’s Hardware, this enables up to 16 times more operations per cycle compared to previous AVX10 instructions, although actual speedups depend on implementation.
Both Intel and AMD have specified that ACE supports a wide range of data types used in machine learning, including INT8, INT32, FP8, FP16, FP32, and BF16. It also supports formats from the Open Compute Project, such as MX block-scaled formats. The extensions aim to simplify development for ML frameworks like PyTorch and TensorFlow, enabling a single code path that works across hardware without hardware-specific modifications. Developers will also be able to shift certain workloads from NPUs back to CPUs, increasing flexibility and efficiency in AI processing.
Potential Impact of ACE on AI Processing
The introduction of ACE could significantly influence AI workloads by making CPU-based processing more viable for tasks traditionally handled by GPUs or specialized accelerators. Its power efficiency and simplified development could lead to broader adoption in data centers, edge devices, and consumer hardware. This shift might reduce reliance on dedicated AI hardware, lowering costs and increasing flexibility for developers and enterprises. Moreover, as both Intel and AMD dedicate more silicon to these instructions in future designs, performance improvements are expected, further expanding AI capabilities on mainstream processors.
Dell Tower Desktop Computer Intel Ultra 7 265F RTX 5060 32GB 1TB Win 11 Pro
- Processor: Intel Ultra 7 265F 20-Core AI CPU
- Graphics Card: NVIDIA GeForce RTX 5060 8GB
- Memory: 32GB RAM
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Background on AI Acceleration and CPU Developments
Traditionally, AI processing has been dominated by GPUs and specialized accelerators due to their high parallelism and performance. CPUs, however, have played a secondary role, mainly handling less demanding or latency-sensitive tasks. Recent years have seen efforts to enhance CPU capabilities for AI, including AVX and AVX10 instruction sets that support vectorized operations. The development of ACE builds on this foundation, aiming to optimize matrix multiplication, which underpins many AI algorithms. Prior to this, efforts to improve CPU-based AI processing have been limited by the lack of dedicated hardware for these operations, leading to the current focus on new instruction set extensions.
“The ACE extensions represent a significant step toward making CPUs more competitive for AI workloads, especially in scenarios where power efficiency and development simplicity are priorities.”
— an anonymous researcher
x86 CPU with AI matrix multiplication extensions
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Unanswered Questions About ACE Performance and Adoption
It is not yet clear how quickly hardware manufacturers will integrate ACE into their future processors or the actual performance gains in real-world applications. The extent to which ACE will replace or complement existing AI accelerators remains uncertain, as does its impact on current AI software ecosystems. Additionally, detailed benchmarks and developer adoption rates are still to be observed, making the full scope of ACE’s influence uncertain at this stage.
Intel® Celeron G-5900 Desktop Processor 2 Cores 3.4 GHz LGA1200 (Intel® 400 Series chipset) 58W, Model Number: BX80701G5900
- Processor Model: Intel Celeron G-5900
- Number of Cores: 2 Cores
- Number of Threads: 2 Threads
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Next Steps for Hardware Integration and Software Support
Manufacturers are expected to incorporate ACE into upcoming CPU architectures, with first implementations anticipated in future product lines. Software developers will likely begin optimizing frameworks for ACE, and early benchmarks will provide more clarity on performance gains. Industry analysts will monitor hardware adoption and software ecosystem support to assess how broadly ACE influences AI processing on x86 platforms. Further announcements from Intel and AMD are expected in the coming months, detailing implementation timelines and performance metrics.
Local AI Engineering with Ollama: Run, understand, customize, fine-tune, and build agentic apps on your own hardware
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Key Questions
How does ACE improve AI processing on CPUs?
ACE introduces dedicated silicon for matrix multiplication and leverages existing AVX10 registers, enabling more operations per cycle with better power efficiency. It also supports multiple data types used in machine learning, simplifying development and improving performance.
Will ACE replace GPUs for AI workloads?
It is unlikely that ACE will fully replace GPUs, but it may reduce reliance on dedicated accelerators for certain tasks, especially latency-sensitive or smaller-scale AI operations on CPUs.
When will new CPUs with ACE be available?
Manufacturers are expected to include ACE in upcoming processor generations, with specific product timelines yet to be announced. Industry insiders anticipate early implementations within the next year.
What data types does ACE support?
ACE supports a wide range of data types, including INT8, INT32, FP8, FP16, FP32, and BF16, as well as formats from the Open Compute Project like MX block-scaled formats.
Source: Tom’s Hardware: For The Hardcore PC Enthusiast
