Primate Labs has launched Geekbench AI, a new tool aimed at evaluating the performance of AI CPUs, GPUs, and NPUs. Previously known as Geekbench ML, The updated and rebranded instrument intends to offer an in-depth analysis of AI processing across different hardware configurations.
The Ascendancy of NPUs in Contemporary Devices
Neural Processing Units (NPUs) have evolved from niche applications in mobile devices to crucial elements in PCs. Leading manufacturers such as Intel and AMD are now integrating NPUs to manage tasks including generative AI, image processing, and chatbot capabilities. As such, gauging NPU performance has become pivotal for consumers looking to make informed tech purchases.
Geekbench AI is compatible with a variety of AI frameworks like OpenVINO for Windows and Linux, ONNX for Windows, Qualcomm's QNN for Snapdragon-powered Arm PCs, Apple's CoreML for macOS and iOS, and multiple vendor-specific frameworks on Android. The benchmark is capable of executing AI tasks on CPUs, GPUs, or NPUs, assuming the system includes an NPU. Currently, Geekbench AI is compatible with Intel and Qualcomm NPUs on Windows PCs, with AMD support expected in future updates.
Evaluating Speed and Precision
The benchmark measures both the speed and accuracy of AI tasks. Such dual metrics are essential for functions that depend on reliable outcomes, like identifying and categorizing objects in photo collections. John Poole of Primate Labs highlighted that Geekbench AI summarizes performance for various tasks using single-precision, half-precision, and quantized data, mirroring the diverse precision requirements in AI systems.
Geekbench AI is available on platforms including Windows, macOS, Linux, iOS/iPadOS, and Android. Users can access the tool for free, but a Pro license offers additional features like command-line tools and the capability to run benchmarks without uploading results to the Geekbench Browser. Primate Labs plans to frequently update the application to support new hardware, frameworks, and workloads.
Formerly known as Geekbench ML, the latest 1.0 version of Geekbench AI represents a major advancement in Primate Labs' benchmark tools. The new name underscores the expanded scope, encompassing detailed evaluations across diverse platforms and hardware setups.
