From Tom's Hardware: MemryX, a technology start-up originating from the University of Michigan, has launched a $149 M.2 module [PDF] designed to provide efficient AI processing capabilities for compact computing systems. The module targets edge computing applications, where power efficiency and compact design are critical.
Packing four MemryX MX3 AI accelerator chips onto a standard M.2 2280 form factor, enables the module to be easily integrated into systems equipped with a PCIe Gen 3 M.2 slot. Each MX3 chip is said to deliver 6 TOPS (Tera Operations Per Second), offering a total of up to 24 TOPS of compute power while consuming just 6 to 8 watts of power. It also supports a range of data formats, including 4-bit, 8-bit, 16-bit weights, and BFloat16. Notably, the module operates without active cooling, relying on an included passive heatsink to manage thermal performance.
Phoronix has tested the MemryX MX3 M.2 module, evaluating its performance and usability as an AI accelerator. Installed in a system with an M.2 PCIe Gen 3 slot running Ubuntu 24.04 LTS, the module proved straightforward to integrate thanks to MemryX's open-source drivers and developer tools. The module's 24 TOPS performance from its four MemryX MX3 chips is said to be sufficient for various inference workloads, particularly those optimized for 8-bit weights.
View: Full Article
