Arm Brings Transformers to IoT Devices
By Sally Ward-Foxton, EETimes (May 4, 2024)
NUREMBERG, Germany— The next generation of Arm’s Ethos micro-NPU, Ethos-U85, is designed to support transformer operations, bringing generative AI models to IoT devices. The IP giant is seeing demand for transformer workloads at the edge, according to Paul Williamson, senior VP and general manager for Arm’s IoT line of business, though in much smaller forms than their bigger brothers, large language models (LLMs). For example, Arm has ported vision transformer ViT-Tiny and generative language model TinyLlama-1.1B to the Ethos-U85 so far.
“Most machine learning inferencing is already being done on Arm-powered devices today,” Williamson said. “It may seem like the AI explosion came overnight, but the truth is Arm’s been preparing for this moment for a long time. The benefits of edge AI cut across a whole host of segments within IoT…AI needs tight integration between the hardware and the software, and Arm has invested heavily in the last decade.”
E-mail This Article | Printer-Friendly Page |
|
Arm Ltd Hot IP
Related News
- New AI technology from Arm delivers unprecedented on-device intelligence for IoT
- Interview: Arm's SystemReady 2.0 to Secure IoT Devices
- Arm brings automation to IoT connectivity management
- Arm and Leading Test Laboratories Unveil Independent Security Certification for IoT Devices
- New Arm IP Helps Protect IoT Devices from Increasingly Prevalent Physical Threats
Breaking News
- Frontgrade Gaisler Unveils GR716B, a New Standard in Space-Grade Microcontrollers
- Blueshift Memory launches BlueFive processor, accelerating computation by up to 50 times and saving up to 65% energy
- Eliyan Ports Industry's Highest Performing PHY to Samsung Foundry SF4X Process Node, Achieving up to 40 Gbps Bandwidth at Unprecedented Power Levels with UCIe-Compliant Chiplet Interconnect Technology
- CXL Fabless Startup Panmnesia Secures Over $60M in Series A Funding, Aiming to Lead the CXL Switch Silicon Chip and CXL IP
- Cadence Unveils Arm-Based System Chiplet
Most Popular
- Cadence Unveils Arm-Based System Chiplet
- CXL Fabless Startup Panmnesia Secures Over $60M in Series A Funding, Aiming to Lead the CXL Switch Silicon Chip and CXL IP
- Esperanto Technologies and NEC Cooperate on Initiative to Advance Next Generation RISC-V Chips and Software Solutions for HPC
- Eliyan Ports Industry's Highest Performing PHY to Samsung Foundry SF4X Process Node, Achieving up to 40 Gbps Bandwidth at Unprecedented Power Levels with UCIe-Compliant Chiplet Interconnect Technology
- Arteris Selected by GigaDevice for Development in Next-Generation Automotive SoC With Enhanced FuSa Standards