Arm Brings Transformers to IoT Devices
By Sally Ward-Foxton, EETimes (May 4, 2024)
NUREMBERG, Germany— The next generation of Arm’s Ethos micro-NPU, Ethos-U85, is designed to support transformer operations, bringing generative AI models to IoT devices. The IP giant is seeing demand for transformer workloads at the edge, according to Paul Williamson, senior VP and general manager for Arm’s IoT line of business, though in much smaller forms than their bigger brothers, large language models (LLMs). For example, Arm has ported vision transformer ViT-Tiny and generative language model TinyLlama-1.1B to the Ethos-U85 so far.
“Most machine learning inferencing is already being done on Arm-powered devices today,” Williamson said. “It may seem like the AI explosion came overnight, but the truth is Arm’s been preparing for this moment for a long time. The benefits of edge AI cut across a whole host of segments within IoT…AI needs tight integration between the hardware and the software, and Arm has invested heavily in the last decade.”
To read the full article, click here
Related Semiconductor IP
- Rad-Hard GPIO, ODIO & LVDS in SkyWater 90nm
- 1.22V/1uA Reference voltage and current source
- 1.2V SLVS Transceiver in UMC 110nm
- 1.8V/3.3V GPIO With I2C Compliant ODIO in GF 55nm
- Verification IP for UALink
Related News
- Arm Accelerates Edge AI with Latest Generation Ethos-U NPU and New IoT Reference Design Platform
- Arm Collaborates with Microsoft on Custom Silicon to Unlock Sustainable, AI-Driven Infrastructure
- Bringing Arm TCS23 to Life on Next-gen Flagship Smartphones with MediaTek and vivo
- Insyde Software Becomes the First Independent BIOS Vendor to Achieve Arm SystemReady SR-SIE Certification for the NVIDIA GH200 Grace Hopper Superchip Platform
Latest News
- EXTOLL received GlobalFoundries Award for “Interface IP Partner of the Year”
- AiM Future and Franklin Wireless Sign MOU to Jointly Develop Lightweight AI Model and High-Efficiency 1 TOPS AI SoC Chipset
- GlobalFoundries and Silicon Labs Partner to Scale Industry-Leading Wi-Fi Connectivity
- GlobalFoundries Announces Availability of 22FDX+ RRAM Technology for Wireless Connectivity and AI Applications
- GlobalFoundries Announces Production Release of 130CBIC SiGe Platform for High-Performance Smart Mobile, Communication and Industrial Applications