Paul Williamson on Edge AI, Llama 3.2 on Arm
By Nitin Dahad, EETimes (September 27, 2024)
EE Times caught up with Paul Williamson, senior VP and general manager of the IoT business for Arm, for an exclusive virtual interview after his keynote talk at the Edge Impulse Imagine conference in Mountain View, Calif., this week.
During the interview, Williamson provided an overview of his talk at the Edge Impulse event. He then touched on examples of edge AI and why it is all about small language models (SLMs) trained for specific tasks at the edge. “The edge is increasingly about expert systems rather than large generic models,” Williamson said.
He helped answered the question, “How do we make edge AI real in real world applications?” and discussed the significance of the other announcement Arm made this week: the company’s collaboration with Meta to enable Llama 3.2 LLMs on Arm CPUs.
To read the full article, click here
Related Semiconductor IP
- Process/Voltage/Temperature Sensor with Self-calibration (Supply voltage 1.2V) - TSMC 3nm N3P
- USB 20Gbps Device Controller
- SM4 Cipher Engine
- Ultra-High-Speed Time-Interleaved 7-bit 64GSPS ADC on 3nm
- Fault Tolerant DDR2/DDR3/DDR4 Memory controller
Related News
- Edge Impulse Deploys its State-of-the-Art Edge AI Models to Arm Microcontrollers Tools
- Arm Accelerates Edge AI with Latest Generation Ethos-U NPU and New IoT Reference Design Platform
- Arm Accelerates AI From Cloud to Edge With New PyTorch and ExecuTorch Integrations to Deliver Immediate Performance Improvements for Developers
- RaiderChip brings Meta Llama 3.2 LLM HW acceleration to low cost FPGAs
Latest News
- Cassia Proposes ‘Better Math’ for AI Efficiency
- QuickLogic Announces $1M eFPGA Hard IP Contract for Data Center ASIC
- Creonic Updates Doppler Channel IP Core with Extended Frequency Band and Sampling Range
- TSMC Price Hikes End the Era of Cheap Transistors
- Analogue Insight IP Group Launches Analogue Insight SAFE in Portland, Oregon to Deliver Certification-Grade Security IP for Next-Gen SoCs and Chiplets