AceleradorSNN: A Neuromorphic Cognitive System Integrating Spiking Neural Networks and Dynamic Image Signal Processing on FPGA
By Daniel Gutierrez, Ruben Martinez, Leyre Arnedo, Antonio Cuesta, Soukaina El Hamry
Intigia R&D Department, Alicante, Spain
Abstract
The demand for high-speed, low-latency, and energy-efficient object detection in autonomous systems—such as advanced driver-assistance systems (ADAS), unmanned aerial vehicles (UAVs), and Industry 4.0 robotics—has exposed the limitations of traditional Convolutional Neural Networks (CNNs). To address these challenges, Intigia has developed AceleradorSNN, a third-generation artificial intelligence cognitive system. This architecture integrates a Neuromorphic Processing Unit (NPU) based on Spiking Neural Networks (SNNs) to process asynchronous data from Dynamic Vision Sensors (DVS), alongside a dynamically reconfigurable Cognitive Image Signal Processor (ISP) for RGB cameras. This paper details the hardware-oriented design of both IP cores, the evaluation of surrogate-gradient-trained SNN backbones, and the real-time streaming ISP ar chitecture implemented on Field-Programmable Gate Arrays (FPGA).
Index Terms
Spiking Neural Networks, FPGA, Dynamic Vi sion Sensor, Image Signal Processor, Neuromorphic Computing, Artificial Intelligence.
To read the full article, click here
Related Semiconductor IP
- NPU
- RISC-V-Based, Open Source AI Accelerator for the Edge
- NPU IP for Embedded ML
- Highly scalable inference NPU IP for next-gen AI applications
- Scalable Edge NPU IP for Generative AI
Related Articles
- SNAP-V: A RISC-V SoC with Configurable Neuromorphic Acceleration for Small-Scale Spiking Neural Networks
- Generic and Automatic Specman based Verification Environment for Image Signal Processing IPs
- Using parallel FFT for multi-gigahertz FPGA signal processing
- Input-Triggered Hardware Trojan Attack on Spiking Neural Networks
Latest Articles
- Vectorizing Quantum Control: A RISC-V Vector Extension Architecture for Scalable Qubit Systems
- FlexViT: A Flexible FPGA-based Accelerator for Edge Vision Transformers
- LIB-TRAP: Standard Cell Library Hardware Trojan Risk Assessment and Prevention
- Exploring Side-Channel Protections in Hardware Implementations of PQC ML-KEM Verification
- CVA6-RT: an Open-Source Time-Predictable RV64 Processor for Mixed-Criticality Systems