AI Accelerator: Neural Network-specific Optimized 1 TOPS

Overview

The Expedera Origin™ E1 is a family of Artificial Intelligence (AI) processing cores individually optimized for a subset of neural networks commonly used in home appliances, edge nodes, and other small consumer devices. Products like these require optimized AI inference that minimizes power consumption, silicon area and system cost. Through careful attention to processor utilization and eliminating the need for external memory, the Origin E1 saves area and system power while optimizing performance and reducing latency. The E1 cores offer 1 TOPS performance for a variety of networks.

While there are many general-purpose Neural Processing Units (NPUs), a one-size-fits-all solution is rarely the most efficient. By optimizing the E1 for specific neural networks, Expedera can significantly reduce NPU area and power—essential in cost- and power-constrained devices.

The Origin E1 family supports combinations of many common neural networks, including ResNet 50 V1, EfficientNet, NanoDet, Tiny YOLOv3, MobileNet V1, MobileNet SSD, BERT, CenterNet, Unet, and many others.

Key Features

  • Performance efficient 18 TOPS/Watt
  • Capable of processing real-time HD video and images on-chip
  • Advanced activation memory management
  • Low latency
  • Tunable for specific workloads
  • Hardware scheduler for NN
  • Support for standard NN functions including Convolution, Deconvolution, FC, Activations, Reshape, Concat, Elementwise, Pooling, Softmax, Bilinear
  • Processes model as trained, no need for software optimizations
  • Use familiar open-source platforms like TFlite
  • Delivered as soft IP: portable to any process

Benefits

  • Industry-leading 18 TOPS/W enables greater processing efficiencies with lower power consumption
  • Eliminates complicated compilers, easing design complexity, reducing cost, and speeding time-to-market
  • Independently configurable building blocks allow for design optimization– right sized deployments
  • Deterministic, QoS
  • Deployability:
  • Best-in-market TOPS/mm2 assures ideal processing/chip size designs

Applications

  • Home Appliances
  • Smartphone
  • Consumer Electronics
  • Handheld devices

Deliverables

  • RTL -or- GDS
  • Documentation
  • SDK (TVM based)

Technical Specifications

Maturity
In production
Availability
Production
×
Semiconductor IP