ACAP HDR Image Signal Processing Framework

Overview

The ACAP HDR Image Signal Processing Framework is intended to showcase a complete logicBRICKS IP suite implementation of High-Dynamic Range (HDR) Image Signal Processing (ISP) pipeline in an embedded design based on AMD-Xilinx ACAP programmable devices. The HDR ISP pipeline enables crisp camera video under altering and rough lighting conditions in next generation multi-channel embedded systems for use in automotive, surveillance, medical, aerospace and similar video and vision AI applications.

The logicBRICKS logiISP-UHD IP core enables parallel processing of multiple Ultra HD video inputs in different AMD-Xilinx devices, ranging from the small AMD-Xilinx Artix FPGAs to the latest AMD-Xilinx Versal Adaptive Compute Acceleration Platform (ACAP) devices. The design showcases how to connect high-quality inputs from automotive-grade cameras to on-board post-processing solutions or feed the stream to hardware-accelerated integrated neural networks running on this adaptive computing acceleration platform.

Key IP cores, the logiISP-UHD ISP and the logiHDR pipelines, support parallel processing of multiple video inputs, resolutions up to 7680x7680 (including the popular 4K2Kp60 video resolution), merging of two or three exposures, parallel pixel processing and different pixel formats. These IP cores for programmable logic implementations are supplemented with AWB and AE software libraries that use video statistics data collected at video inputs, software drivers, demo applications, reference SoC/ACAP designs, and bit-accurate C models.

The design framework implements three parallel video inputs from three 7.4Mpix Leopard Imaging IMX424 GMSL2 video cameras and the UHD display output. All video inputs are stored in the video memory, and by mean of on-board push buttons, the user can select each of them for the single camera or all cameras full screen display.

Key Features

  •  
  • Complete ACAP HDR Image Signal Processing framework for multi-camera embedded applications with three 7.4MP (Ultra High Definition) video inputs from automotive video cameras
  • Delivered as a part of Xylon’s logiVID-ACAP-ISP evaluation kit
  • Enables vision developers to quickly add their own algorithms to the provided infrastructure
  • Jump-starts development and saves valuable design time
  • Intended for use with next generation Maxim Integrated GMSL2 high-speed serial interface
  • Fully compatible with Xylon’s logiVID-ACAP-ISP HDR ISP evaluation kit based on the AMD-Xilinx Versal VCK190 Evaluation Board
  • Includes licensed logicBRICKS IP cores
  • Design prepared for the following environment:
    • AMD-Xilinx Vivado Design Suite 2021.2
    • AMD-Xilinx Vitis Unified Software Platform
  • Runs on Linux OS and includes logicBRICKS software drivers and demo applications
  • HDMI display output with the AMD-Xilinx HDMI 1.4/2.0 Transmitter Subsystem2 controlled via Xylon’s DRM kernel driver
  • Prepared for use with Sony LI-IMX424-GMSL2 Camera with the Sony IMX424 Image Sensor
  • Design can easily be adapted for use with other UHD cameras
  • Input video resolution: 3840x1920@30, Output video resolution: 3840x2160@30
  • Full evaluation version available on request
  • Documentation and Tech support (e-mail)

Block Diagram

ACAP HDR Image Signal Processing Framework Block Diagram

Applications

  • Machine Vision and other vision applications,
  • AR/VR,
  • AD/ADAS,
  • AI,
  • guided robotics,
  • drones etc

Technical Specifications

×
Semiconductor IP