Skip to content

Infinite-ISP v1.5

Latest
Compare
Choose a tag to compare
@mfaizan-10xe mfaizan-10xe released this 20 Dec 11:23
· 1 commit to main since this release
9528dd3

Infinite-ISP FPGA Release v1.5 for Efinix Titanium Ti180 J484 Development Kit and Xilinx Kria KV260 Vision AI Starter Kit

What's New

  • FPGA Binaries for Efinix Titanium Ti180 J484 Development Kit
  • Auto-Exposure Firmware implementation to incorporate full-control and adjustment of:
    • sensor integration time
    • sensor gains
    • ISP gain

Both Kria and Ti180 FPGA kits now support automatic exposure adjustment for indoor and outdoor imaging!

Image Sensor support:

IMX219 image sensor module

  • IMX219 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
  • can use Raspberry Pi Camera Module Rev 2.x

AR1335 IAS module

  • included in Xilinx Kria KV260 Accessory Pack)
  • AR1335 IAS module to be attached to Kria KV260 IAS1 port

OV5647 image sensor module

  • OV5647 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
  • can use Raspberry Pi Camera Module Rev 1.3

Infinite-ISP Features for Efinix Titanium Ti180 (Infinite-ISP_v1.5-IMX219.hex):

  • 10-bit ISP pipeline
  • 2M 1952x1112 input RAW image
  • Supported output resolutions at 20 fps:
    • 1920x1080 (16:9 cropped, no downscaling)
  • 20 fps frame rate supported (as sourced by image sensor)
  • HDMI video output support for 1080p resolution
  • External image visualization scripts provided (efinix_rgb_conversion.py, efinix_raw_conversion.py)
  • 2A Algorithms (AE, AWB) supported in this version
  • By default, the ISP is tuned for indoor applications
  • User guide for Infinite ISP configuration menu can be found at link
Scripts Description
sd_reader_raw_ispout_pair.sh extract the image sensor memory dump data from the SD Card.
efinix_rgb_conversion.py converts the RGB output memory dump (.bin) data from the FPGA Platform to output image frame (.png) as well as output pixel data frame (.bin) for verification.
efinix_raw_conversion.py converts the image sensor memory dump (.bin) of RAW Burst Capture from the FPGA Platform to Bayer RAW frames (.raw) containing valid pixel data.

Infinite-ISP Features for Xilinx Kria KV260 (Infinite-ISP_v1.5-IMX219.bin):

  • 10-bit ISP pipeline
  • 5M 2592x1944 input RAW image
  • Supported output resolutions at 20 fps:
    • 1920x1080 (16:9 cropped, no downscaling)
    • 640x480 (4:3 downscaled from 1920x1080)
    • 640x360 (16:9 downscaled from 1920x1080)
    • 1920x1440 (4:3 cropped, no downscaling)
    • 960x720 (4:3 downscaled from 1920x1440)
    • 640x480 (4:3 downscaled from 1920x1440)
  • 20 fps frame rate supported (as sourced by image sensor)
  • YUV output (YUV444) from ISP configured
  • HDMI video output support for 1080p resolution
  • External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
  • External video visualization scripts provided (video_creation.py)
  • 2A Algorithms (AE, AWB) supported in this version
  • By default, the ISP is tuned for indoor applications
  • Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
    • ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
    • Sensor Analog Gain, Digital Gain & Exposure Control
    • Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
    • Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
  • User guide for Infinite ISP configuration menu can be found at link

Infinite-ISP Features for Xilinx Kria KV260 (Infinite-ISP_v1.5-AR1335.bin):

  • 10-bit ISP pipeline
  • 3M 2048x1536 input RAW image
  • Supported output resolutions at 30 fps:
    • 1920x1080 (16:9 cropped, no downscaling)
    • 640x480 (4:3 downscaled from 1920x1080)
    • 640x360 (16:9 downscaled from 1920x1080)
    • 1920x1440 (4:3 cropped, no downscaling)
    • 960x720 (4:3 downscaled from 1920x1440)
    • 640x480 (4:3 downscaled from 1920x1440)
  • 30 fps frame rate supported
  • RGB output from ISP configured
  • HDMI video output support for 1080p resolution
  • External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
  • External video visualization scripts provided (video_creation.py)
  • 2A Algorithms (AE, AWB) supported in this release
  • By default, the ISP is tuned for indoor applications
  • Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
    • ISP Parameter Configuration
    • Sensor Analog Gain, Digital Gain & Exposure Control
    • Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
    • Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
  • User guide for Infinite ISP configuration menu can be found at link

Infinite-ISP Features for Xilinx Kria KV260 (Infinite-ISP_v1.5-OV5647.bin):

  • 10-bit ISP pipeline
  • 5M 2592x1944 input RAW image
  • Supported output resolutions at 15 fps:
    • 1920x1080 (16:9 cropped, no downscaling)
    • 640x480 (4:3 downscaled from 1920x1080)
    • 640x360 (16:9 downscaled from 1920x1080)
    • 1920x1440 (4:3 cropped, no downscaling)
    • 960x720 (4:3 downscaled from 1920x1440)
    • 640x480 (4:3 downscaled from 1920x1440)
  • 15 fps frame rate supported (as sourced by image sensor)
  • YUV output (YUV444) from ISP configured
  • HDMI video output support for 1080p resolution
  • External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
  • External video visualization scripts provided (video_creation.py)
  • 2A Algorithms (AE, AWB) supported in this version
  • By default, the ISP is tuned for indoor applications
  • Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
    • ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
    • Sensor Analog Gain, Digital Gain & Exposure Control
    • Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
    • Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
  • User guide for Infinite ISP configuration menu can be found at link

For ISP tuning, features and further information, please open a GitHub Issue or Contact: info@10xengineers.ai