Infinite-ISP FPGA Release v1.5 for Efinix Titanium Ti180 J484 Development Kit and Xilinx Kria KV260 Vision AI Starter Kit
What's New
- FPGA Binaries for Efinix Titanium Ti180 J484 Development Kit
- Auto-Exposure Firmware implementation to incorporate full-control and adjustment of:
- sensor integration time
- sensor gains
- ISP gain
Both Kria and Ti180 FPGA kits now support automatic exposure adjustment for indoor and outdoor imaging!
Image Sensor support:
IMX219 image sensor module
- IMX219 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
- can use Raspberry Pi Camera Module Rev 2.x
AR1335 IAS module
- included in Xilinx Kria KV260 Accessory Pack)
- AR1335 IAS module to be attached to Kria KV260 IAS1 port
OV5647 image sensor module
- OV5647 image sensor module to be attached to Kria KV260 RPi port (15-pin Raspberry Pi CSI-2 connector)
- can use Raspberry Pi Camera Module Rev 1.3
Infinite-ISP Features for Efinix Titanium Ti180 (Infinite-ISP_v1.5-IMX219.hex):
- 10-bit ISP pipeline
- 2M 1952x1112 input RAW image
- Supported output resolutions at 20 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 20 fps frame rate supported (as sourced by image sensor)
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (efinix_rgb_conversion.py, efinix_raw_conversion.py)
- 2A Algorithms (AE, AWB) supported in this version
- By default, the ISP is tuned for indoor applications
- User guide for Infinite ISP configuration menu can be found at link
Scripts | Description |
---|---|
sd_reader_raw_ispout_pair.sh | extract the image sensor memory dump data from the SD Card. |
efinix_rgb_conversion.py | converts the RGB output memory dump (.bin) data from the FPGA Platform to output image frame (.png) as well as output pixel data frame (.bin) for verification. |
efinix_raw_conversion.py | converts the image sensor memory dump (.bin) of RAW Burst Capture from the FPGA Platform to Bayer RAW frames (.raw) containing valid pixel data. |
Infinite-ISP Features for Xilinx Kria KV260 (Infinite-ISP_v1.5-IMX219.bin):
- 10-bit ISP pipeline
- 5M 2592x1944 input RAW image
- Supported output resolutions at 20 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 20 fps frame rate supported (as sourced by image sensor)
- YUV output (YUV444) from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this version
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
Infinite-ISP Features for Xilinx Kria KV260 (Infinite-ISP_v1.5-AR1335.bin):
- 10-bit ISP pipeline
- 3M 2048x1536 input RAW image
- Supported output resolutions at 30 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 30 fps frame rate supported
- RGB output from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this release
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
Infinite-ISP Features for Xilinx Kria KV260 (Infinite-ISP_v1.5-OV5647.bin):
- 10-bit ISP pipeline
- 5M 2592x1944 input RAW image
- Supported output resolutions at 15 fps:
- 1920x1080 (16:9 cropped, no downscaling)
- 640x480 (4:3 downscaled from 1920x1080)
- 640x360 (16:9 downscaled from 1920x1080)
- 1920x1440 (4:3 cropped, no downscaling)
- 960x720 (4:3 downscaled from 1920x1440)
- 640x480 (4:3 downscaled from 1920x1440)
- 15 fps frame rate supported (as sourced by image sensor)
- YUV output (YUV444) from ISP configured
- HDMI video output support for 1080p resolution
- External image visualization scripts provided (isp_output_bin_to_isp_output_png.py, sensor_bin_to_sensor_raw.py)
- External video visualization scripts provided (video_creation.py)
- 2A Algorithms (AE, AWB) supported in this version
- By default, the ISP is tuned for indoor applications
- Serial terminal based Infinite-ISP configuration menu added in this version, the menu provides support for:
- ISP Parameter Configuration; DPC, BLC, CCM CSC, IRC and SCALE
- Sensor Analog Gain, Digital Gain & Exposure Control
- Sensor RAW & ISPout Burst Capture Pairs with programmable post-trigger delay
- Fully configurable downscaled output stream with both 16:9 and 4:3 aspect ratios
- User guide for Infinite ISP configuration menu can be found at link
For ISP tuning, features and further information, please open a GitHub Issue or Contact: info@10xengineers.ai