Point-LIO (If you have problems with the formal commits, please try the newest commit first, several modifications have be made in newest commit for wider adaptivity)
Point-LIO: Robust High-Bandwidth Lidar-Inertial Odometry (Pay attention to modifying the parameters for IMU in .yaml file, according to the IMU you use.)
New features:
- would not fly under degeneration.
- high odometry output frequency, 4k-8kHz.
- robust to IMU saturation and severe vibration, and other aggressive motions (75 rad/s in our test).
- no motion distortion.
- computationally efficient, robust, versatile on public datasets with general motions.
- As an odometry, Point-LIO could be used in various autonomous tasks, such as trajectory planning, control, and perception, especially in cases involving very fast ego-motions (e.g., in the presence of severe vibration and high angular or linear velocity) or requiring high-rate odometry output and mapping (e.g., for high-rate feedback control and perception).
Important notes:
A. Please make sure the IMU and LiDAR are Synchronized, that's important.
B. Please obtain the saturation values of your used IMU (i.e., accelerator and gyroscope), and the units of the accelerator of your used IMU, then modify the .yaml file according to those settings, including values of 'satu_acc', 'satu_gyro', 'acc_norm'. That's improtant.
C. The warning message "Failed to find match for field 'time'." means the timestamps of each LiDAR points are missed in the rosbag file. That is important because Point-LIO processes at the sampling time of each LiDAR point.
D. We recommend to set the extrinsic_est_en to false if the extrinsic is give. As for the extrinsic initiallization, please refer to our recent work: Robust and Online LiDAR-inertial Initialization.
E. If a high odometry output frequency without downsample is required, set publish_odometry_without_downsample
as true. Then the warning message of tf "TF_REPEATED_DATA" will pop up in the terminal window, because the time interval between two publish odometery is too small. The following command could be used to suppress this warning to a smaller frequency:
in your catkin_ws/src,
git clone --branch throttle-tf-repeated-data-error [email protected]:BadgerTechnologies/geometry2.git
Then rebuild, source setup.bash, run and then it should be reduced down to once every 10 seconds. If 10 seconds is still too much log output then change the ros::Duration(10.0) to 10000 seconds or whatever you like.
The codes of this repo are contributed by: Dongjiao He (贺东娇) and Wei Xu (徐威)
Our paper is published on Advanced Intelligent Systems(AIS). Point-LIO, DOI: 10.1002/aisy.202200459
Our accompany video is available on YouTube.
3.1 Ubuntu and ROS
We tested our code on Ubuntu20.04 with noetic. Additional ROS package is required:
sudo apt-get install ros-xxx-pcl-conversions
Following the official Eigen installation, or directly install Eigen by:
sudo apt-get install libeigen3-dev
Follow livox_ros_driver Installation.
Remarks:
- Since the Point-LIO supports Livox serials LiDAR, so the livox_ros_driver must be installed and sourced before run any Point-LIO luanch file.
- How to source? The easiest way is add the line
source $Licox_ros_driver_dir$/devel/setup.bash
to the end of file~/.bashrc
, where$Licox_ros_driver_dir$
is the directory of the livox ros driver workspace (should be thews_livox
directory if you completely followed the livox official document).
Clone the repository and catkin_make:
cd ~/$A_ROS_DIR$/src
git clone https://github.com/hku-mars/Point-LIO.git
cd Point-LIO
git submodule update --init
cd ../..
catkin_make
source devel/setup.bash
- Remember to source the livox_ros_driver before build (follow 3.3 livox_ros_driver)
- If you want to use a custom build of PCL, add the following line to ~/.bashrc
export PCL_ROOT={CUSTOM_PCL_PATH}
Connect to your PC to Livox Avia LiDAR by following Livox-ros-driver installation, then
cd ~/$Point_LIO_ROS_DIR$
source devel/setup.bash
roslaunch point_lio mapping_avia.launch
roslaunch livox_ros_driver livox_lidar_msg.launch
- For livox serials, Point-LIO only support the data collected by the
livox_lidar_msg.launch
since only itslivox_ros_driver/CustomMsg
data structure produces the timestamp of each LiDAR point which is very important for Point-LIO.livox_lidar.launch
can not produce it right now. - If you want to change the frame rate, please modify the publish_freq parameter in the livox_lidar_msg.launch of Livox-ros-driver before make the livox_ros_driver pakage.
mapping_avia.launch theratically supports mid-70, mid-40 or other livox serial LiDAR, but need to setup some parameters befor run:
Edit config/avia.yaml
to set the below parameters:
- LiDAR point cloud topic name:
lid_topic
- IMU topic name:
imu_topic
- Translational extrinsic:
extrinsic_T
- Rotational extrinsic:
extrinsic_R
(only support rotation matrix)
- The extrinsic parameters in Point-LIO is defined as the LiDAR's pose (position and rotation matrix) in IMU body frame (i.e. the IMU is the base frame). They can be found in the official manual.
- Saturation value of IMU's accelerator and gyroscope:
satu_acc
,satu_gyro
- The norm of IMU's acceleration according to unit of acceleration messages:
acc_norm
Step A: Setup before run
Edit config/velodyne.yaml
to set the below parameters:
- LiDAR point cloud topic name:
lid_topic
- IMU topic name:
imu_topic
(both internal and external, 6-aixes or 9-axies are fine) - Set the parameter
timestamp_unit
based on the unit of time (Velodyne) or t (Ouster) field in PoindCloud2 rostopic - Line number (we tested 16, 32 and 64 line, but not tested 128 or above):
scan_line
- Translational extrinsic:
extrinsic_T
- Rotational extrinsic:
extrinsic_R
(only support rotation matrix)
- The extrinsic parameters in Point-LIO is defined as the LiDAR's pose (position and rotation matrix) in IMU body frame (i.e. the IMU is the base frame).
- Saturation value of IMU's accelerator and gyroscope:
satu_acc
,satu_gyro
- The norm of IMU's acceleration according to unit of acceleration messages:
acc_norm
Step B: Run below
cd ~/$Point_LIO_ROS_DIR$
source devel/setup.bash
roslaunch point_lio mapping_velody16.launch
Step C: Run LiDAR's ros driver or play rosbag.
Set pcd_save_enable
in launchfile to 1
. All the scans (in global frame) will be accumulated and saved to the file Point-LIO/PCD/scans.pcd
after the Point-LIO is terminated. pcl_viewer scans.pcd
can visualize the point clouds.
Tips for pcl_viewer:
- change what to visualize/color by pressing keyboard 1,2,3,4,5 when pcl_viewer is running.
1 is all random
2 is X values
3 is Y values
4 is Z values
5 is intensity
The example datasets could be downloaded through onedrive. Pay attention that if you want to test on racing_drone.bag, [0.0, 9.810, 0.0] should be input in 'mapping/gravity_init' in avia.yaml, and uncomment the line 877 to line 880, comment the line 882 to line 884 in laserMapping.cpp. Because this bag start from a high speed motion. And for PULSAR.bag, we change the measuring range of the gyroscope of the built-in IMU to 17.5 rad/s. Therefore, when you test on this bag, please change 'satu_gyro' to 17.5 in avia.yaml.
PULSAR is a self-rotating actuated by only one motor, PULSAR
If you have any questions about this work, please feel free to contact me <hdj65822ATconnect.hku.hk> and Dr. Fu Zhang <fuzhangAThku.hk> via email.