Tests on Two Popular VIO Algorithms
Published:
Tests on Two Popular VIO Algorithms
Test date: July 31st.
Algorithms: MSCKF-VIO & VINS-MONO
Environment: UAV Lab (E4A 03-04, NUS)
Sensors: 2 Point Grey Cameras (Chameleon3 2.8mm) / VN-100 IMU (adis16480)
About
We test on two popular open source vio (visual-inertial odometry) algorithms, VINS-MONO[1] and MSCKF-VIO[2]. Apparently the major diference between them is the numbers of cameras, only one camera used in [1] but two in [2]. Accroding to the [2]’s authors that stereo cameras could raise the performances, we did a simple test and therefore compared the results.
Step
Install the camera and IMU drivers.
Implement two algorithms through their official open source ros package.
Calibrate the sensors.
Record a dataset in rosbag type.
Test two algorithms on the dataset.
Compare the results.
Calibration
We use the Kalibr to calibrate the cameras and T&R matrix between cameras and imu. The results are showing below and the accurate calibration file could be downloaded here.
Notices When Test
Since [1] has the loop-closing mode that we need to turn it off.
There is a time-delay between imu and images which is short but need to be concerned about. The authors of [1] provide the delay calculation and we consider this delay is approximately accurate to use in [2].
[1] needs a step of raising vertically and the dataset must contains some rotation or accelerating to fulfill the experiment procedure.
Test Result
The test video are showing below.
We record the odometry of these two algorithms and plot them in MATLAB in the same coordinate. Fig 1 shows that after turnning off the loop-closing mode, [1] has a drift in X-Y plane though we started and ended in the same position while the Fig 2 shows that [2] has a bigger drift in Z.
Besides, [2] needs more CPU resources because of the processing of stereo images. And [1] performs not so good when pirouetting.
References
[1] Qin, Tong, Peiliang Li, and Shaojie Shen. “VINS-Mono: A robust and versatile monocular visual-inertial state estimator.” IEEE Transactions on Robotics 99 (2018): 1-17.
[2] Sun, Ke, et al. “Robust stereo visual inertial odometry for fast autonomous flight.” IEEE Robotics and Automation Letters 3.2 (2018): 965-972.