Laser tracking leader-follower automatic cooperative navigation system for UAVs

Rui Ming, Zhiyan Zhou, Zichen Lyu, Xiwen Luo, Le Zi, Cancan Song, Yu Zang, Wei Liu, Rui Jiang

Abstract


Currently, small payload and short endurance are the main problems of a single UAV in agricultural applications, especially in large-scale farmland. It is one of the important methods to solve the above problems of UAVs by improving operation efficiency through multi-UAV cooperative navigation. This study proposed a laser tracking leader-follower automatic cooperative navigation system for multi-UAVs. The leader in the cluster fires a laser beam to irradiate the follower, and the follower performs a visual tracking flight according to the light spot at the relative position of the laser tracking device. Based on the existing kernel correlation filter (KCF) tracking algorithm, an improved KCF real-time spot tracking method was proposed. Compared with the traditional KCF tracking algorithm, the recognition and tracking rate of the optimized algorithm was increased from 70% to 95% in indoor environment, and was increased from 20% to 90% in outdoor environment. The navigation control method was studied from two aspects: the distance coordinate transformation model based on micro-gyroscope and navigation control strategy. The error of spot position was reduced from the maximum (3.12, −3.66) cm to (0.14, 0.12) cm by correcting the deviation distance of the spot at different angles through a coordinate correction algorithm. An image coordinate conversion model was established for a complementary metal-oxide-semiconductor (CMOS) camera and laser receiving device at different mounting distances. The laser receiving device was divided into four regions, S0-S3, and the speed of the four regions is calculated using an uncontrollable discrete Kalman filter. The outdoor flight experiments of two UAVs were carried out outdoors using this system. The experiment results show that the average flight error of the two UAVs on the X-axis is 5.2 cm, and the coefficient of variation is 0.0181. The average flight error on the Z-axis is 7.3 cm, and the coefficient of variation is 0.0414. This study demonstrated the possibility and adaptability of the developed system to achieve multi-UAVs cooperative navigation.
Keywords: two-UAVs cooperative, visual navigation, laser tracking
DOI: 10.25165/j.ijabe.20221502.6350

Citation: Ming R, Zhou Z Y, Lyu Z C, Luo X W, Zi L, Song C C, et al. Laser tracking leader-follower automatic cooperative navigation system for UAVs edited. Int J Agric & Biol Eng, 2022; 15(2): 165–176.

Keywords


two-UAVs cooperative, visual navigation, laser tracking

Full Text:

PDF

References


Fan B K, Li Y, Zhang R Y, Fu Q Q. Review on the technological development and application of UAV systems. Chinese Journal of Electronics, 2020; 29(2): 199–207.

Xue X Y, Lan Y B, Sun Z, Chang C, Hoffmann W C. Develop an unmanned aerial vehicle based automatic aerial spraying system. Computersand Electronics in Agriculture, 2016; 128: 58–66.

Faical B S, Freitas H, Gomes P H, Mano L Y, Pessin G, de Carvalho A C P L, et al. An adaptive approach for UAV-based pesticide spraying in dynamic environments. Computersand Electronicsin Agriculture, 2017; 138: 210–223.

Saeed A S, Younes A B, Islam S, Dias J, Seneviratne L, Cai G. A review on the platform design, dynamic modeling and control of hybrid UAVs. In: 2015 International Conference on Unmanned Aircraft Systems (ICUAS), Denver, USA: IEEE, 2015; pp.806–815. doi: 10.1109/ICUAS. 2015.7152365.

Xu C C, Liao X H, Tan J M, Ye H P, Lu H Y. Recent research progress of unmanned aerial vehicle regulation policies and technologies in urban low altitude. IEEE Access, 2020; 8: 74175–74194.

Causa F, Vetrella A R, Fasano G, Accardo D. Multi-UAV formation geometries for cooperative navigation in GNSS-challenging environment. In: 2018 IEEE/ION Position, Location and Navigation Symposium (PLANS), Monterey, USA, 2018; pp.775–785. doi: 10.1109/PLANS. 2018.8373453.

Karrer M, Agarwal M, Kamel M, Siegwart R, Chli M. Collaborative 6DoF relative pose estimation for two UAVs with overlapping fields of view. In 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia: IEEE, 2018; pp.6687–6693. doi: 10.1109/ICRA.2018.8461143.

Spurny V, Baca T, Saska M, Penicka R, Krajnik T, Thomas J, et al. Cooperative autonomous search, grasping, and delivering in a treasure hunt scenario by a team of unmanned aerial vehicles. Journal of Field Robotics, 2019; 36(1): 125–148.

Pan R H, Xu S H. Multi-UAV cooperative navigation algorithm based on

geometric characteristics. Journal of Ordnance Equipment Engineering, 2017; 10: 55–59. (in Chinese)

Guo K X, Li X X, Xie L H. Ultra-wideband and odometry-based cooperative relative localization with application to multi-UAV formation control. IEEE Transactions on Cybernetics, 2020; 50(6): 2590–2603.

Jongug C, Yudan K. Fuel-efficient three-dimensional controller for leader-follower UAV formation flight. In: 2007 International Conference on Control Automation and Systems, Seoul: IEEE, 2007; pp.806–811. doi: 10.1109/ICCAS.2007.4407011.

Ivanov L I, Obukhova N A, Baranov P S. Review of modern UAV detection algorithms using methods of computer vision. In: 2020 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus), St. Petersburg and Moscow: IEEE, 2020; pp.322–325. doi: 10.1109/EIConRus49466.2020.9039352.

Tang Y Z, Hu Y C, Cui J Q, Liao F, Lao M J, Lin F, et al. Vision-aided multi-UAV autonomous flocking in GPS-denied environment. IEEE Transactions on Industrial Electronics, 2019; 66(1): 616–626.

Kalal Z, Mikolajczyk K, Matas J. Tracking-learning-detection. IEEE Transactions on Software Engineering, 2011; 34(7): 1409–1422.

Lin F, Mao P K, Xu D X, Yu Z S, M C B. Vision-based formation for UAVs. Taichung: IEEE, 2014; pp.1375–1380. doi: 10.1109/ICCA.2014. 6871124.

Vetrella A R, Causa F, Renga A, Fasano G, Accardo D, Grassi M. Flight demonstration of multi-UAV CDGPS and vision-based sensing for high accuracy attitude estimation. In: 2017 International Conference on Unmanned Aircraft Systems (ICUAS), Miami: IEEE, 2017; pp.237–246. doi: 10.1109/ICUAS.2017.7991378.

Gassner M, Cieslewski T, Scaramuzza D. Dynamic collaboration without communication: Vision-based cable-suspended load transport with two quadrotors. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore: IEEE, 2017; pp.5196–5202. doi: 10.1109/ICRA.2017.7989609.

Yan L, Fang L F, Wei Z. A study on the sync guidance of the multi-lasers with the micro-vision. In: The 26th Chinese Control and Decision Conference (2014 CCDC), Changsha: IEEE, 2014; pp.1449–1453. doi: 10.1109/CCDC.2014.6852395.

Walter V, Staub N, Franchi A, Saska M. UVDAR system for visual relative localization with application to leader-follower formations of multirotor UAVs. IEEE Robotics and Automation Letters, 2019; 4(3): 2637–2644.

Park H, Choi I, Park S, Choi J. Leader-follower formation control using infrared camera with reflective tag. In: 2013 10th International Conference on Ubiquitous Robots and Ambient Intelligence, Jeju, Korea: IEEE, 2013; pp.321–324.

Fang F, Qian K, Zhou B, Ma X. Real-time RGB-D based people detection and tracking system for mobile robots. In: 2017 IEEE International Conference on Mechatronics and Automation (ICMA), Takamatsu, Japan: IEEE, 2017; pp.1937–1941. doi: 10.1109/ ICMA.2017.8016114.

Xiang C, Mao J. Research on target detection method based on HSV fusion Gaussian mixture model. In: 2019 3rd International Conference on Electronic Information Technology and Computer Engineering (EITCE), Xiamen, China: IEEE, 2019; pp.327–331. doi: 10.1109/EITCE47263. 2019.9094782.

Janousek J, Marcon P, Pokorny J, Mikulka J. Detection and tracking of moving UAVs. In: 2019 PhotonIcs & Electromagnetics Research Symposium - Spring (PIERS-Spring), Rome: IEEE, 2019; pp.2759–2763. doi: 10.1109/PIERS-Spring46901.2019.9017351.

Henriques J F, Caseiro R, Martins P, Batista J. High-speed tracking with kernelized correlation filters. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015; 37(3): 583–596.

Li Q, Liu L, Ma X, Chen S, Yun H, Tang S. Development of multitarget acquisition, pointing, and tracking system for airborne laser communication. IEEE Transactions on Industrial Informatics, 2019; 15(3): 1720–1729.

Luo Y, Ye G, Wu Y, Guo J, Liang J, Yang Y. An adaptive Kalman filter for UAV attitude estimation. In: 2019 IEEE 2nd International Conference on Electronic Technology (ICET), Chengdu: IEEE, 2019; pp.258–262. doi: 10.1109/ELTECH.2019.8839496.

Lee D H, Lee S S, Kang H H, Ahn C K. Camera position estimation for UAVs using SolvePnP with Kalman filter. In: 2018 1st IEEE International Conference on Hot Information-Centric Networking (HotICN), Shenzhen: IEEE, 2018; pp.250–251. doi: 10.1109/ HOTICN.2018.8606037.




Copyright (c) 2022 International Journal of Agricultural and Biological Engineering

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2023-2026 Copyright IJABE Editing and Publishing Office