Laser-range-finder-based target detection for human-robot collaboration in hilly orchards

Xiulan Bao, Xiaojie Ma, Yuxin Niu, Qilin Yin, Hong Chen, Qing Wu

Abstract


Human-robot collaboration is a promising means to promote orchard intelligence and reduce the over-reliance on manual work for complex agronomic practices such as fruit tree pruning, flower and fruit thinning, and harvesting. Accurate target detection and recognition of robots on humans are the basis and prerequisite for subsequent autonomous human-robot collaboration. In this study, detection and recognition of following robots for human torso were carried out in a standardized hilly orchard. A LiDAR-based human torso detection method was proposed based on the actual orchard environment. Breakpoint detection was used to cluster and segment the point clouds, and the segmentation thresholds were determined based on experimental results. The geometric attributes of the human torso were trained in the classification detection model, resulting in the extraction of six geometric attributes of the human torso. The classification model was then trained with various combinations to obtain the optimal feature combination [girth-depth-average curvature (G-D-k)] for human torso recognition in an orchard environment. Practical experiments were carried out to validate the feasibility and accuracy of the G-D-k feature combination. The experimental results demonstrate that the G-D-k feature combination can accurately recognize human bodies in orchards. The LiDAR-based detection method can achieve relatively accurate human detection and recognition in complex orchard environments, providing a reference for target detection in human-robot collaboration in orchards.
Key words: human-robot collaboration; following robot; human torso recognition; LiDAR; support vector data descriptors
DOI: 10.25165/j.ijabe.20251802.8346

Citation: Bao X L, Ma X J, Niu Y X, Yin Q L, Chen H, Wu Q. Laser-range-finder-based target detection for human-robot collaboration in hilly orchards. Int J Agric & Biol Eng, 2025; 18(2): 231–238.

Keywords


human-robot collaboration; following robot; human torso recognition; LiDAR; support vector data descriptors

Full Text:

PDF

References


Yuan B, Chen C. Evolution of a development model for fruit industry against background of rising labor cost: Intensive or extensive adjustment? Sustainability, 2019; 11(14): 3864.

Mao W J, Liu H, Hao W, Yang F Z, Lin Z J. Development of a combined orchard harvesting robot navigation system. Remote Sensing, 2022; 14(3): 675.

Silwal A, Davidson J R, Karkee M, Mo C, Zhang Q, Lewis K. Design, integration, and field evaluation of a robotic apple harvester. Journal of Field Robotics, 2017; 34(6): 1140–1159.

Verbiest R, Ruysen K, Vanwalleghem T, Demeester E, Kellens K. Automation and robotics in the cultivation of pome fruit: Where do we stand today? Journal of Field Robotics, 2021; 38(4): 513–531. doi: 10.1002/rob.22000.

Tang Y C, Chen M Y, Wang CL, Luo, L F, Li J H, Lian G P, et al. Recognition and localization methods for vision-based fruit picking robots: A review. Frontiers in Plant Science, 2020; 11: 510.

Ding H, Yang X, Zheng N, Li M, Lai Y, Wu H. Tri-Co Robot: A Chinese robotic research initiative for enhanced robot interaction capabilities. National Science Review, 2018; 5(6): 799–801.

Wang G, Li W L, Jiang C, Zhu D H, Xie H, Liu X J. Simultaneous calibration of multicoordinates for a dual-robot system by solving the AXB=YCZ problem. IEEE Transactions on Robotics, 2021; 37(4): 1172–1185.

Lai Y N, Ye X, Ding H. Research progress of major research plan on Tri-Co robots. Journal of Mechanical Engineering, 2021; 57(23): 1–11, 20. (in Chinese)

Hirose N, Tajima R, Sukigara K. Personal robot assisting transportation to support active human life—Human-following method based on model predictive control for adjacency without collision. In: 2015 IEEE International Conference on Mechatronics (ICM), Nagoya: IEEE, 2015; pp.76–81. doi: 10.1109/ICMECH.2015.7083951.

Gupta M, Kumar S, Behera L, Subramanian V. A novel vision-based tracking algorithm for a human-following mobile robot. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2016; 47(7): 1415–1427.

Alves R, Linhares B, Souza J. Autonomous shopping cart: A new concept of service robot for assisting customers. In: 2018 Latin American Robotic Symposium, 2018 Brazilian Symposium on Robotic (SBR) and 2018 Workshop on Robotics in Education (WRE), João Pessoa: IEEE, 2018; pp.451–456. doi: 10.1109/LARS/SBR/WRE.2018.00086.

Su H, Zhang Y S, Li J S, Hu J. The shopping assistant robot design based on ROS and deep learning. In: 2016 2nd International Conference on Cloud Computing and Internet of Things. Dalian: IEEE, 2016; pp.173–176. doi: 10.1109/CCIOT.2016.7868328.

Gross H, Meyer S, Scheidig A, Eisenbach M, Mueller S, Trinh T, et al. Mobile robot companion for walking training of stroke patients in clinical post-stroke rehabilitation. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore: IEEE, 2017; pp.1028–1035. doi: 10.1109/ICRA.2017.7989124.

Xiao H Z, Li Z J, Yang C G, Yuan W, Wang L Y. RGB-D sensor-based visual target detection and tracking for an intelligent wheelchair robot in indoors environments. International Journal of Control, Automation and Systems, 2015; 13: 521–529.

Sales J, Martí J, Marín R, Cervera E J, Sanz P. CompaRob: The shopping cart assistance robot. International Journal of Distributed Sensor Networks, 2016; 12(2): 4781280.

Guerrero-Higueras Á, Álvarez-Aparicio C, Calvo Olivera M, Rodríguez-Lera F, Fernández-Llamas C, Rico F, et al. Tracking people in a mobile robot from 2d lidar scans using full convolutional neural networks for security in cluttered environments. Frontiers in Neurorobotics, 2019; 12: 85.

Feng T, Yu Y, Wu L, Bai Y R, Xiao Z, Lu Z. A human-tracking robot using ultra wideband technology. IEEE Access, 2018; 6: 42541–42550.

Masuzawa H, Miura J, Oishi S. Development of a mobile robot for harvest support in greenhouse horticulture—Person following and mapping. In: 2017 IEEE/SICE International Symposium on System Integration. Taipei: IEEE, 2017; pp.541–546. doi: 10.1109/SII.2017.8279277.

Yorozu A, Ishigami G, Takahashi M. Human-following control in furrow for agricultural support robot. In: Intelligent Autonomous Systems 16: Proceedings of the 16th International Conference IAS-16, Cham: Springer, 2022; pp.155–164. doi: 10.1007/978-3-030-95892-3_12.

Polvara R, Del Duchetto F, Neumann G, Hanheide M. Navigate-and-seek: A robotics framework for people localization in agricultural environments. IEEE Robotics and Automation Letters, 2021; 6(4): 6577–6584.

Mao W J, Liu H, Wang X L, Yang F Z, Liu Z J, Wang Z Y. Design and experiment of dual navigation mode orchard transport robot. Transactions of the CSAM, 2022; 53(3): 27–39, 49. (in Chinese)

Taipalus T, Ahtiainen J. Human detection and tracking with knee-high mobile 2D LIDAR. In: 2011 IEEE International Conference on Robotics and Biomimetics, Karon Beach: IEEE, 2011; pp.1672–1677. doi: 10.1109/ROBIO.2011.6181529.

Chung W, Kim H, Yoo Y, Moon C, Park J. The detection and following of human legs through inductive approaches for a mobile robot with a single laser range finder. IEEE Transactions on Industrial Electronics, 2012; 59(8): 3156–3166.

Cha D, Chung W. Human-leg detection in 3D feature space for a person-following mobile robot using 2D LiDARs. International Journal of Precision Engineering and Manufacturing, 2020; 21: 1299–1307.

Zainudin Z, Kodagoda S, Dissanayake G. Torso detection and tracking using a 2d laser range finder. In: Proceedings of the 2010 Australasian Conference on Robotics and Automation, ACRA 2010, 2010. Available: https://opus.lib.uts.edu.au/bitstream/10453/16405/1/2010000410.pdf. Accessed on [2022-12-07].

Jung E, Lee J, Yi B, Park J, Yuta S, Noh S. Development of a laser-range-finder-based human tracking and control algorithm for a marathoner service robot. IEEE/ASME Transactions on Mechatronics, 2013; 19(6): 1963–1976.

Kim J, Jeong H, Lee D. Single 2D lidar based follow-me of mobile robot on hilly terrains. Journal of Mechanical Science and Technology, 2020; 34: 3845–3854.

Zheng Y J, Chen B T, Lyu H D, Kang F, Jiang S J. Research progress of orchard plant protection mechanization technology and equipment in China. Transactions of the CSAE, 2020; 36(20): 110–124. (in Chinese)

Hayat F, Li J, Iqbal S, Peng Y, Hong L M, Balal R, et al. A mini review of citrus rootstocks and their role in high-density orchards. Plants, 2022; 11(21): 2876.




Copyright (c) 2025 International Journal of Agricultural and Biological Engineering

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2023-2026 Copyright IJABE Editing and Publishing Office