Review of rigid fruit and vegetable picking robots

Yuxia Zhao, Xuefeng Wan, Huixiao Duo

Abstract


The important indicators to measure the goodness of rigid fruit and vegetable picking robot have two aspects, the first is the reasonable structural design of the end-effector, and the second is having a high precision positioning recognition method. Many researchers have done a lot of work in these two aspects, and a variety of end-effector structures and advanced position recognition methods are constantly appearing in people's view. The working principle, structural characteristics, advantages and disadvantages of each end-effector are summarized to help us design better fruit and vegetable picking robot. The authors start from the rigid fruit and vegetable picking robot grasping methods, separation methods, and position recognition methods, firstly introduce three different grasping methods and the characteristics of the two separation methods, then introduce the under-driven picking robot developed on the basis of the traditional rigid picking robot, then explain the single special, multi-feature, and deep learning location position recognition methods currently used, and finally make a summary and outlook on the rigid fruit and vegetable picking robot from the structural development and position recognition methods.
Keywords: picking robot, end-effector, grasping methods, separation methods, under-driven, position recognition methods
DOI: 10.25165/j.ijabe.20231605.8120

Citation: Zhao Y X, Wan X F, Duo H X. Review of rigid fruit and vegetable picking robots. Int J Agric & Biol Eng, 2023; 16(5): 1-11.

Keywords


picking robot, end-effector, grasping methods, separation methods, under-driven, position recognition methods

Full Text:

PDF

References


Hou J. New characteristics and trends of population development in China: an Analysis Based on seven Chinese censuses. Academic Forum, 2021; 44(5): 1-14. (in Chinese)

Lyu H R, Ma H R. Behind the stable growth of arable land. China Natural Resource News, 2022. (in Chinese)

Peng L. Development of under-actuated manipulator for apply picking. MS dissertation. Nanjing: Nanjing Agriculture University, 2010. (in Chinese)

Rong H. Development of kiwifruit picking end actuator based on separation and picking of fruit stems. MS dissertation. Shaanxi: Northwest A&F University, 2019. (in Chinese)

Scarfe A J, Flemmer R C, Bakker H H, Flemmer C L. Development of an autonomous kiwifruit picking robot. 4th International Conference on Autonomous Robots and Agents, Wellington, New Zealand: ICARA, 2009; pp.639-643.

Ji C, Feng Q C, Yuan T, Tan Y Q, Li W. Development and performance analysis on cucumber harvesting robot system in greenhouse. Robot, 2011; 33(6): 726-730.

Henten E J V, Tuijl B A J V, Hemming J, Kornet J G, Bontsema J, Os E A V. Field test of an autonomous cucumber picking robot. Biosystems Engineering. 2003; 86(3): 305-313.

Liu J Z, Li P P, Ni Q, Li Z G. Design and test of the vacuum suction device for tomato harvesting robot. Transactions of the CSAM, 2010; 41(10): 170-173. (in Chinese)

Liu J Z, Li P P, Li Z G. Hardware design of the end-effector for tomato-harvesting robot. Transactions of the CSAM, 2008; 39(3): 109-112. (in Chinese)

Monta M, Kondo N, Ting K C. End-effectors for tomato harvesting robot. Artificial Intelligence Review, 1998; 12(1-3): 11-25.

Wang Y, Zhang M, Liu B, Liu S, He Y, Xu H B. Design and experiment of clamping mechanism about end-effector for citrus harvesting robot. Journal of Agricultural Science and Technology, 2019; 21(4): 9. (in Chinese)

Mehta S S, Burks T F. Vision-based control of robotic manipulator for citrus harvesting. Computers and Electronics in Agriculture, 2014; 102: 146-158.

Zhao D A, Lv J D, Ji W, Zhang Y, Chen Y. Design and control of an apple harvesting robot. Biosystems Engineering, 2011; 110(2): 112-122.

Baeten J, Donne K, Boedrij S, Beckers W, Claesen E. Autonomous fruit picking machine: A robotic apple harvester. 6th International Symposium on Field and Service Robotics, 2008 Jul 09-12; Chamonix, France, pp.531-539.

Hayashi S, Yamamoto S, Tsubota S, Ochiai Y, Kobayashi K, Kamata J, et al. Automation technologies for strawberry harvesting and packing operations in Japan. Journal of Berry Research, 2014; 4(1): 19-27.

Feng Q C, Wang X, Zu W, Qing G, Ma W, Jiang K. Greenhouse intelligent equipment series 38: design of a new type fruit picking robot system. Agricultural Engineering Technology, 2012; 7: 56, 8. (in Chinese)

Arima S, Kondo N, Monta M. Strawberry harvesting robot on table-top culture. 2004 ASAE Annual Meeting, St. Joseph, MI: ASAE; 2004.

Chen J, Wang H, Jiang H R, Gao H, Lei W L, Dang G R. Design of end-effector for kiwifruit harvesting robot. Transactions of the CSAM, 2012; 43(10): 151-154, 199. (in Chinese)

Li Z H, Guan S Q, Xiao X, Chang J, Liu W H. Structure design kinematics of a new bionic manipulator. Journal of Xi'an Polytechnic University, 2020; 34(5): 56-62. (in Chinese)

Feng Q C, Wang X N, Wang G H, Li Z. Design and test of tomatoes harvesting robot. IEEE International Conference on Information and Automation 2015, Lijiang, China, 2015; pp.949-952.

Li G L, Ji C Y, Gu B X, Xu W Y, Dong M. Kinematics analysis and experiment of apple harvesting robot manipulator with multiple end-effectors. Transactions of the CSAM, 2016; 47(12): 14-21. (in Chinese)

Jiang L P, Chen S R. The overview of fruit harvesting robot. Agricultural Equipment & Technology, 2006; 1: 8-10. (in Chinese)

Ma L Z, Yang W L, Wang C J, Chen X X, Xue C, Lin Y, et al. Structure design and experiment of the end-effector for apple-harvesting robot. Journal of Agricultural Mechanization Research, 2009; 31(12): 65-67. (in Chinese)

Davidson J R, Silwal A, Hohimer C J, Karkee M, Mo C, Zhang Q, et al. Proof-of-concept of a robotic apple harvester. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); Daejeon, South Korea: IEEE; 2016; pp.634-639.

Kondo N Y K, Iida M. Development of an end-effector for a tomato cluster harvesting robot. Engineering in Agriculture, Environment and Food, 2010; 3(1): 20–24.

Xu L M, Liu X D, Zhang K L, Xing J J, Yuan Q C, Chen J W, et al. Transactions of the CSAE, 2018; 34(12): 53-61. (in Chinese)

Chiu Y-C, Yang P-Y, Chen S. Development of the end-effector of a picking robot for greenhouse-grown tomatoes. Applied Engineering in Agriculture, 2013; 29(6): 1001-1009.

Zhang Y. Research on the fruit-vegetable picking robot end executor and manipulator. MS dissertation, Shenyang: Shenyang University of Technology, 2014. (in Chinese)

Hayashi S, Ota T, Kubota K, Ganno K, Kondo N, editors. Robotic harvesting technology for fruit vegetables in protected horticultural production. The 7th Fruit, Nut and Vegetable Production Engineering Symposium, Montpelier, France: Information & Technology for Sustainable Fruit & Vegetable Production, 2005; Paper No.49

Xiong Y, Chen P, Grimstad L, From P J, Isler V. Development and field evaluation of a strawberry harvesting robot with a cable-driven gripper. Computers and Electronics in Agriculture, 2019; 157: 392-402.

Li G. Design and research of apple picking robot with multiple end-effectors. PhD dissertation, Nanjing: Nanjing Agricultural University, 2017. (in Chinese)

Fu S. Design and research on end-effector of citrus harvesting robot. ms dissertation. Chongqing: Chong Qing University of Technology, 2017. (in Chinese)

Han S K, Zhao Z K, Zhang H, Zhou Y, Wang Z Y. Design and simulation analysis of the end effector of circular fruit picking robot. Journal of Machine Design, 2019; 36(S2): 82-85. (in Chinese)

Wang L, Fan J, Zhao B, Wei C, Sun X, Hu X. Structural design and performance test of fruit and vegetable picking manipulator. Agricultural Engineering Technology, 2017; 7(2): 107-113, 23. (in Chinese)

Wang L. Research on key technology of tomato harvesting robot. PhD dissertation, Beijing: Beijing University of Technology, 2017. (in Chinese)

Schertz C E, Brown G K. Basic considerations in mechanizing citrus harvest. Transactions of the ASAE, 1968; 11(3): 343-346.

Hannan M W, Burks T F. Current developments in automated citrus harvesting. 2004 ASAE Annual Meeting; Ottawa, Canada: ASABE; 2004.

Tibbetts J H. Not too far from the tree. Mechanical Engineering, 2018; 140(2): 10-17.

Israeli robotics firm FFRobotics aims to release robotic apple picker by next year 2021. https://www.therobotreport.com/israeli-robotics-firm-ffrobotics-aims-release-robotic-apple-picker-next-year/.

Henten E J V, Hemming J, Tuijl B A J V, Kornet J G, Meuleman J, Bootsma J, et al. An autonomous robot for harvesting cucumbers in greenhouses. Auton Robots, 2002; 13(3): 241-258.

Muscato G, Prestifilippo M, Abbate N, Rizzuto I. A prototype of an orange picking robot: past history, the new robot and experimental results. Industrial Robot: An International Journal, 2005; 32(2): 128-138.

Sun H. Design and experiment of the end actuator of intelligent greenhouse tomato picking system. MS dissertation, Sichuan: Sichuan Agriculture University; 2019. (in Chinese)

Sun H L, Hou Y. Mechanism design and mechanical analysis of multi-mode grab underactuated hand. Journal of Mechanical Transmission, 2021; 45(8): 90-96.

Jun K, Hiroki S, Junya T, Kazuhiro K. Underactuated robotic hand for a fully automatic dishwasher based on grasp stability analysis. Advanced Robotics. 2022; 36(4): 167-181.

Begoc V K S, Dombre E. Mechanical design of a new pneumatically driven underactuated hand. Proceedings of 2007 IEEE International Conference on Robotics and Automation, Rome, Italy: IEEE; 2007; pp.927–933.

Dollar A M. The Highly adaptive SDM hand: Design and performance evaluation. The International Journal of Robotics Research, 2010; 29(5): 585-597.

Tegin J, Iliev B, Skoglund A, Kragic D, Wikander J. Real life grasping using an under-actuated robot hand-Simulation and experiments. 2009 International Conference on Advanced Robotics, Munich, Germany: IEEE; 2009; pp.1-8.

Zheng T, Jiang M, Ma M. Vision based target recognition and location for picking robot: A review. Chinese Journal of Scientific Instrument, 2021; 42(9): 28-51. (in Chinese)

Ji C. Vision information acquisition for fruit harvesting robot and development of robot prototype system. PhD dissertation, Beijing: China Agriculture University, 2014. (in Chinese)

Zhao D A, Liu X Y, Chen Y, Ji W, Jia W K, Hu C L. Image recognition at night for apple picking robot. Transactions of the CSAM, 2015; 46(3): 15-22. (in Chinese)

Patel H N J R, Joshi M V. Automatic segmentation and yield measurement of fruit. International Journal of Computer Applications, 2012; 45(7): 19-24.

Lv J D, Zhao D A, Ji W, Ding S H. Recognition of apple fruit in natural environment. Optik-International Journal for Light and Electron Optics, 2016; 127(3): 1354-1362.

Wei X Q, Jia K, Lan J H, Li Y W, Zeng Y L, Wang C M. Automatic method of fruit object extraction under complex agricultural background for vision system of fruit picking robot. Optik-International Journal for Light and Electron Optics, 2014; 125(19): 5684-5689.

Peng H X, Zu X J, Chen L J, Xiong J T, Chen K Y, Lin G C. Fast recognition of multiple color targets of litchi image in field environment based on double Otsu algorithm. Transactions of the CSAM, 2014; 45(4): 61-68, 75. (in Chinese)

Luo L F, Tang Y C, Zou X J, Wang C L, Zhang P, Feng W X. Robust grape cluster detection in a vineyard by combining the adaboost framework and multiple color components. Sensors, 2016; 16(12):2098.

Liu J Z, Li P P, Li Z G. A multi-sensory end-effector for spherical fruit harvesting robot. IEEE International Conference on Automation and Logistics, Jinan, China: IEEE; 2007; pp.258-262.

Rakun J, Stajnko D, Zazula D. Detecting fruits in natural scenes by using spatial-frequency based texture analysis and multiview geometry. Computers and Electronics in Agriculture, 2011; 76(1): 80-89.

Thendral R, Suhasini A, Senthil N. A comparative analysis of edge and color based segmentation for orange fruit recognition. 3rd International Conference on Communications and Signal Processing (ICCSP), Melmaruvathur, INDIA: IEEE; 2014. pp. 463-466.

Chaivivatrakul S, Dailey M N. Texture-based fruit detection. Precision Agriculture, 2014; 15(6): 662-683.

Lu J, Lee W S, Gan H, Hu X. Immature citrus fruit detection based on local binary pattern feature and hierarchical contour analysis. Biosystems Engineering, 2018; 171: 78-79.

Kurtulmus F, Lee W S, Vardar A. Green citrus detection using ‘eigenfruit’, color and circular Gabor texture features under natural outdoor conditions. Computers and Electronics in Agriculture, 2011; 78(2): 140-149.

Hannan M W, Burks T, Bulanon D.A Real-time Machine Vision Algorithm for Robotic Citrus Harvesting. 2007 ASAE Annual Meeting; St. Joseph, MI: ASABE; 2007.

Patel H N, Jain R K, Joshi M V. Fruit Detection using Improved Multiple Features based Algorithm. International Journal of Computer Applications, 2011; 13(2):0975-8887.

Liu S, Whitty M. Automatic grape bunch detection in vineyards with an SVM classifier. Journal of Applied Logic, 2015; 13(4): 643-53.

Li H, Lee W S, Wang K. Immature green citrus fruit detection and counting based on fast normalized cross correlation (FNCC) using natural outdoor color images. Precision Agriculture, 2016; 17(6): 678-697.

Sa I, Ge Z, Dayoub F, Upcroft B, Perez T, McCool C. Deep Fruits: A Fruit Detection System Using Deep Neural Networks. Sensors, 2016; 16(8): 1222-1228.

Xiong J T, Liu Z, Tang L Y, Lin R, Bu R B, Peng H X. Visual detection technology of green citrus under natural environment. Transactions of the CSAM, 2018; 49(4): 45-52. (in Chinese)

Zhou Y C, Xu T Y, Zheng W, Deng H B. Classification and recognition approaches of tomato main organs based on DCNN. Transactions of the CSAE, 2017; 33(15): 219-226. (in Chinese)

Xue Y J, Huang N, Xu S Q, Mao L, Yang A Q. Immature mango detection based on improved YOLOv2. Transactions of the CSAE, 2018; 34(7): 173-179. (in Chinese)

Liu Y P, Yang C H, Ling H, Mabu S, Kuremoto T. A visual system of citrus picking robot using convolutional neural networks. 5th International Conference on Systems and Informatics (ICSAI), Nanjing, China: IEEE; 2018; pp. 344-349.

Li X, Li J, Tang J. A deep learning method for recognizing elevated mature strawberries. 33rd Youth Academic Annual Conference of Chinese Association of Automation (YAC), Nanjing, China: IEEE; 2018; pp.1072-1077.




Copyright (c) 2023 International Journal of Agricultural and Biological Engineering

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2023-2026 Copyright IJABE Editing and Publishing Office