Determination of surface color of ‘all yellow’ mango cultivars using computer vision

Marcus Nagle, Kiatkamjon Intani, Giuseppe Romano, Busarakorn Mahayothee, Vicha Sardsud, Joachim Müller

Abstract


Image processing techniques are increasingly applied in sorting applications of agricultural products. This work has assessed the use of image processing for inspecting surface color of two Thai mango cultivars. A computer vision system (CVS) was developed and experiments were conducted to monitor peel color change during the ripening process. Conversion of RGB to CIE-LAB values was done via image processing and prediction models were developed to estimate color parameters from CVS data. Performance evaluations showed insufficient prediction for L values (R2 = 0.42-0.58), but better results for A and B values (R2 = 0.90-0.95 and 0.80-0.82, respectively). Compared to the calculated color values hue angle and chroma, a yellowness index computed from intermediate XYZ values was found to be much more adept at accurately predicting peel color from CVS data. Correlations were strong for both cultivars (R2 = 0.93 for ‘Nam Dokmai’ and R2 = 0.95 for ‘Maha Chanok’). Results from classification analysis indicated satisfactory results for classifying fruits according to ripeness based on yellowness. Success rates of true positives in the categories unripe, ripe and overripe ranged 72%-92% for ‘Nam Dokmai’ and 98%-100% for ‘Maha Chanok’. Therefore, it was shown that the CVS was capable of producing accurate color values for the two mango cultivars investigated. The findings of this study can be incorporated for development of a robust system for quality prediction and establishment of a CVS for automatic grading and sorting of mangos.
Keywords: mango, peel color, computer vision, image processing, fruit quality, Thailand
DOI: 10.3965/j.ijabe.20160901.1861

Citation: Nagle M, Intani K, Romano G, Mahayothee B, Sardsud V, Müller J. Determination of surface color of ‘all yellow’ mango cultivars using computer vision. Int J Agric & Biol Eng, 2016; 9(1): 42-50.

Keywords


mango, peel color, computer vision, image processing, fruit quality, Thailand

Full Text:

PDF

References


Lawless H T, Heymann H. Color and Appearance. Sensory Evaluation of Food, Food Science Text Series. New York: Springer; 2010. pp. 283–301.

Grierson W. Fruit development, maturation and ripening. In: Pessarakli M editor. Handbook of Plant and Crop Physiology. New York: Marcel Dekker; 2002. pp. 143–159.

Crisosto C H, Crisosto G M, Metheney P. Consumer acceptance of ‘Brooks’ and ‘Bing’ cherries is mainly dependent on fruit SSC and visual skin color. Postharvest Biology and Technology, 2003; 28(1): 159–167.

UNCTAD. Commodity profile: Mango. Volume 2012. Geneva, Switzerland: United Nations Conference on Trade and Development (UNCTAD); 2012.

OAE. Office of Agrcultural Economics: Agricultural Production Statistics 2014. Bangkok, Thailand; 2015.

Tautho C C, Satonero L A, Tautho Y C, Lariosa E A. Production, postharvest handling and marketing practices of mango growers in Bukidnon [Philippines]. Philippine Journal of Crop Science, 2002; 27(1): 37.

Chen Y-R, Chao K, Kim M S. Machine vision technology for agricultural applications. Computers and Electronics in Agriculture, 2002; 36(2-3): 173–191.

Blasco J, Aleixos N, Moltó E. Machine vision system for automatic quality grading of fruit. Biosystems Engineering, 2003; 85(4): 415–423.

Cubero S, Aleixos N, Moltó E, Gómez-Sanchis J, Blasco J. Advances in machine vision applications for automatic inspection and quality evaluation of fruits and vegetables. Food and Bioprocess Technology, 2011; 4(4): 487–504.

Zhang B, Huang W, Li J, Zhao C, Fan S, Wu J, Liu C. Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: A review. Food Research International, 2014; 62: 326–343.

Wu D, Sun D-W. Colour measurements by computer vision for food quality control – A review. Trends in Food Science and Technology, 2013; 29(1): 5–20.

Ismail W I W, Razali M H. Machine vision to determine agricultural crop maturity. In: Eissa A A editor. Trends in Vital Food and Control Engineering. doi: 10.5772/26213: InTech (online); 2012. pp. 115–118.

Omid M, Khojastehnazhand M, Tabatabaeefar A. Estimating volume and mass of citrus fruits by image processing technique. Journal of Food Engineering, 2010; 100(2): 315–321.

Jarimopas B, Pushpariksha P, Singh S P. Postharvest damage of mangosteen and quality grading using mechanical and optical properties as indicators. International Journal of Food Properties, 2009; 12(2): 414 – 426.

Li Q, Wang M, Gu W. Computer vision based system for apple surface defect detection. Computers and Electronics in Agriculture, 2002; 36: 215–223.

Leemans V, Destain M F. A real-time grading method of apples based on features extracted from defects. Journal of Food Engineering, 2004; 61(1): 83–89.

Spreer W, Müller J. Estimating the mass of mango fruit (Mangifera indica, cv. Chok Anan) from its geometric dimensions by optical measurement. Computers and Electronics in Agriculture, 2011; 75(1): 125–131.

Chalidabhongse T, Yimyam P, Sirisomboon P. 2D/3D vision-based mango’s feature extraction and sorting. ICARCV '06 9th International Conference on Control, Automation, Robotics and Vision; 2006; Singapore. p 6.

Schulze K, Nagle M, Spreer W, Mahayothee B, Müller J. Development and assessment of different modeling approaches for size-mass estimation of mango fruits (Mangifera indica L., cv. ‘Nam Dokmai’). Computers and Electronics in Agriculture, 2015; 114: 269–276.

Yam K L, Papadakis S E. A simple digital imaging method for measuring and analyzing color of food surfaces. Journal of Food Engineering, 2004; 61(1): 137–142.

Mendoza F, Dejmek P, Aguilera J M. Calibrated color measurements of agricultural foods using image analysis. Postharvest Biology and Technology, 2006; 41(3): 285–295.

Pedreschi F, León J, Mery D, Moyano P. Development of a computer vision system to measure the color of potato chips. Food Research International, 2006; 39(10): 1092–1098.

Mendoza F, Aguilera J M. Application of image analysis for classification of ripening bananas. Journal of Food Science, 2004; 69(9): 471–477.

Garrido-Novell C, Pérez-Marin D, Amigo J M, Fernández-Novales J, Guerrero J E, Garrido-Varo A. Grading and color evolution of apples using RGB and hyperspectral imaging vision cameras. Journal of Food Engineering, 2012; 113(2): 281–288.

Romano G, Argyropoulos D, Nagle M, Khan M T, Müller J. Combination of digital images and laser light to predict moisture content and color of bell pepper simultaneously during drying. Journal of Food Engineering, 2012; 109(3): 438–448.

Ji W, Koutsidis G, Luo R, Hutchings J, Akhtar M, Megias F, Butterworth M. A digital imaging method for measuring banana ripeness. Color Research and Application, 2013; 38(5): 364–374.

Kang S P, East A R, Trujillo F J. Colour vision system evaluation of bicolour fruit: A case study with ‘B74’ mango. Postharvest Biology and Technology, 2008; 49(1): 77–85.

Jha S N, Chopra S, Kingsly A R P. Modeling of color values for nondestructive evaluation of maturity of mango. Journal of Food Engineering, 2007; 78(1): 22–26.

Jha S N, Narsaiah K, Sharma A D, Singh M, Bansal S, Kumar R. Quality parameters of mango and potential of non-destructive techniques for their measurement: a review. Journal of Food Science and Technology, 2010; 47(1): 1–14.

Rungpichayapichet P, Mahayothee B, Khuwijitjaru P, Nagle M, Müller J. Non-destructive determination of β-carotene content in mango by near-infrared spectroscopy compared with colorimetric measurements. Journal of Food Composition and Analysis, 2015; 38: 32–41.

Wanitchang P, Terdwongworakul A, Wanitchang J, Nakawajana N. Non-destructive maturity classification of mango based on physical, mechanical and optical properties. Journal of Food Engineering, 2011; 105(3): 477–484.

Fukuda S, Yasunaga E, Nagle M, Yuge K, Sardsud V, Spreer W, Müller J. Modelling the relationship between peel colour and the quality of fresh mango fruit using Random Forests. Journal of Food Engineering, 2014; 131: 7–17.

Jha S N, Kingsly A R P, Chopra S. Non-destructive determination of firmness and yellowness of mango during growth and storage using visual spectroscopy. Biosystems Engineering, 2006; 94(3): 397–402.

Kienzle S, Sruamsiri P, Carle R, Sirisakulwat S, Spreer W, Neidhart S. Harvest maturity detection for ‘Nam Dokmai #4’ mango fruit (Mangifera indica L.) in consideration of long supply chains. Postharvest Biology and Technology, 2012; 72(0): 64–75.

Kienzle S, Sruamsiri P, Carle R, Sirisakulwat S, Spreer W, Neidhart S. Harvest maturity specification for mango fruit (Mangifera indica L. 'Chok Anan') in regard to long supply chains. Postharvest Biology and Technology, 2011; 61(1): 41–55.

León K, Mery D, Pedreschi F, León J. Color measurement in L*a*b* units from RGB digital images. Food Research International, 2006; 39(10): 1084–1091.

Lalel H J D, Singh Z, Tan S C. Maturity stage at harvest affects fruit ripening, quality and biosynthesis of aroma volatile compounds in 'Kensington Pride' mango. Journal of Horticultural Science & Biotechnology, 2003; 78(2): 225–233.

McLellan M R, Lind L R, Kime R W. Hue angle determinations and statistical analysis for multiquadrant Hunter L, a, b data. Journal of Food Quality, 1995; 18(3): 235–240.

Inoue S. 'Color Converter' from Color Research Lab, Japan. 2004.

Hofman P J, Smith L G, Joyce D C, Johnson G I, Meiburg G F. Bagging of mango (Mangifera indica cv. `Keitt') fruit influences fruit quality and mineral composition. Postharvest Biology and Technology, 1997; 12(1): 83–91.

Kang S P, Sabarez H T. Simple colour image segmentation of bicolour food products for quality measurement. Journal of Food Engineering, 2009; 94(1): 21–25.

Hashim N, Janius R, Baranyai L, Rahman R, Osman A, Zude M. Kinetic model for colour changes in bananas during the appearance of chilling injury symptoms. Food and Bioprocess Technology, 2012; 5(8): 2952–2963.




Copyright (c)



2023-2026 Copyright IJABE Editing and Publishing Office