The Convolutional Neural Network as a Tool for Predicting Fruit Quality and Freshness Based on Images

Emilianto Sefri Bere; Binastya Anggara  Sekti

doi:10.29207/joseit.v3i2.6130

Emilianto Sefri Bere STIKOM Uyelindo
Binastya Anggara Sekti Universitas Esa Unggul

DOI: https://doi.org/10.29207/joseit.v3i2.6130

Keywords: digital imagery, machine learning, convolutional neural network

Abstract

The lack of technology that can monitor changes in fruit quality in the supply chain can result in a large amount of fruit being wasted. Digital imagery can be used to reduce fruit wastage in monitoring and predicting fruit quality throughout its life. In post-harvest engineering, digital images can be used as virtual representations of real products. This research will present a new approach to monitor the quality changes of banana fruit with machine learning-based imagery, using a thermal camera to acquire data with its ability to detect surface area and physiological changes of banana fruit. In this research, model training has been performed using intelligent technology from SAP after the thermal data dataset has been built. By using thermal information to monitor the status of the fruit, this solution utilizes a deep artificial neural network. The training process has shown that it is more accurate. Therefore, the thermal imaging technique has been used as a data source to create a machine learning-based digital twin of the fruit that can reduce waste in the food supply chain. Thus, 99% prediction accuracy has been achieved.

Downloads

Download data is not yet available.

References

Yuh I. Sa, Z. Ge, F. Dayoub, B. Upcroft, T. Perez, and C. McCool, “Deepfruits: A fruit detection system using deep neural networks,” Sensors (Switzerland), vol. 16, no. 8, Aug. 2016, doi: 10.3390/s16081222.

H. Gan, W. S. Lee, V. Alchanatis, R. Ehsani, and J. K. Schueller, “Immature green citrus fruit detection using color and thermal images,” Comput Electron Agric, vol. 152, pp. 117–125, Sep. 2018, doi: 10.1016/j.compag.2018.07.011.

T. Y. Melesse, M. Bollo, V. Di Pasquale, F. Centro, and S. Riemma, “Machine Learning- Based Digital Twin for Monitoring Fruit Quality Evolution,” in Procedia Computer Science, Elsevier B.V., 2022, pp. 13–20. doi: 10.1016/j.procs.2022.01.200.

V. Gonzalez-Huitron, J. A. León-Borges, A. E. Rodriguez-Mata, L. E. Amabilis-Sosa, B. Ramírez-Pereda, and H. Rodriguez, “Disease detection in tomato leaves via CNN with lightweight architectures implemented in Raspberry Pi 4,” Comput Electron Agric, vol. 181, Feb. 2021, doi: 10.1016/j.compag.2020.105951.

M. G. Selvaraj et al., “AI-powered banana diseases and pest detection,” Plant Methods, vol. 15, no. 1, Aug. 2019, doi: 10.1186/s13007- 019-0475-z.

Y. Liu, H. Pu, and D. W. Sun, “Efficient extraction of deep image features using convolutional neural network (CNN) for applications in detecting and analysing complex food matrices,” Jul. 01, 2021, Elsevier Ltd. doi: 10.1016/j.tifs.2021.04.042.

J. F. I. Nturambirwe and U. L. Opara, “Machine learning applications to non- destructive defect detection in horticultural products,” Jan. 01, 2020, Academic Press. doi: 10.1016/j.biosystemseng.2019.11.011.

T. T. Le, C. Y. Lin, and E. J. Piedad, “Deep learning for noninvasive classification of clustered horticultural crops – A case for banana fruit tiers,” Postharvest Biol Technol, vol. 156, Oct. 2019, doi: 10.1016/j.postharvbio.2019.05.023.

E. O. Olaniyi, O. K. Oyedotun, and K. Adnan, “Intelligent Grading System for Banana Fruit Using Neural Network Arbitration,” J Food Process Eng, vol. 40, no. 1, Feb. 2017, doi: 10.1111/jfpe.12335.

MIT World Peace University, Institute of Electrical and Electronics Engineers. Pune Section, and Institute of Electrical and Electronics Engineers, 2019 IEEE Pune Section International Conference (PuneCon) : MIT World Peace University, Pune, India. Dec 18- 20, 2019.

S. S. S. Palakodati, V. R. R. Chirra, Y. Dasari, and S. Bulla, “Fresh and rotten fruits classification using CNN and transfer learning,” Revue d’Intelligence Artificielle, vol. 34, no. 5, pp. 617–622, Oct. 2020, doi: 10.18280/ria.340512.

Institute of Electrical and Electronics Engineers, Adhiparasakthi Engineering College. Department of Electronics and Communication Engineering, and Institute of Electrical and Electronics Engineers. Madras Section, Proceedings of the 2017 IEEE International Conference on Communication and Signal Processing (ICCSP) : 6th-8th April, 2017, Melmaruvathur, India.

R. Vadivambal and D. S. Jayas, “Applications of Thermal Imaging in Agriculture and Food Industry-A Review,” Feb. 2011. doi: 10.1007/s11947-010-0333-5.

R. Karthik, M. Hariharan, S. Anand, P. Mathikshara, A. Johnson, and R. Menaka, “Attention embedded residual CNN for disease detection in tomato leaves,” Applied Soft Computing Journal, vol. 86, Jan. 2020, doi: 10.1016/j.asoc.2019.105933.

J. Kuzy, Y. Jiang, and C. Li, “Blueberry bruise detection by pulsed thermographic imaging,” Postharvest Biol Technol, vol. 136, pp. 166– 177, Feb. 2018, doi:

1016/j.postharvbio.2017.10.011.

R. E. Saragih and A. W. R. Emanuel, “Banana Ripeness Classification Based on Deep Learning using Convolutional Neural Network,” in 3rd 2021 East Indonesia Conference on Computer and Information Technology, EIConCIT 2021, Institute of Electrical and Electronics Engineers Inc., Apr. 2021, pp. 85–89. doi: 10.1109/EIConCIT50028.2021.9431928.

IEEE Staff, 2019 International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT). IEEE, 2019.

L. Fu et al., “Fast and accurate detection of banana fruits in complex background orchards,” IEEE Access, vol. 8, pp. 196835– 196846, 2020, doi: 10.1109/ACCESS.2020.3029215.

H. C. Shin et al., “Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning,” IEEE Trans Med Imaging, vol. 35, no. 5, pp. 1285–1298, May 2016, doi: 10.1109/TMI.2016.2528162.

S. N. Guerrero and S. M. Alzamora, “Effect of pH, Temperature and Glucose Addition on Flow Behaviour of Fruit PurCes I. Banana Puree.”