EuroPallet Detection with RGB-D Camera Based on Deep Learning

Main Article Content

Gokhan Atali

Abstract

This study related to enhancing processes and production efficiency in industrial settings by opting for autonomous mobile robots dedicated to indoor transportation and logistics. The specific focus of this research is on employing deep learning for the detection of Euro pallet objects, enabling a mobile robot, specifically the Servant-T1500 model by Kar Metal company with natural navigation capabilities, to autonomously dock and handle palletized loads with precision.


To accomplish this, an original dataset was curated using an RGB-D camera, and data augmentation techniques were applied to expand this dataset. Subsequently, a deep learning model was trained on this data to detect Euro pallets in images it had not encountered during training. The transfer learning method was applied using the YOLOv5 model on the dataset. The successful outcome of this process demonstrates the autonomous robot's capability to accurately recognize Euro pallet objects even under changing lighting conditions. This achievement marks a significant step toward optimizing industrial processes and improving production efficiency through the integration of autonomous mobile robots in logistics and transportation tasks.

Downloads

Download data is not yet available.

Article Details

How to Cite
Kirci, S., & Atali, G. (2023). EuroPallet Detection with RGB-D Camera Based on Deep Learning. The European Journal of Research and Development, 3(4), 55–65. https://doi.org/10.56038/ejrnd.v3i4.341
Section
Articles

References

Czimmermann, T., Ciuti, G., Milazzo, M., Chiurazzi, M., Roccella, S., Oddo, C. M., & Dario, P. (2020, 3 6). Visual-Based Defect Detection and Classification Approaches for Industrial Applications—A SURVEY. Sensors. DOI: https://doi.org/10.3390/s20051459

Deng, H., Cheng, Y., Feng, Y., & Xiang, J. (2021, 09 18). Industrial Laser Welding Defect Detection and Image Defect Recognition Based on Deep Learning Model Developed. Symmetry. DOI: https://doi.org/10.21203/rs.3.rs-149365/v1

Shahmoradi, J., Talebi, E., Roghanchi, P., & Hassanalian, M. (2020, 07 15). A Comprehensive Review of Applications of Drone Technology in the Mining Industry. Drones. DOI: https://doi.org/10.3390/drones4030034

Bach, S.-H., Khoi, P.-B., & Yi, S.-Y. (2023). Application of QR Code for Localization and Navigation of Indoor Mobile Robot. IEEE, (s. 28354-28390). DOI: https://doi.org/10.1109/ACCESS.2023.3250253

Guo, S., Fang, T.-T., Song, T., Xi, F.-F., & Wei, B.-G. (2018, 02 28). Tracking and localization for omni-directional mobile industrial robot using reflectors. Adv. Manuf. DOI: https://doi.org/10.1007/s40436-018-0216-y

Bosnak, M., & Skrjanc, I. (2021). Obstacle Avoidance for Line-Following AGV with Local Maps. International Symposium on Applied Computational Intelligence and Informatic SACI 2021, (s. 193-198). Timişoara. DOI: https://doi.org/10.1109/SACI51354.2021.9465550

Jia, F., Tao, Z., & Wang, F. (2021). Pallet Detection Based on Halcon and Alex:Net Network for Autonomous Forklifts. International Conference on Internet, Education and Information Technology, (s. 86-89). DOI: https://doi.org/10.1109/IEIT53597.2021.00025

Kurnianto, H., & Rusmin, P. H. (2022). Task Allocation and Path Planning Method For Multi-Autonomous Forklift Navigation. International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), (s. 631-636). DOI: https://doi.org/10.1109/ISRITI56927.2022.10053045

Manurung, P., Rusmin, P. H., & Yusuf, R. (2022). Custom Pallet Detection Using YOLOv5 Deep Learning Architecture. International Symposium on Electronics and Smart Devices (ISESD). DOI: https://doi.org/10.1109/ISESD56103.2022.9980635

Rahman, M., Kanchi, M., Pasha, M., & Yadla, B. (2021). Design and Development of Autonomous Warehouse Management Robot with Intelligent Software Framework. International Conference on Mobile Networks and Wireless Communications. DOI: https://doi.org/10.1109/ICMNWC52512.2021.9688354

Syu, J.-L., Li, H.-T., Chiang, J.-S., Hsia, C.-H., Wu, P.-H., Hsieh, C.-F., & Li, S.-A. (2016, 11 2). A computer vision assisted system for autonomous forklift vehicles in real factory environment. Multimated Tools Appl. DOI: https://doi.org/10.1007/s11042-016-4123-6

Li, T., Huang, B., & Huang, M. (2018). Application of convolution neural network object detection algorithm in logistics warehouse. International Symposium on Test Automation and Instrumentation. The Journal of Engineering.

Shao, Y., Fan, Z., Zhu, B., Zhou, M., Chen, Z., & Lu, J. (2022, 11 9). A Novel Pallet Detection Method for Automated Guided Vehicles Based on Point Cloud Data. sensors. DOI: https://doi.org/10.3390/s22208019

Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You Only Look Once: Unified, Real-Time Object Detection. Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, USA. DOI: https://doi.org/10.1109/CVPR.2016.91

Ultralytics. (2021). YOLOv5: A state-of-the-art real-time object detection system. https://docs.ultralytics.com.