Implementation of YOLOV5 for Real-time Detection of Ships and Buoys using Jetson Nano and Deepstream on Autonomous Leisure Vessel

Authors

  • Ardi Prayoga Telkom University Author
  • Alfitho Surya Prabaswara Telkom University Author
  • Adri Firmansya Sofyan Telkom University Author
  • Erwin Susanto Telkom University Author
  • Muhammad Hablul Barri Telkom University Author

Keywords:

Object Detection, YOLOv5, Deepstream

Abstract

System detection on autonomous vehicle have become an increasingly important subject of research in recent years due to their potential to enhance safety and operational efficiency in the maritime sector. This research focuses on the implementation of YOLOv5 for real-time object detection, specifically foreign vessels and buoys, using Jetson Nano and Deepstream. The developed system utilizes serial communication between Jetson Nano and Arduino Mega 2560 to receive and display object detection data. Testing results show that the object detection system achieves 96.66% accuracy during the day and 90% at night. During the YOLOv5 model training, precision of 91.96%, recall of 77.69%, mAP_0.5 of 81.55%, and mAP 0.5:0.95 of 66.23% were obtained. This implementation enables autonomous vessels to detect and avoid objects in real-time, thereby improving safety and operational efficiency at sea.

References

[1] D. Parekh et al., “A Review on Autonomous Vehicles: Progress, Methods and Challenges,” Electron., vol. 11, no. 14, pp. 1–18, 2022, doi: 10.3390/electronics11142162.

[2] K. Salukh, “70 Persen Kecelakaan Kapal di Indonesia akibat Human Error.” [Online]. Available: https://www.victorynews.id/ntt/3319975829/70-persen-kecelakaan-kapal-di-indonesia-akibat-human-error

[3] J. Terven, D. M. Córdova-Esparza, and J. A. Romero-González, “A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS,” Mach. Learn. Knowl. Extr., vol. 5, no. 4, pp. 1680–1716, 2023, doi: 10.3390/make5040083.

[4] E. Yose, Victor, and N. Surantha, “Portable smart attendance system on Jetson Nano,” Bull. Electr. Eng. Informatics, vol. 13, no. 2, pp. 1050–1059, 2024, doi: 10.11591/eei.v13i2.6061.

[5] H. F. Al-Selwi, N. Hassan, H. B. A. Ghani, N. A. B. A. Hamzah, and A. B. A. Aziz, “Face mask detection and counting using you only look once algorithm with Jetson Nano and NVDIA giga texel shader extreme,” IAES Int. J. Artif. Intell., vol. 12, no. 3, pp. 1169–1177, 2023, doi: 10.11591/ijai.v12.i3.pp1169-1177.

[6] M. H. Guo et al., “Attention mechanisms in computer vision: A survey,” Comput. Vis. Media, vol. 8, no. 3, pp. 331–368, 2022, doi: 10.1007/s41095-022-0271-y.

[7] Z. Deng, C. Yao, and Q. Yin, “Safety Helmet Wearing Detection Based on Jetson Nano and Improved YOLOv5,” Adv. Civ. Eng., vol. 2023, 2023, doi: 10.1155/2023/1959962.

[8] B. Ma et al., “Distracted Driving Behavior and Driver’s Emotion Detection Based on Improved YOLOv8 With Attention Mechanism,” IEEE Access, vol. 12, pp. 37983–37994, 2024, doi: 10.1109/ACCESS.2024.3374726.

[9] N. F. Abdul Hassan, A. A. Abed, and T. Y. Abdalla, “Face mask detection using deep learning on NVIDIA Jetson Nano,” Int. J. Electr. Comput. Eng., vol. 12, no. 5, pp. 5427–5434, 2022, doi: 10.11591/ijece.v12i5.pp5427-5434.

[10] N. F. A. Hassan, A. A. Abed, and T. Y. Abdalla, “Surveillance system of mask detection with infrared temperature sensor on Jetson Nano Kit,” Bull. Electr. Eng. Informatics, vol. 11, no. 2, pp. 1047–1055, 2022, doi: 10.11591/eei.v11i2.3369.

[11] C. Qi, Z. Wu, L. Wang, H. Feng, and H. Yang, “Artificial intelligence garbage sorting vehicle based on deepstream,” Acad. J. Comput. Inf. Sci., vol. 5, no. 13, pp. 82–88, 2022, doi: 10.25236/ajcis.2022.051313.

[12] J. Bedkowski et al., “A novel approach to global positioning system accuracy assessment, verified on lidar alignment of one million kilometers at a continent scale, as a foundation for autonomous driving safety analysis,” Sensors, vol. 21, no. 17, pp. 1–19, 2021, doi: 10.3390/s21175691.

[13] M. Hussain, “YOLOv1 to v8: Unveiling Each Variant-A Comprehensive Review of YOLO,” IEEE Access, vol. 12, pp. 42816–42833, 2024, doi: 10.1109/ACCESS.2024.3378568.

[14] A. Ayodeji, M. A. Amidu, S. A. Olatubosun, Y. Addad, and H. Ahmed, “Deep learning for safety assessment of nuclear power reactors: Reliability, explainability, and research opportunities,” Prog. Nucl. Energy, vol. 151, no. April, p. 104339, 2022, doi: 10.1016/j.pnucene.2022.104339.

[15] I. Usmanov and M. Chernychka, “Maritime Autonomous Weapon Systems from the Standpoint of International Humanitarian Law,” Lex Portus, vol. 8, no. 2, pp. 33–53, 2022, doi: 10.26886/2524-101X.8.2.2022.2.

Downloads

Published

22/10/2024

How to Cite

[1]
“Implementation of YOLOV5 for Real-time Detection of Ships and Buoys using Jetson Nano and Deepstream on Autonomous Leisure Vessel”, jse, vol. 9, no. 4, Oct. 2024, Accessed: Dec. 12, 2024. [Online]. Available: http://jse.serambimekkah.id/index.php/jse/article/view/495

Similar Articles

You may also start an advanced similarity search for this article.