INVESTIGATION AND ANALYSIS OF CRACK DETECTION USING UAV AND CNN: A CASE STUDY OF HOSPITAL RAJA PERMAISURI BAINUN

Authors

  • Goh Wei Sheng Faculty of Computing, Universiti Malaysia Pahang
  • Wan Isni Sofiah Binti Wan Din Faculty of Computing, Universiti Malaysia Pahang
  • Waseem Quadri
  • Azlee Bin Zabidi Faculty of Computing, Universiti Malaysia Pahang, 26600 Pahang, Malaysia

DOI:

https://doi.org/10.15282/ijsecs.9.1.2023.2.0106

Keywords:

Crack Detection, Structures, Unmanned Aerial Vehicle, Machine Learning

Abstract

Crack detection in old buildings has been shown to be inefficient, with many technical challenges such as physical inspection and difficult measurements. It is important to have an automatic, fast visual inspection of these building components to detect cracks by evaluating their conditions (impact) and the level of their risk. Unmanned Aerial Vehicles (UAV) can automate, avoid visual inspection, and avoid other physical check-ups of these buildings. Automated crack detection using Machine Learning Algorithms (MLA), especially a Conventional Neural Network (CNN), along with an Unmanned Aerial Vehicle (UAV), can be effective and both can efficiently work together to detect the cracks in buildings using image processing techniques. The purpose of this research project is to evaluate currently available crack detection systems and to develop an automated crack detection system using Aggregate Channel Features (ACF) that can be used with unmanned aerial vehicles (UAV). Therefore, we conducted a real-world experiment of crack detection at Hospital Raja Permaisuri Bainun using DJI Mavic Air (Drone Hardware) and DJI GO 4(Drone Software) using CNN through MATLAB software with CNN-SVM method with the accuracy rate of 3.0 percent increased from 82.94% to 85.94%. in comparison with other ML algorithms like CNN Random Forest (RF), Support Vector Machine (SVM) and Artificial Neural Network (ANN).

References

Wu, X., Jiang, Y., Masaya, K., Taniguchi, T., & Yamato, T. “Study on the Correlation of Vibration Properties and Crack Index in

the Health Assessment of Tunnel Lining,” Shock and Vibration, 2017.

Talab, A. M. A., Huang, Z., Xi, F., & HaiMing, L. “Detection crack in image using Otsu method and multiple filtering in image

processing techniques,” Optik, 127(3), 1030–1033.2016

Adhikari, R. S., Moselhi, O., & Bagchi, A. “Image- based retrieval of concrete crack properties for bridge inspection,” Automation

in Construction, 39, 180–194. 2014

Hoang, N. D. “Detection of Surface Crack in Building Structures Using Image Processing Technique with an Improved Otsu

Method for Image Thresholding,” Advances in Civil Engineering, 2018.https://doi.org/10.1155/2018/3924120.

Smith, P., Reid, D. B., Environment, C., Palo, L., Alto, P., & Smith, P. L. Otsu_1979_otsu_method. IEEE Transactions on Systems,

Man, and Cybernetics, C(1), 62– 66. 1979

Mohan, A., & Poobal, S. “Crack detection using image processing: A critical review and analysis,” Alexandria Engineering

Journal, 57(2), 787–798. 2018

Kim, H., Ahn, E., Cho, S., Shin, M., & Sim, S.-H. “Comparative analysis of image binarization methods for crack identification

in concrete structures,” Cement and Concrete Research, 99,53–61. 2017.

Thatoi, D., Guru, P., Jena, P. K., Choudhury, S., & Das, H. C. “Comparison of CFBP, FFBP, and RBF networks in the field of

crack detection,” Modelling and Simulation in Engineering, 2014. https://doi.org/10.1155/2014/292175.

Koch, C., Georgieva, K., Kasireddy, V., Akinci, B., & Fieguth, P. “A review on computer vision based defect detection and

condition assessment of concrete and asphalt civil infrastructure,” Advanced Engineering Informatics, 29(2), 196–210. 2015

Zakeri, H., Nejad, F. M., & Fahimifar, A. “Image Based Techniques for Crack Detection, Classification and Quantification in

Asphalt Pavement: A Review,” Archives of Computational Methods in Engineering, 24(4), 935–977. 2017

Rabah, M., Elhattab, A., & Fayad, A. (2013). “Automatic concrete cracks detection and mapping of terrestrial laser scan data,”

NRIAG Journal of Astronomy and Geophysics, 2(2), 250–255. 2013

Rau, Jiann-Yeou, K. W. Hsiao, J. P. Jhan, S. H. Wang, W. C. Fang, and J. L. Wang. "Bridge crack detection using multi-rotary

UAV and object-base image analysis," The International Archives of Photogrammetry, Remote Sensing and Spatial Information

Sciences 42 (2017): 311.

Tedeschi, A., & Benedetto, F. “A real-time automatic pavement crack and pothole recognition system for mobile Android-based

devices,” Advanced Engineering Informatics, 32, 11–25. 2017. https://doi.org/10.1016/J.AEI.2016.12.004.

Chaiyasarn, K., Khan, W., Ali, L., Sharma, M., & Brackenbury, D. “Crack Detection in Masonry Structures using Convolutional

Neural Networks and Support Vector Machines,” Proceedings of the 35th ISARC, Berlin, Germany.pp. 118-125.2018.

Santos, R., Ribeiro, D., Lopes, P., Cabral, R., & Calçada, R. “Detection of exposed steel rebars based on deep-learning techniques

and unmanned aerial vehicles,” Automation in Construction, 139, 104324. 2022.

Kung, R. Y., Pan, N. H., Wang, C. C., & Lee, P. C. “Application of deep learning and unmanned aerial vehicle on building

maintenance,” Advances in Civil Engineering, 2021.

Ko, P., Prieto, S. A., & de Soto, B. G. “ABECIS: An automated building exterior crack inspection system using UAVs, opensource deep learning and photogrammetry,” In ISARC. Proceedings of the International Symposium on Automation and Robotics

in Construction (Vol. 38, pp. 637-644). 2021. IAARC Publications.

Saeed, M. S. “Unmanned Aerial Vehicle for Automatic Detection of Concrete Crack using Deep Learning,” In 2021 2nd

International Conference on Robotics, Electrical and Signal Processing Techniques (ICREST) (pp. 624-628). IEEE.

Silva, W. R. L. D., & Lucena, D. S. D. “Concrete cracks detection based on deep learning image classification,” 18th International

Conference on Experimental Mechanics (ICEM18) ,Vol. 2, No. 8, p. 489. 2018. MDPI AG.

Bhowmick, S., Nagarajaiah, S., & Veeraraghavan. A. “Vision and deep learning-based algorithms to detect and quantify cracks

on concrete surfaces from UAV videos,” Sensors, 20(21). 2020.

Best-Rowden, L., Han, H., Otto, C., Klare, B. F., & Jain, A. K. “Unconstrained face recognition: Identifying a person of interest

from a media collection,” IEEE Transactions on Information Forensics and Security, 9(12), 2144–2157. 2014

https://doi.org/10.1109/TIFS.2014.2359577

Dollár, P., Tu, Z., Perona, P., & Belongie, S. “Integral channel features,” British Machine Vision Conference, BMVC 2009 -

Proceedings, January 2009. https://doi.org/10.5244/C.23.91

Bourdev, L., & Brandt, J. “Robust object detection via soft cascade,” Proceedings - 2005 IEEE Computer Society Conference on

Computer Vision and Pattern Recognition, CVPR 2005, II(July 2005), 236–243. https://doi.org/10.1109/CVPR.2005.310

Published

2023-01-03

How to Cite

Sheng, G. W. ., Binti Wan Din, W. I. S., Waseem Quadri, & Bin Zabidi, A. (2023). INVESTIGATION AND ANALYSIS OF CRACK DETECTION USING UAV AND CNN: A CASE STUDY OF HOSPITAL RAJA PERMAISURI BAINUN. International Journal of Software Engineering and Computer Systems, 9(1), 10–26. https://doi.org/10.15282/ijsecs.9.1.2023.2.0106