Abstract
Detecting cracks early in various structures is crucial not only for preserving the integrity of these structures but also for safeguarding lives, especially in environments like coal mines, bridges, and buildings. However, employing deep learning(DL) and computer vision for crack identification in mines poses significant challenges. These challenges arise from the presence of intensity inhomogeneity in cracks and the intricate nature of the background such as elements, shadows, lines, and water-dripping patterns, which can resemble more like cracks. Moreover, these techniques often struggle to detect extremely small cracks, further complicating the detection process. Manually inspecting these extensive structures is highly arduous. Utilizing DL techniques in conjunction with image processing can prove immensely beneficial in the early identification of these cracks. In this study, we improve the performance of TernausNet with modified loss functions. The encoder component of TernausNet is substituted with various networks, including VGG-16 [19], Resnet34 [7], and Resnet101 [7]. Additionally, the study investigates the utilization of pre-trained weights from ImageNet [16] for the encoder component and compares it against training from random initialization for crack detection using TernausNet.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Amhaz, R., Chambon, S., Idier, J., Baltazart, V.: Automatic crack detection on two-dimensional pavement images: an algorithm based on minimal path selection. IEEE Trans. Intell. Transp. Syst. 17(10), 2718–2729 (2016)
As’ad, S., Sukiman, M., et al.: Investigation on wall crack damage and its proposed repair method. Procedia Eng. 54, 165–175 (2013)
Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)
Benz, C., Debus, P., Ha, H.K., Rodehorst, V.: Crack segmentation on UAS-based imagery using transfer learning. In: 2019 International Conference on Image and Vision Computing NeGitHuband (IVCNZ), pp. 1–6. IEEE (2019)
Dollár, P., Zitnick, C.L.: Fast edge detection using structured forests. IEEE Trans. Pattern Anal. Mach. Intell. 37(8), 1558–1570 (2014)
Eisenbach, M., et al.: How to get pavement distress detection ready for deep learning? a systematic approach. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp. 2039–2047. IEEE (2017)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385 (2015)
Iglovikov, V., Shvets, A.: TernausNet: U-net with vgg11 encoder pre-trained on ImageNet for image segmentation. arXiv preprint arXiv:1801.05746 (2018)
Ke, W., Chen, J., Jiao, J., Zhao, G., Ye, Q.: SRN: side-output residual network for object symmetry detection in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1068–1076 (2017)
Liu, H., Zhang, M., Su, L., Chen, X., Liu, C., Sun, A.: A boundary model of terrain reconstruction in a coal-mining subsidence waterlogged area. Environ. Earth Sci. 80, 1–15 (2021)
Liu, Y., Yao, J., Lu, X., Xie, R., Li, L.: DeepCrack: a deep hierarchical feature learning architecture for crack segmentation. Neurocomputing 338, 139–153 (2019)
Liu, Y., Cheng, M.M., Hu, X., Wang, K., Bai, X.: Richer convolutional features for edge detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3000–3009 (2017)
Mundt, M., Majumder, S., Murali, S., Panetsos, P., Ramesh, V.: Meta-learning convolutional neural architectures for multi-target concrete defect classification with the concrete defect bridge image dataset. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11196–11205 (2019)
Pan, J.S., Yuan, S.X., Jiang, T., Cui, C.H.: Experimental study on crack characteristics and acoustic emission characteristics in rock-like material with pre-existing cracks. Sci. Rep. 11(1), 23790 (2021)
Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015, Part III. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. Int. J. Comput. Vision 115, 211–252 (2015)
Sharma, H., Pradhan, P., P, B.: SCNet: a generalized attention-based model for crack fault segmentation. In: Proceedings of the Twelfth Indian Conference on Computer Vision, Graphics and Image Processing, pp. 1–9 (2021)
Shi, Y., Cui, L., Qi, Z., Meng, F., Chen, Z.: Automatic road crack detection using random structured forests. IEEE Trans. Intell. Transp. Syst. 17(12), 3434–3445 (2016)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Takarli, F., Aghagolzadeh, A., Seyedarabi, H.: Combination of high-level features with low-level features for detection of pedestrian. Signal Image Video Process. 10(1), 93–101 (2016)
Tang, C., et al.: Inspection robot and wall surface detection method for coal mine wind shaft. Appl. Sci. 13(9), 5662 (2023)
Xie, S., Tu, Z.: Holistically-nested edge detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1395–1403 (2015)
Yu, X., Yang, J., Lin, Z., Wang, J., Wang, T., Huang, T.: Subcategory-aware object detection. IEEE Signal Process. Lett. 22(9), 1472–1476 (2014)
Zhang, L., Yang, F., Zhang, Y.D., Zhu, Y.J.: Road crack detection using deep convolutional neural network. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3708–3712. IEEE (2016)
Zhu, Q., Phung, M.D., Ha, Q.: Crack detection using enhanced hierarchical convolutional neural networks. arXiv preprint arXiv:1912.12139 (2019)
Zou, Q., Cao, Y., Li, Q., Mao, Q., Wang, S.: CrackTree: automatic crack detection from pavement images. Pattern Recogn. Lett. 33(3), 227–238 (2012)
Zou, Q., Zhang, Z., Li, Q., Qi, X., Wang, Q., Wang, S.: DeepCrack: learning hierarchical convolutional features for crack detection. IEEE Trans. Image Process. 28(3), 1498–1512 (2018)
Acknowledgement
This work is supported by IIT Kharagpur AI4ICPS I Hub Foundation, a.k.a AI4ICPS under the aegis of DST.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Patel, A., Sandhan, T. (2024). Robust CNN-Based Segmentation of Infrastructure Cracks Segregating from Shadows and Lines. In: Kaur, H., Jakhetiya, V., Goyal, P., Khanna, P., Raman, B., Kumar, S. (eds) Computer Vision and Image Processing. CVIP 2023. Communications in Computer and Information Science, vol 2011. Springer, Cham. https://doi.org/10.1007/978-3-031-58535-7_32
Download citation
DOI: https://doi.org/10.1007/978-3-031-58535-7_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-58534-0
Online ISBN: 978-3-031-58535-7
eBook Packages: Computer ScienceComputer Science (R0)