Hostname: page-component-74656f9884-c52kr Total loading time: 0 Render date: 2026-11-06T16:18:58.608Z Has data issue: false hasContentIssue false

Unsupervised scene-based clustering for underwater structural health monitoring: Enhancing image categorization and feature matching

Published online by Cambridge University Press:  04 August 2026

Kiyarash Aminfar
Affiliation:
Department of Civil, Environmental, and Infrastructure Engineering, George Mason University , USA
David Lattanzi*
Affiliation:
Department of Civil, Environmental, and Infrastructure Engineering, George Mason University , USA
*
Corresponding author: David Lattanzi; Email: dlattanz@gmu.edu

Abstract

This study presents a scene-based clustering methodology for underwater structural health monitoring (SHM), categorizing images by intrinsic scene attributes (visibility, color, and turbidity). Shifting focus from object detection to holistic scene understanding enhances automated condition assessment in underwater infrastructure inspection by prefiltering suboptimal images and optimizing downstream tasks such as image matching and alignment. Ensuring algorithms operate on images with consistent lighting, texture, and clarity reduces ambiguities and enhances feature correspondence. It integrates local and global feature extraction, correlation analysis, feature selection, dimensionality reduction, and outlier detection to improve clustering accuracy and pipeline robustness. Clustering uses hierarchical and centroid-based algorithms, evaluated by Silhouette Score, Calinski-Harabasz Index, F1-score, V-measure, Adjusted Mutual Information, and Adjusted Rand Index, applying the Hungarian algorithm for label mapping in pseudo-labeled cases. The methodology is validated on real and synthetic underwater datasets, including a bridge inspection video dataset with abovewater and underwater segments, and controlled laboratory experiments assessing turbidity effects on submerged structural elements. A key contribution is assessing feature matching performance across clustered and unclustered image sets, demonstrating that scene-based clustering significantly enhances keypoint detection, feature correspondence, and inlier ratios while reducing mismatches from illumination and viewpoint variations. Additionally, engineered features outperform pretrained deep learning features in this unsupervised setting, providing more reliable global scene representation and improved clustering and feature matching outcomes. These findings establish the proposed pipeline as a valuable tool for underwater SHM, supporting applications such as 3D reconstruction, infrastructure assessment, and autonomous underwater inspections.

Information

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2026. Published by Cambridge University Press
Figure 0

Table 1. Comparison of the proposed framework with existing underwater image analysis methodsTable 1. long description.

Figure 1

Figure 1. The underwater scene analysis pipeline.

Figure 2

Table 2. Overview of image feature extraction techniques employedTable 2. long description.

Figure 3

Figure 2. Sample images from the UIEB dataset.Figure 2. long description.

Figure 4

Figure 3. Occoquan bridge and target piers are shown by rectangles.

Figure 5

Figure 4. Mounted camera setup showing LED lights, Wi-Fi extender, and underwater housing. The backside of the camera is also visible on the right.

Figure 6

Figure 5. Schematic illustration of the laboratory experimental setup (not to scale).

Figure 7

Figure 6. Representative photograph of the laboratory setup: textured (left) and untextured (right) specimens.

Figure 8

Table 3. Summary of dataset ground truth characteristics and labeling semanticsTable 3. long description.

Figure 9

Figure 7. Distribution of UCIQE scores across datasets, illustrating variations in image quality characteristics.Figure 7. long description.

Figure 10

Figure 8. Box plot of BRISQUE scores across datasets, showing variations in image quality and distribution.Figure 8. long description.

Figure 11

Figure 9. Histograms of Field Test 1 data for different quality metrics, illustrating their distributions and effectiveness in characterizing image quality.Figure 9. long description.

Figure 12

Table 4. Reduced number of features per dataset after correlation filteringTable 4. long description.

Figure 13

Table 5. Clustering performance at the maximum composite scoreTable 5. long description.

Figure 14

Figure 10. Correlation matrix of quality assessment metrics for the Lab Test dataset.Figure 10. long description.

Figure 15

Figure 11. Heat map of Silhouette score for Field Test 3. (a) Engineered Features and (b) Deep Features.Figure 11. long description.

Figure 16

Figure 12. Clustering performance evaluation metrics for Field Test 1 using K-means (Engineered Features).Figure 12. long description.

Figure 17

Figure 13. Clustering performance evaluation metrics for UIEB dataset using K-means (Engineered Features).Figure 13. long description.

Figure 18

Figure 14. t-SNE visualization demonstrating DBSCAN failure modes across six representative parameter configurations on Field Test 1 dataset. Gray points indicate noise classification (excluded from clustering).Figure 14. long description.

Figure 19

Table 6. Optimal clustering configurations across datasets, with the number of clusters (in parentheses) determined by each metricTable 6. long description.

Figure 20

Table 7. Class-cluster relationships for labeled dataset (UCCS) along with external validity indicesTable 7. long description.

Figure 21

Figure 15. Clustering outcomes for UIEB, displaying randomly selected samples from each predicted cluster.Figure 15. long description.

Figure 22

Figure 16. Clustering outcomes for Field Test 1, displaying randomly selected samples from each predicted cluster. Each row represents a distinct cluster, including images captured above water, images depicting piers, and images with minimal structural content (e.g., open water).Figure 16. long description.

Figure 23

Table 8. Feature matching performance in Field Test 3 using the SIFTTable 8. long description.

Figure 24

Table 9. Performance comparison of SIFT, ORB, and AKAZE in Field Test 3Table 9. long description.

Figure 25

Table 10. Validation of pipeline components for Field Test 3Table 10. long description.

Figure 26

Table 11. Metashape results for Field Test 1Table 11. long description.

Submit a response

Comments

No Comments have been published for this article.