Data-Driven Structural Health Monitoring Using Feature Fusion and Hybrid Deep Learning

Smart structural health monitoring (SHM) for large-scale infrastructure is an intriguing subject for engineering communities thanks to its significant advantages such as timely damage detection, optimal maintenance strategy, and reduced resource requirement. Yet, it is a challenging topic as it requires handling a large amount of collected sensors data continuously, which is inevitably contaminated by random noises. Therefore, this study developed a practical end-to-end framework that makes use of physical features embedded in raw data and an elaborated hybrid deep learning model, namely 1-DCNN-LSTM, featuring two algorithms—convolutional neural network (CNN) and long-short term memory (LSTM). In order to extract relevant features from sensory data, the method combines various signal processing techniques such as the autoregressive model, discrete wavelet transform, and empirical mode decomposition. The hybrid deep learning 1-DCNN-LSTM is designed based on the CNN's capacity of capturing local information and the LSTM network's prominent ability to learn long-term dependencies. Through three case studies involving both experimental and synthetic data sets, it is demonstrated that the proposed approach achieves highly accurate damage detection, as accurate as the powerful 2-D CNN, but with a lower time and memory complexity, making it suitable for real-time SHM. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Note to Practitioners</i> —This article aims to develop a practical data-driven method for automatically monitoring the operational state of structures. In order to achieve consistently and highly accurate results in performing different tasks for diverse structures, we combine underlying features in both time and frequency domains extracted from measured signal vibration data. Three popular data featuring methods are combined to achieve the diversity gain which would not be possible with each individual method. As the vibration is usually measured by long time-series signals, the most efficient deep learning architecture for time-series signal, namely long-short term memory (LSTM), is considered for this work. Besides, each structure has its own dynamic properties, i.e., eigenfrequencies, around which the most relevant information is in the frequency domain, thus convolutional neural network specifically designed for capturing local information is used in combination with LSTM, forming a hybrid deep learning architecture. The applicability and effectiveness of the proposed approach are supported by three case studies with different types of structures, showing highly accurate damage detection with reduced resource requirements. These advantages can be valuable for developing a model for live monitoring of structural health in the future life-line infrastructures.