sensors-logo

Journal Browser

Journal Browser

Deep-Learning-Based Defect Detection for Smart Manufacturing

A special issue of Sensors (ISSN 1424-8220). This special issue belongs to the section "Fault Diagnosis & Sensors".

Deadline for manuscript submissions: 25 August 2024 | Viewed by 5312

Special Issue Editor


E-Mail Website
Guest Editor
Vicomtech Foundation, Basque Research and Technology Alliance (BRTA), Mikeletegi 57, 20009 Donostia-San Sebastián, Spain
Interests: computer vision; artificial intelligence; image processing and image understanding; simulation and 3D visualization; photography

Special Issue Information

Dear Colleagues,

Nowadays, artificial intelligence (AI) is becoming more widely used in the smart industry field, due to its ability to enhance production process efficiency, lower expenses, and improve production quality. The smart industry trend relies on the advanced integration of information and communication technologies, such as robotics, AI, Big Data, and the Internet of Things (IoT).

Within the smart industry, defect detection in production systems is one of the most popular applications of AI. By utilizing AI algorithms, such as deep learning, smart production systems are capable of analysing images and videos of production processes, detecting deviations, identifying problems in a timely manner, improving product quality, and predicting maintenance needs.

Implementing smart inspection systems presents unique challenges, including the complexity of the components to be inspected, the availability of training data, the design of agile and robust AI algorithms, and the deployment of these systems within real industrial scenarios. This Special Issue aims to highlight novel and cutting-edge research focused on artificial intelligence applied to industry and production processes.

In particular, submitted papers should clearly show novel contributions and innovative applications covering, among others, any of the following topics:

  • Machine vision and pattern recognition techniques;
  • The use of sensors in intelligent industrial quality control applications;
  • Data augmentation techniques in unfavourable scenarios of the lack or imbalance of data;
  • Artificial Intelligence techniques for surface defect detection and characterization;
  • Deployment and integration of intelligent quality control systems using machine vision in real industrial environments.

Dr. Iñigo Barandiaran
Guest Editor

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Sensors is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Published Papers (4 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

24 pages, 3978 KiB  
Article
LSTM-Autoencoder Based Anomaly Detection Using Vibration Data of Wind Turbines
by Younjeong Lee, Chanho Park, Namji Kim, Jisu Ahn and Jongpil Jeong
Sensors 2024, 24(9), 2833; https://doi.org/10.3390/s24092833 - 29 Apr 2024
Viewed by 286
Abstract
The problem of energy depletion has brought wind energy under consideration to replace oil- or chemical-based energy. However, the breakdown of wind turbines is a major concern. Accordingly, unsupervised learning was performed using the vibration signal of a wind power generator to achieve [...] Read more.
The problem of energy depletion has brought wind energy under consideration to replace oil- or chemical-based energy. However, the breakdown of wind turbines is a major concern. Accordingly, unsupervised learning was performed using the vibration signal of a wind power generator to achieve an outlier detection performance of 97%. We analyzed the vibration data through wavelet packet conversion and identified a specific frequency band that showed a large difference between the normal and abnormal data. To emphasize these specific frequency bands, high-pass filters were applied to maximize the difference. Subsequently, the dimensions of the data were reduced through principal component analysis, giving unique characteristics to the data preprocessing process. Normal data collected from a wind farm located in northern Sweden was first preprocessed and trained using a long short-term memory (LSTM) autoencoder to perform outlier detection. The LSTM Autoencoder is a model specialized for time-series data that learns the patterns of normal data and detects other data as outliers. Therefore, we propose a method for outlier detection through data preprocessing and unsupervised learning, utilizing the vibration signals from wind generators. This will facilitate the quick and accurate detection of wind power generator failures and provide alternatives to the problem of energy depletion. Full article
(This article belongs to the Special Issue Deep-Learning-Based Defect Detection for Smart Manufacturing)
Show Figures

Figure 1

18 pages, 42942 KiB  
Article
PCB Defect Detection via Local Detail and Global Dependency Information
by Bixian Feng and Jueping Cai
Sensors 2023, 23(18), 7755; https://doi.org/10.3390/s23187755 - 08 Sep 2023
Cited by 2 | Viewed by 1965
Abstract
Due to the impact of the production environment, there may be quality issues on the surface of printed circuit boards (PCBs), which could result in significant economic losses during the application process. As a result, PCB surface defect detection has become an essential [...] Read more.
Due to the impact of the production environment, there may be quality issues on the surface of printed circuit boards (PCBs), which could result in significant economic losses during the application process. As a result, PCB surface defect detection has become an essential step for managing PCB production quality. With the continuous advancement of PCB production technology, defects on PCBs now exhibit characteristics such as small areas and diverse styles. Utilizing global information plays a crucial role in detecting these small and variable defects. To address this challenge, we propose a novel defect detection framework named Defect Detection TRansformer (DDTR), which combines convolutional neural networks (CNNs) and transformer architectures. In the backbone, we employ the Residual Swin Transformer (ResSwinT) to extract both local detail information using ResNet and global dependency information through the Swin Transformer. This approach allows us to capture multi-scale features and enhance feature expression capabilities.In the neck of the network, we introduce spatial and channel multi-head self-attention (SCSA), enabling the network to focus on advantageous features in different dimensions. Moving to the head, we employ multiple cascaded detectors and classifiers to further improve defect detection accuracy. We conducted extensive experiments on the PKU-Market-PCB and DeepPCB datasets. Comparing our proposed DDTR framework with existing common methods, we achieved the highest F1-score and produced the most informative visualization results. Lastly, ablation experiments were performed to demonstrate the feasibility of individual modules within the DDTR framework. These experiments confirmed the effectiveness and contributions of our approach. Full article
(This article belongs to the Special Issue Deep-Learning-Based Defect Detection for Smart Manufacturing)
Show Figures

Figure 1

19 pages, 9344 KiB  
Article
Optimization of Gearbox Fault Detection Method Based on Deep Residual Neural Network Algorithm
by Zhaohua Wang, Yingxue Tao, Yanping Du, Shuihai Dou and Huijuan Bai
Sensors 2023, 23(17), 7573; https://doi.org/10.3390/s23177573 - 31 Aug 2023
Cited by 1 | Viewed by 883
Abstract
Because of its long running time, complex working environment, and for other reasons, a gear is prone to failure, and early failure is difficult to detect by direct observation; therefore, fault diagnosis of gears is very necessary. Neural network algorithms have been widely [...] Read more.
Because of its long running time, complex working environment, and for other reasons, a gear is prone to failure, and early failure is difficult to detect by direct observation; therefore, fault diagnosis of gears is very necessary. Neural network algorithms have been widely used to realize gear fault diagnosis, but the structure of the neural network model is complicated, the training time is long and the model is not easy to converge. To solve the above problems and combine the advantages of the ResNeXt50 model in the extraction of image features, this paper proposes a gearbox fault detection method that integrates the convolutional block attention module (CBAM). Firstly, the CBAM is embedded in the ResNeXt50 network to enhance the extraction of image channels and spatial features. Secondly, the different time–frequency analysis method was compared and analyzed, and the method with the better effect was selected to convert the one-dimensional vibration signal in the open data set of the gearbox into a two-dimensional image, eliminating the influence of the redundant background noise, and took it as the input of the model for training. Finally, the accuracy and the average training time of the model were obtained by entering the test set into the model, and the results were compared with four other classical convolutional neural network models. The results show that the proposed method performs well both in fault identification accuracy and average training time under two working conditions, and it also provides some references for existing gear failure diagnosis research. Full article
(This article belongs to the Special Issue Deep-Learning-Based Defect Detection for Smart Manufacturing)
Show Figures

Figure 1

17 pages, 2378 KiB  
Article
STMS-YOLOv5: A Lightweight Algorithm for Gear Surface Defect Detection
by Rui Yan, Rangyong Zhang, Jinqiang Bai, Huijuan Hao, Wenjie Guo, Xiaoyan Gu and Qi Liu
Sensors 2023, 23(13), 5992; https://doi.org/10.3390/s23135992 - 28 Jun 2023
Cited by 1 | Viewed by 1407
Abstract
Most deep-learning-based object detection algorithms exhibit low speeds and accuracy in gear surface defect detection due to their high computational costs and complex structures. To solve this problem, a lightweight model for gear surface defect detection, namely STMS-YOLOv5, is proposed in this paper. [...] Read more.
Most deep-learning-based object detection algorithms exhibit low speeds and accuracy in gear surface defect detection due to their high computational costs and complex structures. To solve this problem, a lightweight model for gear surface defect detection, namely STMS-YOLOv5, is proposed in this paper. Firstly, the ShuffleNetv2 module is employed as the backbone to reduce the giga floating-point operations per second and the number of parameters. Secondly, transposed convolution upsampling is used to enhance the learning capability of the network. Thirdly, the max efficient channel attention mechanism is embedded in the neck to compensate for the accuracy loss caused by the lightweight backbone. Finally, the SIOU_Loss is adopted as the bounding box regression loss function in the prediction part to speed up the model convergence. Experiments show that STMS-YOLOv5 achieves frames per second of 130.4 and 133.5 on the gear and NEU-DET steel surface defect datasets, respectively. The number of parameters and GFLOPs are reduced by 44.4% and 50.31%, respectively, while the mAP@0.5 reaches 98.6% and 73.5%, respectively. Extensive ablation and comparative experiments validate the effectiveness and generalization capability of the model in industrial defect detection. Full article
(This article belongs to the Special Issue Deep-Learning-Based Defect Detection for Smart Manufacturing)
Show Figures

Figure 1

Planned Papers

The below list represents only planned manuscripts. Some of these manuscripts have not been received by the Editorial Office yet. Papers submitted to MDPI journals are subject to peer-review.

Title: Failure modes classification for rolling element bearings using time-domain transformer-based encoder
Authors: Minh Vu Tri, Motoaki Hiraga, Nanako Miura, Arata Masuda* (*Corresponding author)
Affiliation: Kyoto Institute of Technology
Abstract: Existing Transformer models often require transformed data or extensive computational resources, limiting their practical adoption. we propose a simple yet competitive modification of the Transformer model, integrating a trainable noise reduction method specifically tailored for failure mode classification using vibration data in the time domain. Furthermore, we present the key architectural components and algorithms underlying our model, emphasizing interpretability and trustworthiness. Our model is trained and validated using two benchmark datasets: the IMS dataset (4 failure modes) and the CWRU dataset (4 and 10 failure modes). Notably, our model performs competitively, especially when using an unbalanced test set and a lightweight architecture.

Title: Optimizing Automated Optical Inspection: An Adaptive Fusion and Semi-Supervised Self-Learning Approach for Elevated Accuracy and Efficiency in Scenarios with Scarce Labeled Data
Authors: Yu-Shu Ni and Jiun-In Guo
Affiliation: Institute of Electronics, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
Abstract: In the realm of Automatic Optical Inspection (AOI), this study introduces two innovative technical strategies aimed at enhancing the accuracy of object detection models while reducing reliance on extensive annotated datasets. Initially, by establishing a preliminary defect detection workflow and utilizing a dataset collaboratively assembled with a major panel manufacturer in Taiwan, we developed and refined a defect detection model. This process commenced with a preliminary set of 3,579 images spanning 24 categories to construct the model. Subsequently, the model was evaluated on 12,000 ambiguously labeled images to assess its initial performance and verify the accuracy of the annotations. Through data augmentation, annotation refinement, and defect classification techniques, we enhanced the model's accuracy and generalizability, thereby expanding the defect dataset on unlabelled datasets and retraining the model. Moreover, addressing the self-learning needs of AOI inspection, we introduced an Adaptive-Fused Semi-Supervised Self-learning (AFSL) method. This approach, rooted in semi-supervised learning and tailored for Anchor-based object detection models, facilitates the model's self-learning and continuous optimization through a minimal set of labeled data and a larger volume of unlabeled data. The proposed AFSL technique, with its modules of Bounding Box Assigner, Adaptive Training Scheduler, and Data Allocator, enables dynamic threshold adjustments, balanced training between labeled and unlabeled data, and efficient data allocation, significantly boosting the model's accuracy on AOI datasets. This methodology not only elevates the precision and efficiency of AOI object detection but also provides an effective approach for achieving efficient model training with limited labeled data.

Title: End-to-End Fast Defect Detection in HBMs with Semi-Supervised and Incremental Learning
Authors: Richard Chang, Jie Wang, Ramanpreet Singh Pahwa
Affiliation: Institute for Infocomm Research, A*STAR
Abstract: Deep learning and AI methods can improve defect detection accuracy and reduce time and manpower required for a high-quality inspection process. Semi-supervised learning models have recently been applied to computer vision tasks and significantly increased the models’ capabilities on diverse data with high accuracy. In this paper, we leverage on the new advances in deep learning and semi-supervised models for segmentation in defect detection. We propose an end-to-end pipeline including detection, segmentation and metrology tasks with a new strategy to analyse the entire 3D scan in one pass instead of individual memory and logic bumps. We demonstrate the proposed work’s capabilities by showing significant reduction in the total processing time as well as the resources needed for defect detection with higher accuracy and efficiency. Our extensive experiments showed a 50% faster processing and an accuracy improvement by 10% compared our previous state-of-the-art approaches.

Back to TopTop