Anomaly Detection

Assembly Line

πŸ–¨οΈ Visual quality control in additive manufacturing: Building a complete pipeline

πŸ“… Date:

✍️ Authors: Marko Nikolic, Ilya Katsov, Aleksandar Bozic

πŸ”– Topics: Additive Manufacturing, Quality Assurance, Machine Learning, Anomaly Detection

🏒 Organizations: Grid Dynamics


In this article, we share a reference implementation of a VQC pipeline for additive manufacturing that detects defects and anomalies on the surface of printed objects using depth-sensing cameras. We show how we developed an innovative solution to synthetically generate point clouds representing variations on 3D objects, and propose multiple machine learning models for detecting defects of different sizes. We also provide a comprehensive comparison of different architectures and experimental setups. The complete reference implementation is available in our git repository.

The main objective of this solution is to develop an architecture that can effectively learn from a sparse dataset, and is able to detect defects on a printed object by controlling the surface of the printed object each time a new layer is added. To address the challenge of acquiring a sufficient quantity of defect anomalies data for accurate ML model training, the proposed approach leverages a synthetic data generation approach. The controlled nature of the additive manufacturing process reduces the presence of unaccounted exogenous variables, making synthetic data a valuable resource for initial model training. In addition to this, we hypothesize that by deliberately inducing overfitting of the model on good examples, the model will become more accurate in predicting the presence of anomalies/defects. To achieve this, we generate a number of normal examples with introduced noise in a ratio that balances the defects occurrence expected during the manufacturing process. For instance, if the fault ratio is 10 to 1, we generate 10 similar normal examples for every 1 defect example. Hence, the pipeline for initial training consists of two modules: the synthetic generation module and the module for training anomaly detection models.

Read more at Grid Dynamics Blog

Detecting anomalies in high-dimensional IoT data using hierarchical decomposition and one-class learning

πŸ“… Date:

✍️ Author: Volodymyr Koliadin

πŸ”– Topics: Anomaly Detection, IIoT

🏒 Organizations: Grid Dynamics


Automated health monitoring, including anomaly/fault detection, is an absolutely necessary attribute of any modern industrial system. Problems of this sort are usually solved through algorithmic processing of data from a great number of physical sensors installed in various equipment. A broad range of ML-based and statistical techniques are used here. An important common parameter that defines the practical complexity and tractability of the problem is the dimensionality of the feature vector generated from the signals of the sensors.

While there is a great variety of methods and techniques described in ML and statistical literature, it is easy to go in the wrong direction when trying to solve problems for industrial systems with a large number of IoT sensors. The seemingly β€œobvious” and stereotypical solutions often lead to dead-ends or unnecessary complications when applied to such systems. Here we generalize our experience and delineate some potential pitfalls of the stereotypical approaches. We also outline quite a general methodology that helps to avoid such traps when dealing with IoT data of high dimension. The methodology rests on two major pillars: hierarchical decomposition and one-class learning. This means that we try to start health monitoring from the most elementary parts of the whole system, and we learn mainly from the healthy state of the system.

Read more at Grid Dynamics Blog

Anomaly detection in industrial IoT data using Google Vertex AI: A reference notebook

πŸ“… Date:

✍️ Authors: Volodymyr Koliadin, Ilya Katsov

πŸ”– Topics: Anomaly Detection, IIoT

🏒 Organizations: Grid Dynamics, Google


Modern manufacturing, transportation, and energy companies routinely operate thousands of machines and perform hundreds of quality checks at different stages of their production and distribution processes. Industrial sensors and IoT devices enable these companies to collect comprehensive real-time metrics across equipment, vehicles, and produced parts, but the analysis of such data streams is a challenging task.

We start with a discussion of how the health monitoring problem can be converted into standard machine learning tasks and what pitfalls one should be aware of, and then implement a reference Vertex AI pipeline for anomaly detection. This pipeline can be viewed as a starter kit for quick prototyping of IoT anomaly detection solutions that can be further customized and extended to create production-grade platforms.

Read more at Grid Dynamics Blog

U.S. Navy Takes Falkonry AI to the High Seas for Increased Equipment Reliability and Performance

πŸ“… Date:

πŸ”– Topics: Anomaly Detection

🏭 Vertical: Defense

🏒 Organizations: Falkonry, US Navy, Oracle, NVIDIA


Falkonry today announced a big leap for Falkonry AI with the Office of Naval Research deploying its AI applications to advance equipment reliability on the high seas. This AI deployment is carried out with a Falkonry-designed reference architecture using NVIDIA accelerated computing and Oracle Cloud Infrastructure’s (OCI’s) distributed cloud. It enables better performance and reliability awareness using electrical and mechanical time series data from thousands of sensors at ultra-high speed.

Falkonry has designed its automated anomaly detection application, Falkonry Insight, to take advantage of Edge computing capabilities that are now available for high security and edge-to-cloud connectivity. Falkonry Insight includes a patent-pending, high-throughput time series AI engine that inspects every sensor data point to identify reliability and performance anomalies along with their contributing factors. Falkonry Insight organizes the information needed by operations teams to determine root causes and automatically informs operations teams to take rapid action. By inserting an edge device into the US Navy’s operational environment that can process data continuously, increasingly sophisticated naval platforms can maintain high reliability and performance out at sea.

Read more at Falkonry Newsroom

Build an Anomaly Detection Model using SME expertise

Achieving World-Class Predictive Maintenance with Normal Behavior Modeling

πŸ“… Date:

✍️ Author: Brian Kenneth Swain

πŸ”– Topics: Predictive Maintenance, Autoencoder, Anomaly Detection

🏒 Organizations: SparkCognition


Central to the normal behavior modeling (NBM) concept is an algorithm known as an autoencoder, shown in Figure 1. Over time, the autoencoder’s input layer ingests a continuous stream of quantitative data from equipment sensors (temperature, pressure, etc.). This data is then fed to a hidden layer (of which there are typically several), where it gets compressed. Numerical weights (a value between 0 and 1) are then applied to each node, with the goal of eventually reproducing the input values at the output layer.

The principal purpose of NBM is to define the normal state of a complex system and then proactively identify instances where the system is operating outside of normal with sufficient advance warning to allow maintenance or repair actions to take place to avoid revenue loss, repair costs, and safety compromises that typically come with such failures.

Read more at SparkCognition Blog

Predicting Defrost in Refrigeration Cases at Walmart using Fourier Transform

πŸ“… Date:

✍️ Author: Sujay Madbhavi

πŸ”– Topics: Anomaly Detection, E-commerce

🏒 Organizations: Walmart


As the largest grocer in the United States, Walmart has a massive assembly of supermarket refrigeration systems in its stores across the country. Food quality is an essential part of our customer experience and Walmart spends a considerable amount annually on maintenance of its vast portfolio of refrigeration systems. In an effort to improve the overall maintenance practices, we use preventative and proactive maintenance strategies. We at Walmart Global Tech use IoT data and build algorithms to study and proactively detect anomalous events in refrigeration systems at Walmart.

Read more at Walmart Global Tech

Condition monitoring in steel mills: 3 fault detections

Forecast Anomalies in Refrigeration with PySpark & Sensor-data

πŸ“… Date:

πŸ”– Topics: anomaly detection, predictive maintenance, cloud computing

🏒 Organizations: Walmart


A refrigeration has four important components: Compressor, Condenser Fan, Evaporator Fan & Expansion Valve. Loosely speaking, together they try to keep the pressure at a reasonable level so as to maintain the temperature within (Remember, PV = nRT). In Walmart, we collect sensor data for all of these components (eg. pressure, fan speed, temperature) at a 10 minutes interval along with metrics like if the system is in defrost or not, compressor is locked out or not etc. We also capture outside air temperature as it impacts the condenser fan speed and in turn, the temperature.

The objective is to minimize the number of malfunctions and suggest probable resolutions of the same to save time. So, we leveraged this telemetry information in order to forecast anomalies in temperature, which would help in prioritizing issues and be proactive rather than reactive.

Read more at Walmart Global Tech Blog

Intelligent edge management: why AI and ML are key players

πŸ“… Date:

✍️ Authors: Fetahi Wuhib, Mbarka Soualhia, Carla Mouradian, Wubin Li

πŸ”– Topics: AI, machine learning, edge computing, anomaly detection

🏒 Organizations: Ericsson


What will the future of network edge management look like? We explain how artificial intelligence and machine learning technologies are crucial for intelligent edge computing and the management of future-proof networks. What’s required, and what are the building blocks needed to make it happen?

Read more at Ericsson

Using Machine Learning to identify operational modes in rotating equipment

πŸ“… Date:

✍️ Author: Frederik Wartenberg

πŸ”– Topics: anomaly detection, vibration analysis, machine learning

🏒 Organizations: Viking Analytics


Vibration monitoring is key to performing condition monitoring-based maintenance in rotating equipment such as engines, compressors, turbines, pumps, generators, blowers, and gearboxes. However, periodic route-based vibration monitoring programs are not enough to prevent breakdowns, as they normally offer a narrower view of the machines’ conditions.

Adding Machine Learning algorithms to this process makes it scalable, as it allows the analysis of historic data from equipment. One of the benefits is being able to identify operational modes and help maintenance teams to understand if the machine is operating in normal or abnormal conditions.

Read more at Viking Analytics Blog

Application of AI to Oil Refineries and Petrochemical Plants

πŸ“… Date:

✍️ Author: Tetsuya Ohtani

πŸ”– Topics: Failure Analysis, Factor Analysis, Anomaly Detection

🏭 Vertical: Petroleum and Coal

🏒 Organizations: Yokogawa


Artificial intelligent (AI), machine learning, data science, and other advanced technologies have been progressing remarkably, enabling computers to handle labor- and time-consuming tasks that used to be done manually. As big data have become available, it is expected that AI will automatically identify and solve problems in the manufacturing industry. This paper describes how AI can be used in oil refineries and petrochemical plants to solve issues regarding assets and quality.

Read more at Yokogawa Technical Report

A Case of Applying AI to an Ethylene Plant

πŸ“… Date:

✍️ Authors: Yoshiyuki Jinguu, Hirotsugu Gotou

πŸ”– Topics: Predictive Maintenance, Anomaly Detection

🏭 Vertical: Chemical

🏒 Organizations: Yokogawa


Unexpected equipment failures or maintenance may result in unscheduled plant shutdowns in continuously operating petrochemical plants such as ethylene plants. To avoid this, the operation status needs to be continuously monitored. However, since troubles in plants have various causes, it is difficult for human workers to precisely grasp the plant status and notice the signs of unexpected failures and need for maintenance. To solve this problem, we worked with a customer in an ethylene plant and developed a solution based on AI analysis. Using AI analysis based on customer feedback, we identified several factors from numerous sensor parameters and created an AI model that can grasp the plant status and detect any signs of abnormalities. This paper introduces a case study of AI analysis carried out in an ethylene plant and the new value that AI technology can offer to customers, and then describes how to extend the solution business with AI analysis.

Read more at Yokogawa Technical Report