Cognitive Solutions
The Cognitive Automation Platform will coordinate a set of specific cognitive solutions at the various levels of functional organisation of the automation (from planning to sensors) based on the analysis of the different use cases involved in CAPRI.

Planning & Control of Asphalt Production[CAP1]
Status:
CAP1 applies knowledge extraction techniques through the data collected. In this case, algorithms are being developed for data cleaning and identification and selection of relevant variables within the physical model of the plant. Besides, intelligent visualizations have been carried out. The mass balance of the plant can be visualized in the CAP platform, and the Thermal Balance is still in progress to accurate the model.Description:
One of the main problems in asphalt production is knowing the correct composition of the raw materials as well as their relevant properties. The extraction of knowledge will allow the development of an expert system that generates the adjustments of the setpoints of the controllers, the amounts of material to be incorporated into the processes such as the mixer, and other data. The main objective is to generate a tool that helps in the decision making in the planning of the production process carried out in the Asphalt plant. This main objective can be divided into two specific objectives linked to two balances:- To ensure the optimum temperature of the asphalt mix:
Thermal Balance - To minimize the excess of asphalt material in the hot hoppers at the end of the day:
Mass Balance
Additional Material





Cognitive control of Asphalt Drum[CAC1]
Status:
CAC1 algorithm has been developed based on a control algorithm where sensors and actuators that directly affect the drying process are used to calculate the optimum values for the different variables that run the drum, i.e., the burner and the rotary motors through the corresponding VFD’s. A dynamic modeling of the rotary drum has been developed using Deep Learning techniques. It is based on time series predictions using a long short-term memory (LSTM) Recurrent Neural Network (RNN) that has been trained using historical data. An LSTM network is a recurrent neural network (RNN) that processes input data by looping over time steps and updating the RNN state. The RNN state contains information remembered over all previous time steps. Thanks to this feature, subsequent values can be forecasted. At the same time, the control method to produce both, the optimum Burner Power Setpoint and the optimum Rotary Speed Setpoint is performed using using open loop forecasting methods with several time steps in the future. It finds the optimum value applying the fmincon algorithm which seeks for finding minimum of constrained nonlinear multivariable functions using as objective target the minimum error and the minimum energy consumption.Description:
The asphalt production process begins when the stockpiled aggregates in the cold feeders are measured and conveyed to a dryer drum where they are heated to a specific temperature. The control objectives are to obtain a dry product at an optimum temperature for the next process and combustion gases at the possible lowest temperature, on one hand not to damage the baghouse filter bags and on the other to minimize energy consumption, thus increasing the efficiency of the drying process.Additional Material





Cognitive sensor for bitumen content [CAS1]
Status:
CAS1 is currently a laboratory prototype, almost in its final form.Description:
Asphalt is obtained by mixing aggregates, virgin bitumen and additives. One of these additives is Reclaimed Asphalt Pavement (RAP), which is obtained by removing and milling old asphalt from roads, highways, or pavements. When this additive is added to the mix, the virgin bitumen content is recalculated considering the bitumen already contained in the RAP added. Currently, the bitumen content in RAP is roughly measured offline in a laboratory. Aiming to obtain a precise and automated measurement of the bitumen content in RAP in-line and in real-time, CAS1 will be developed at AIMEN’s laboratories and placed in the RAP line in EIFFAGE’s plant. CAS1 is an optical sensor that will make the asphalt manufacturing process more flexible and automated, reducing decision-making times and improving productivity and product quality.Additional Material





Cognitive sensor of amount of filler [CAS2]
Status:
CAS2, has been developed looking to two ways of work. The first, is to develop a new sensor, create new applications of sensors to obtain the flow of filler through the baghouse pipe. The second way of work is to use a commercial sensor that never have been use under these conditions of use. Both solutions are implemented in the use case, and are under the process of calibration and validation of results.Description:
The asphalt is a product obtained by mixing aggregates, bitumen and additives. The smallest aggregates are named FILLER, size less than 60 µm, and are present with all the size of aggregates. The asphalt plants need to measure the filler extracted during the drying process, because, this material needs a lot of energy to be heated and controlling this material we can obtain a higher energy efficiency.Additional Material





Predictive maintenance of the Baghouse [CAO1]
Status:
CAO1 solution is composed by two Deep Learning models- The first model for predicting the health state of the baghouse is currently a laboratory prototype, almost in its final form. Currently, we are in the process of fine-tune and optimize the model.
- The second model for predicting the remaining useful life of a baghouse’s component is in progress.
Description:
The baghouse filter consists of a collector which removes dust, mainly filler content in dry aggregates during drying process in drum. Baghouse performance is heavily depended on inlet and outlet gas temperature and flow speed as well as opacity climatic conditions and pressure drop, in the bag house (temperature and humidity, the recipe of asphalt). The final user of this asset is the plant operator (EIFFAGE), which is interested in the predictive maintenance of the baghouse.In the context of the developed Cognitive Solution (CS), two prediction models will be developed:
- The first model predicts if the baghouse is working properly by attempting to identify any abnormal behavior.
- The second model predict the remaining useful life of a component of baghouse (days or hours).
Additional Material





Cognitive sensor for tracking of steel billets and bars [CSS1]
Status:
CSS1 is done in two parts: the first connects the billet from the casting machine to the rolling mill by marking each billet with laser and later reading with visual cameras; the second connects the output from those billets, the bars, from the rolling mill to the finishing units, using laser marking and visual cameras too. In both cases, a close connection with the MES systems and Level 2 systems is necessary. The first part of the sensor is fully operative, whereas the second one has been operatively tested but faces some implementation difficulties due to a revamping in the rolling mill. However, a mitigation strategy has been developed based in one concrete type of orders.Description:
The final product of steel long producers are bars of different composition, size and length. As the process is discontinuous and the product varies in form, size and number during the whole production operation, the detailed tracking of the final bar and link to the detailed data collected at different moments is a challenging issue. In fact, the amount of data is also very variable, from the liquid steel as one unit, to the intermediate product (a billet) in units of tens up to the final bars in units of hundreds.Additional Material





Soft Sensor for Solidification Process in Steel Billet Casting [CSS2]
Status:
In the CAPRI project, BFI develops a software-based solidification sensor for continuous casting of steel. Based on a 3-dimensional caster process simulation model and available process data, such as the initial temperature and steel grade in the tundish, the casting velocity, the cooling water flow rate and temperature increase in the mould as well as the spray water flow rates in the secondary cooling loops, the sensor calculates the temperature distribution and shell thickness in the casting strands. Upon cutting of a new billet, the sensor creates a digital twin of the semi-product. By feeding all the upstream data from secondary metallurgy and the casting process to the twin, the sensor provides a solid basis for the risk and anomalies detection, which will identify anomalous situations in the production early on and help the operator to make informed decisions about the further processing of the semi-products. The sensor has been calibrated by means of several temperature measurements on the strand surface at SIDENOR’s casting machine, where the sensor will be deployed in the CAPRI project.Description:
Continuous casting of billets is an important step in the steel production. It takes place after the primary and secondary steelmaking processes, which produce batches of liquid steel either in a blast furnace and basic oxygen furnace or an electric arc furnace with subsequent ladle treatment steps, and before the downstream treatment of the solid semi products in a rolling mill. In the casting machine, liquid steel at a temperature of about 50 K above liquidus temperature is first poured into the so-called tundish, from where it flows through a submerged entry nozzle into the mould. There, by means of water cooling the steel is cooled down so that the outer shell of the strand starts to solidify. When the steel leaves the bottom of the mould this shell must be thick enough to support the liquid core that is still present at that time. When the strand has become fully solid, it is cut into pieces of approximately 10 meters length, the so-called billets. Improper cooling conditions can cause thermal stresses leading to surface or internal cracks. It is not possible, however, to directly measure the temperature field within the solidifying strand, which makes it hard to select the correct casting parameters for each of the different steel grades produced, and to evaluate the impact of the parameters on the final product quality.Additional Material



Temperature Soft Sensor for steel semi-products [CSS3]
Status:
The 2D- model is realized with FEM- analysis and uses Partial differential equations for the heat transfer. First step in modelling is to create the contours of the products. In Sidenor plant there are round profiles with diameters from 30 millimeters up to 100 millimeters. For each round contour, a FEM mesh is generated. The size of the mesh triangles have to be small enough to contain appropriate information, and big enough to guarantee a low calculation time. Additionally, boundary conditions, as material parameters are set. Second step of modelling is the creation of model calibration information. This concerns functions for the heat transfer coefficient. For later use and other environment conditions it is possible to calibrate this model input with real measured information.Description:
A couple of temperature measurements of the steel surface are made by means of pyrometers, installed at fixed locations in the rolling mill, and the present soft sensor enhances those by interpolating the temperature evolution for intervals where no measurements are available. This information will later be used to estimate the amount of scale, i.e. iron oxides, that forms on the surface of hot steel and can lead to quality issues, and more generally in the CAPRI anomaly detector for the steel production.Additional Material


Scale Soft Sensor for steel semi-products [CSS4]
Status:
The formation of scale on the surface of a steel product is a complex chemical reaction. It is a high temperature oxidation build-up of three kinds of iron oxid: FeO, Fe3O4 und Fe2O3, that is magnetite. The composition of the complex oxidation layer changes with the temperature. The formation of scale is high correlated to the steel composition. This information of the amount of scale is important for the following processes because scale can lead to quality issues. It is used in the CAPRI anomaly detector for the steel production. In this scale sensor the secondary scale is of interest. This scale grows after rolling, cooling by air on the cooling bed, in a temperature range from 1100°C down to 500° C. Below 500° C there is no increase of scale expected. There are two factors of influence for the scale: 1) The material composition of the steel, that is the steel grade and 2) the temperature, that is the cooling curve. The result of the scale model is a curve of the scale layer thickness over time as well as the final thickness, expected in the range [1, 100] µm.Description:
During production of steel bars in hot rolling mills there is a formation of scale on the surface of the products. It is differentiated between two scale types: primary scale and secondary scale. During the reheating of the product in the furnace the scale is called primary scale. After reheating and before rolling the scale is removed by a descaler, for instance with high water pressure. After rolling, while the product is located on the cooling bed, the secondary scale grows up.Additional Material


Risk and anomaly sensor for the steel production [CSS5]
Status:
The algorithm that we implemented for the anomaly detection so far is based on an autoencoder. Autoencoders are special types of neural networks, which are trained to simply reconstruct their input data. They consist of an encoder part and a decoder part, and the middle layer always has a lower number of neurons than the input layer. This implies that the autoencoder needs to learn a low-dimensional representation of the potentially high-dimensional input data, focusing on the features of most discriminative power and dropping strongly correlated features. The autoencoder may hence be thought of as a tool for dimensional reduction, like principal component analysis. There are at least two main approaches to using an autoencoder for anomaly detection. The first one is based on the reconstruction error: suppose we have a labelled dataset containing good cases only, without any outliers, and we train our autoencoder to learn a reduced representation for this dataset. When we then apply the autoencoder to an unknown good case, the expectation is that it will be able to reconstruct the data well. A bad case, on the other hand, should lead to an outlier in the latent representation, for which we do not expect the autoencoder to work very well, and consequently the reconstruction error should be large. We may then define a threshold in the reconstruction error for identifying anomalous input data. A second approach makes use of the latent representation to distinguish between good and bad cases. In this case we include the anomalous data or outliers in the model training and apply some learning algorithm to identify anomalies in the hidden layer. This may be done, for instance, by means of clustering, thresholds, or some regression algorithms.Description:
The CAPRI risk and anomalies sensor for the steel production aims to provide an estimate of the processing risk for intermediate products at different stages of the processing chain. This risk estimation will be the basis for a decision support system, which will provide recommendations regarding the further processing of a semi-product. For instance, if an item will likely fail to meet the quality specification for its original customer order, the support system could recommend changing the target order the product will be assigned to, or it could recommend to immediately recycle the item or to do some reprocessing. The earlier we identify a problematic item, the less energy and time needs be wasted in its further processing, therefore the solution can lead to substantial savings both in cost and CO2 emissions.Additional Material



Digital Twins for the steel production [CSO1]
Status:
For the steel use case DT‘s for billets and bars were realised. The billet DT is ‘born’ directly after the cut at the end of the casting machine. The billet DT is then equipped with information from steel works like the chemical analysis and casting, for example the casting speed. After the rolling of the billet the billet DT is the parent of several children, the bar DT’s. They inherit all the information from their parent and additionally information from the rolling process. The production of steel bars consists of several special conditions. The tracking is complicated due to the complexity of the optical detection of individuals e.g. in front of the rolling mill. (This is realised by the CSS1). Furthermore, the production of the bars may take weeks to months which makes it necessary to store the DT’s. For the persistence of the DT an object-oriented NoSQL database is used. This allows to store growing individuals containing different information located in their structure. New information can easily be added to this structure and stored again into the NoSQL database.Description:
The starting point for the Digital Twin (DT) is the so called „digital shadow“ (DS). This is a kind of a digital footprint of a physical object, in our use case a product or a production plant. The DS is a model which is fed by a one-way data flow with the state of the object. A change in state of the object leads to a change in the digital object, but not vice versa. The DS therefore transfers a physical object into the virtual world leading to a sufficiently accurate digital image of the object. The transferred data are usually transformed either upon ingestion or on the fly at retrieval time. Beside the data collected from the process also data generated by soft sensors are used in the CAPRI steel use case. Soft sensors are online models calculating information that are not directly measurable. Here the solidification sensor CSS2 is mentioned which calculates the location of the point of the product were the aggregate state of the product changes from fluid to solid or the temperature sensor CSS3 which calculates the development of the temperature of the product. All these collected data are now related to the product for example on the length basis. The data are used in the CAPRI project to train data driven models like the CSS5, the anomaly detector used to estimate the risk of producing a product with insufficient surface quality.Additional Material


Steel
Cognitive Solutions
[CSS1]
Cognitive sensor for tracking of steel billets and bars
[CSS2]
Soft Sensor for Solidification Process in Steel Billet Casting
[CSS3]
Temperature Soft Sensor for steel semi-products
[CSS4]
Scale Soft Sensor for steel semi-products
[CSS5]
Risk and anomaly sensor for the steel production
[CSO1]
Digital Twins for the steel production
[CSS1]
Cognitive sensor for tracking of steel billets and bars
[CSS2]
Soft Sensor for Solidification Process in Steel Billet Casting
[CSS3]
Temperature Soft Sensor for steel semi-products
[CSS4]
Scale Soft Sensor for steel semi-products
[CSS5]
Risk and anomaly sensor for the steel production
[CSO1]
Digital Twins for the steel production
Pharma
Cognitive Solutions
[CPC1]
Cognitive control
concept
[CPO1]
Cognitive operation solutions for pharma production
[CPP1]
Cognitive planning solutions for pharma production
[CPS1]
Cognitive sensor for blend uniformity
[CPS2]
Cognitive sensor for granule quality
[CPS3]
Cognitive sensor for product moisture
[CPS4]
Cognitive prediction of dissolution
[CPS5]
Cognitive sensor for fault detection
[CPC1]
Cognitive control
concept
[CPO1]
Cognitive operation solutions for pharma production
[CPP1]
Cognitive planning solutions for pharma production
[CPS1]
Cognitive sensor for blend uniformity
[CPS2]
Cognitive sensor for granule quality
[CPS3]
Cognitive sensor for product moisture
[CPS4]
Cognitive prediction of dissolution
[CPS5]
Cognitive sensor for fault detection

Cognitive control concept[CPC1]
Status:
The development of CPP1 has not yet started. Once other work packages are completed, development will commence.Description:
Before running a continuous manufacturing line, appropriate process settings must be selected. Therefore, to find these settings, an initial set of trials is executed. Based on the generated data and insights, suitable process settings are determined. As the number and scale of experiments affect the overall sustainability (e.g., energy consumption), the Design of the Experiments (DoE) plays a critical role in minimising environmental impact.Additional Material



Cognitive operation solutions for pharma production [CPO1]
Status:
Several scenarios that typically require human intervention have been evaluated, categorised, and defined. The development of algorithms supporting line operators by suggesting appropriate countermeasures is currently ongoing.Description:
The operation of continuous manufacturing lines demand highly trained and experienced personnel operating the equipment. Employing a cognitive concept (CPO1), to support line operators in selecting the correct process settings and making appropriate decisions about maintenance, can reduce downtimes and streamline processing while guaranteeing maximum quality.
Cognitive planning solutions for pharma production [CPP1]
Status:
Several scenarios that typically require human intervention have been evaluated, categorised, and defined. The development of algorithms supporting line operators by suggesting appropriate countermeasures is currently ongoing.Description:
The operation of continuous manufacturing lines demand highly trained and experienced personnel operating the equipment. Employing a cognitive concept (CPO1), to support line operators in selecting the correct process settings and making appropriate decisions about maintenance, can reduce downtimes and streamline processing while guaranteeing maximum quality.
Cognitive sensor for blend uniformity [CPS1]
Status:
CPS1 covers the construction and realisation of the mechanical interface needed for integrating the Raman probe in the process. Functionality utilising an electric motor has been developed, to properly present the monitored material to the probe. Furthermore, the algorithm for computing the API concentration was developed, and the programming of the motor actuation was completed. Currently, tests with the prototype on the ConsiGma CTL25 (GEA) manufacturing line at RCPE are ongoing.Description:
Continuous manufacturing of pharmaceutical oral dosage forms, like tablets, requires the implementation of appropriate quality control concepts. The real-time monitoring of critical quality attributes is an essential component of a quality control concept. The CPS1 solution supports prediction of the concentration of active pharmaceutical ingredients (API) in the material stream during manufacturing, using Raman spectroscopy. The availability of that information enables the development of sophisticated quality control concepts, ultimately reducing waste material and improving product quality.Additional Material




Cognitive sensor for granule quality [CPS2]
Status:
The project team has accomplished the mechanical setup of the Parsum particle probe and developed algorithms for computing characteristic size values from the captured size distribution. Initial tests using the generated data in a process control concept have been successfully completed.Description:
Continuous wet granulation is a commonly used unit operation in secondary pharmaceutical manufacturing. Its purpose is the creation of granules of well-defined size distribution. As the granule size affects critical quality attributes, real-time monitoring is of the utmost importance, reducing defective end products. The development in CPS2 provides real-time measurements of the size distribution. This data is fed to a process control concept (CPC1), which selects optimal granulation settingsAdditional Material




Cognitive sensor for product moisture [CPS3]
Status:
The mathematical model, the core component of CPS3, has been developed. Currently, the parametrisation of the model is ongoing, and the project team is executing trials to generate the necessary initial data set. Once we have completed the preliminary setup, we will generate another data set, to validate the 'theoretical' granule moisture estimates using experimental data.Description:
In a pharmaceutical “from powder to tablet” manufacturing line that uses wet granulation, drying is crucial to produce intermediate granules with well-defined moisture content. However, typically, there is no direct measurement of the granule moisture. Using available sensor data, such as temperature and humidity, as well as a mathematical model, CPS3 aims to estimate an effective granule moisture measurement.Additional Material


Cognitive prediction of dissolution [CPS4]
Status:
The development of the dissolution prediction model requires the availability of experimental data. Therefore, we executed several trials using RCPE's continuous wet granulation and tableting line. During these trials the specific dissolution profiles were measured. Based on the generated data, we have created prototype models which will be validated against a set of additional experiments.Description:
The dissolution is essential to the intended performance of a pharmaceutical tablet. It describes how quickly the active pharmaceutical ingredient (API) dissolves in a defined solvent. Therefore, it is one of the most critical quality attributes that must be monitored and controlled in pharmaceutical processes. The dissolution rate is highly dependent on processing conditions. The purpose of CPS4 is to predict the dissolution profile from process settings and available sensor data.Additional Material



Cognitive sensor for fault detection [CPS5]
Status:
The CPS5 algorithm requires large amounts of process data. It requires both data from fault-free operations and also operations showcasing faults, e.g., clogging of filters. We generated this data by running a number of dedicated experiments on RCPE's ConsiGma CTL25 (GEA) manufacturing line. Descriptions of the faults that occurred were manually transcribed into a suitable JSON file format, allowing easy import during algorithm development, which is currently in progress by our colleagues at Nissatech.Description:
The reliable operation of all involved unit operations, at all times, is essential in continuous pharmaceutical manufacturing lines. Faults and defects must be detected as early as possible, before causing any additional product deterioration. CPS5 aims to detect these potential faults using available sensor data.Additional Material
