Deep Reinforcement Learning for Continuous Control of Material Thickness

Dippel, Oliver ORCID: 0000-0002-6252-2248, Lisitsa, Alexei ORCID: 0000-0002-3820-643X and Peng, Bei ORCID: 0000-0003-0152-3180 (2023) Deep Reinforcement Learning for Continuous Control of Material Thickness. In: The Forty-third SGAI International Conference on Artificial Intelligence, 2023-12-12 - 2023-12-14, Cambridge, United Kingdom.

PDF
Deep Reinforcement Learning for Continuous Control of Material Thickness.pdf - Submitted version
Download (419kB) | Preview

Official URL: http://dx.doi.org/10.1007/978-3-031-47994-6_30

Abstract

To achieve the desired quality standards of certain manufactured materials, the involved parameters are still adjusted by knowledgebased procedures according to human expertise, which can be costly and time-consuming. To optimize operational efficiency and provide decision support for human experts, we develop a general continuous control framework that utilizes deep reinforcement learning (DRL) to automatically determine the main control parameters, in situations where simulation environments are unavailable and traditional PID controllers are not viable options. In our work, we aim to automatically learn the key control parameters to achieve the desired outlet thickness of the manufactured material. We first construct a surrogate environment based on real-world expert trajectories obtained from the true underlining manufacturing process to achieve this. Subsequently, we train a DRL agent within the surrogate environment. Our results suggest a Proximal Policy Optimization (PPO) algorithm combined with a Multi-Layer Perceptron (MLP) surrogate environment to successfully learn a policy that continuously changes parameter configurations optimally, achieving the desired target material thickness within an acceptable range.

Item Type:	Conference or Workshop Item (Unspecified)
Uncontrolled Keywords:	Reinforcement Leaning, Deep Learning, Real World Manufacturing
Divisions:	Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science
Depositing User:	Symplectic Admin
Date Deposited:	04 Oct 2023 08:32
Last Modified:	15 Mar 2024 11:45
DOI:	10.1007/978-3-031-47994-6_30
Related URLs:	Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3173365