Generalized Process Simulation of Heterogeneous Industrial Robots Using a Shared Machine Learning Model
,
 
,
 
 
 
 
More details
Hide details
1
Virumaa innovation centre of digitalisation and green technologies (ViruTech): Virumaa College, Tallinn University of Technology, Estonia
 
2
Department of Mechanical and Industrial Engineering, Tallinn University of Technology, Estonia
 
3
Faculty of Engineering, Universidad Autónoma de Bucaramanga, Colombia
 
 
Submission date: 2026-04-20
 
 
Final revision date: 2026-05-22
 
 
Acceptance date: 2026-05-28
 
 
Online publication date: 2026-07-16
 
 
Corresponding author
Karle Nutonen   

Virumaa innovation centre of digitalisation and green technologies (ViruTech): Virumaa College, Tallinn University of Technology, Järveküla tee 75, 30322, Kohtla-Järve, Estonia
 
 
 
KEYWORDS
TOPICS
ABSTRACT
Industrial robot process simulation plays an important role in production planning, optimization, and digital twin development. However, many existing simulation approaches rely on robot-specific and manually parametrized models, which limits scalability in heterogeneous robot environments. This paper proposes a unified machine learning–based simulation framework for modelling and simulating process behaviour across different industrial robot platforms using a shared task-space learning policy. The proposed approach combines reinforcement learning and inverse kinematics with clearly separated roles. The reinforcement learning policy generates end-effector motion in task space, while inverse kinematics converts the desired motion into robot-specific joint configurations and supports geometric feasibility. This separation reduces the dependence of the learning model on the joint structure of a particular robot. Experimental evaluation on heterogeneous robot platforms showed that the proposed framework can learn accurate target-reaching behaviour in simulation. The best-performing policy achieved a success rate close to 1.0, a mean final distance error of 0.0082 m, and a mean final orientation error of 5.55°. These results indicate that a shared task-space learning policy combined with robot-specific inverse kinematics can support scalable robot process simulation.
REFERENCES (26)
1.
ZHANG Z., ZENG J., 2022, A Review on Development and Application of Industrial Robot, Acad. J. Sci. Technol., 2/2, 78–81, https://doi.org/10.54097/ajst.....
 
2.
ONAJI I., TIWARI D., SOULATIANTORK P., SONG B., TIWARI A., 2022, Digital Twin in Manufacturing: Conceptual Framework and Case Studies, Int. J. Comput. Integr. Manuf., 35/8, 831–858, https://doi.org/10.1080/095119....
 
3.
UGARTE M., ETXEBERRIA L., UNAMUNO G., BELLANCO J.L., UGALDE E., 2022, Implementation of Digital Twin-Based Virtual Commissioning in Machine Tool Manufacturing, Procedia Comput. Sci., 200/1–2, 527–536, https://doi.org/10.1016/j.proc....
 
4.
GALAMBOS P., et al., 2015, Design, Programming and Orchestration of Heterogeneous Manufacturing Systems Through VR-Powered Remote Collaboration, Robot. Comput. Integr. Manuf., 33, 68–77, https://doi.org/10.1016/j.rcim....
 
5.
LEVINE S., PASTOR P., KRIZHEVSKY A., IBARZ J., QUILLEN D., 2018, Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collection, Int. J. Rob. Res., 37/4–5, 421–436, https://doi.org/10.1177/027836....
 
6.
LEVINE S., FINN C., DARRELL T., ABBEEL P., 2016, End-to-end Training of Deep Visuomotor Policies, J. Mach. Learn. Res., 17, 1–40.
 
7.
KOBER J., BAGNELL J.A., PETERS J., 2013, Reinforcement Learning in Robotics: a Survey, Int. J. Rob. Res., 32/11, 1238–1274, https://doi.org/10.1177/027836....
 
8.
VU M.N., BECK F., SCHWEGEL M., HARTL-NESIC C., NGUYEN A., KUGI A., 2023, Machine Learning-Based Framework for Optimally Solving the Analytical Inverse Kinematics for Redundant Manipulators, Mechatronics, 91, 102970, https://doi.org/10.1016/j.mech....
 
9.
LAVALLE S.M., KUFFNER J.J., 2001, Randomized Kinodynamic Planning, Int. J. Rob. Res., 20/5, 378–400, https://doi.org/10.1177/027836....
 
10.
KAVRAKI L.E., SVESTKA P., LATOMBE J.C., OVERMARS M.H., 1996, Probabilistic Roadmaps for Path Planning in High-Dimensional Configuration Spaces, IEEE Trans. Robot. Autom., 12/4, 566–580, 1996, https://doi.org/10.1109/70.508....
 
11.
KARAMAN S., FRAZZOLI E., 2011, Sampling-Based Algorithms for Optimal Motion Planning, Int. J. Rob. Res., 30/7, 846–894, https://doi.org/10.1177/027836....
 
12.
KALAKRISHNAN M., CHITTA S., THEODOROU E., PASTOR P., SCHAAL S., 2011, STOMP: Stochastic Trajectory Optimization for Motion Planning, Proc. - IEEE Int. Conf. Robot. Autom., 4569–4574, https://doi.org/10.1109/ICRA.2....
 
13.
RATLIFF N., ZUCKER M., ANDREW BAGNELL J., SRINIVASA S., 2009, CHOMP: Gradient Optimization Techniques for Efficient Motion Planning, Proc. - IEEE Int. Conf. Robot. Autom., 489–494, https://doi.org/10.1109/ROBOT.....
 
14.
LILLICRAP T.P., et al., 2015, Continuous Control with Deep Reinforcement Learning, 4th Int. Conf. Learn. Represent. ICLR 2016 - Conf. Track Proc., https://arxiv.org/pdf/1509.029....
 
15.
SCHULMAN J., WOLSKI F., DHARIWAL P., RADFORD A., OPENAI O.K., 2026, Proximal Policy Optimization Algorithms, https://arxiv.org/pdf/1707.063....
 
16.
TOUSSAINT M., 2009, Robot Trajectory Optimization Using Approximate Inference.
 
17.
TASSA Y., EREZ T., TODOROV E., 2012, Synthesis and Stabilization of Complex Behaviors Through Online Trajectory Optimization, IEEE Int. Conf. Intell. Robot. Syst., 4906–4913, https://doi.org/10.1109/IROS.2....
 
18.
KALAKRISHNAN M., BUCHLI J., PASTOR P., MISTRY M., SCHAAL S., 2011, Learning, Planning, and Control for Quadruped Locomotion Over Challenging Terrain, Int. J. Rob. Res., 30/2, 236–258, https://doi.org/10.1177/027836....
 
19.
KUMAR A., FU Z., PATHAK D., MALIK J., 2026, RMA: Rapid Motor Adaptation For Legged Robots, Robot. Sci. Syst., http://arxiv.org/abs/2107.0403....
 
20.
TODOROV E., EREZ T., TASSA Y., 2012, Mujoco: A Physics Engine for Model-Based Control, IEEE Int. Conf. Intell. Robot. Syst., 5026–5033, 2012, https://doi.org/10.1109/IROS.2....
 
21.
KOENIG N. HOWARD A., 2004, Design and Use Paradigms for Gazebo, an Open-Source Multi-Robot Simulator, 2004 IEEE/RSJ Int. Conf. Intell. Robot. Syst., 3, 2149–2154, https://doi.org/10.1109/iros.2....
 
22.
Unity-Technologies/ml-agents: Available: https://github.com/Unity-Techn..., Accessed: Jan. 12, 2022.
 
23.
TOBIN J., FONG R., RAY A., SCHNEIDER J., ZAREMBA W., ABBEEL P., 2017, Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World, IEEE Int. Conf. Intell. Robot. Syst., 23–30, https://doi.org/10.1109/IROS.2....
 
24.
JAMES S., DAVISON A.J., JOHNS E., 2026, Transferring end-to-end Visuomotor Control from Simulation to Real World for a Multi-Stage Task, http://arxiv.org/abs/1707.0226....
 
25.
GRIEVES M., VICKERS J., 2017, Digital Twin: Mitigating Unpredictable, Undesirable Emergent Behavior in Complex Systems, Transdiscipl. Perspect. Complex Syst. New Find. Approaches, 85–113, https://doi.org/10.1007/978-3-....
 
26.
Tao F., Xiao B., Qi Q., Cheng J., Ji P., 2022, Digital Twin Modeling, J. Manuf. Syst., 64/7775, 372–389, https://doi.org/10.1016/j.jmsy....
 
eISSN:2391-8071
ISSN:1895-7595
Journals System - logo
Scroll to top