Virumaa innovation centre of digitalisation and green technologies (ViruTech): Virumaa College, Tallinn University of Technology, Estonia
2
Department of Mechanical and Industrial Engineering, Tallinn University of Technology, Estonia
3
Faculty of Engineering, Universidad Autónoma de Bucaramanga, Colombia
Submission date: 2026-04-20
Final revision date: 2026-05-22
Acceptance date: 2026-05-28
Online publication date: 2026-07-16
Corresponding author
Karle Nutonen
Virumaa innovation centre of digitalisation and green technologies (ViruTech): Virumaa College, Tallinn University of Technology, Järveküla tee 75, 30322, Kohtla-Järve, Estonia
Industrial robot process simulation plays an important role in production planning, optimization, and digital twin development. However, many existing simulation approaches rely on robot-specific and manually parametrized models, which limits scalability in heterogeneous robot environments. This paper proposes a unified machine learning–based simulation framework for modelling and simulating process behaviour across different industrial robot platforms using a shared task-space learning policy. The proposed approach combines reinforcement learning and inverse kinematics with clearly separated roles. The reinforcement learning policy generates end-effector motion in task space, while inverse kinematics converts the desired motion into robot-specific joint configurations and supports geometric feasibility. This separation reduces the dependence of the learning model on the joint structure of a particular robot. Experimental evaluation on heterogeneous robot platforms showed that the proposed framework can learn accurate target-reaching behaviour in simulation. The best-performing policy achieved a success rate close to 1.0, a mean final distance error of 0.0082 m, and a mean final orientation error of 5.55°. These results indicate that a shared task-space learning policy combined with robot-specific inverse kinematics can support scalable robot process simulation.
REFERENCES(26)
1.
ZHANG Z., ZENG J., 2022, A Review on Development and Application of Industrial Robot, Acad. J. Sci. Technol., 2/2, 78–81, https://doi.org/10.54097/ajst.....
ONAJI I., TIWARI D., SOULATIANTORK P., SONG B., TIWARI A., 2022, Digital Twin in Manufacturing: Conceptual Framework and Case Studies, Int. J. Comput. Integr. Manuf., 35/8, 831–858, https://doi.org/10.1080/095119....
GALAMBOS P., et al., 2015, Design, Programming and Orchestration of Heterogeneous Manufacturing Systems Through VR-Powered Remote Collaboration, Robot. Comput. Integr. Manuf., 33, 68–77, https://doi.org/10.1016/j.rcim....
LEVINE S., PASTOR P., KRIZHEVSKY A., IBARZ J., QUILLEN D., 2018, Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collection, Int. J. Rob. Res., 37/4–5, 421–436, https://doi.org/10.1177/027836....
VU M.N., BECK F., SCHWEGEL M., HARTL-NESIC C., NGUYEN A., KUGI A., 2023, Machine Learning-Based Framework for Optimally Solving the Analytical Inverse Kinematics for Redundant Manipulators, Mechatronics, 91, 102970, https://doi.org/10.1016/j.mech....
KALAKRISHNAN M., BUCHLI J., PASTOR P., MISTRY M., SCHAAL S., 2011, Learning, Planning, and Control for Quadruped Locomotion Over Challenging Terrain, Int. J. Rob. Res., 30/2, 236–258, https://doi.org/10.1177/027836....
KOENIG N. HOWARD A., 2004, Design and Use Paradigms for Gazebo, an Open-Source Multi-Robot Simulator, 2004 IEEE/RSJ Int. Conf. Intell. Robot. Syst., 3, 2149–2154, https://doi.org/10.1109/iros.2....
TOBIN J., FONG R., RAY A., SCHNEIDER J., ZAREMBA W., ABBEEL P., 2017, Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World, IEEE Int. Conf. Intell. Robot. Syst., 23–30, https://doi.org/10.1109/IROS.2....
JAMES S., DAVISON A.J., JOHNS E., 2026, Transferring end-to-end Visuomotor Control from Simulation to Real World for a Multi-Stage Task, http://arxiv.org/abs/1707.0226....
We process personal data collected when visiting the website. The function of obtaining information about users and their behavior is carried out by voluntarily entered information in forms and saving cookies in end devices. Data, including cookies, are used to provide services, improve the user experience and to analyze the traffic in accordance with the Privacy policy. Data are also collected and processed by Google Analytics tool (more).
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.