Method of learning of autonomous mobile robots based on drl and curriculum learning

Бушма, Олександр Володимирович and Ганенко, Людмила (2025) Method of learning of autonomous mobile robots based on drl and curriculum learning Кібербезпека: освіта, наука, техніка" є рецензованим технічним часописом галузі інформаційних техноло, 30 (2). pp. 568-582. ISSN 2663-4023

Text Bushma_Cybersecurity_2025-30-v2_FITM.pdf - Published Version Available under License Creative Commons Attribution Non-commercial. Download (1MB)

Abstract

The work is devoted to the urgent task of improving the efficiency of socially adaptive navigation of autonomous mobile robots in dynamic environments with human presence. The application of deep reinforcement learning (DRL) methods to solve this problem is complicated by the high dimensionality of the state space, the complexity of formalizing social norms in the reward function, and the instability of the learning process. To overcome these challenges, a method is proposed that integrates the Proximal Policy Optimization (PPO) algorithm with the Curriculum Learning (CL) training strategy. The developed training program combines a gradual increase in the complexity of the environment (from static obstacles to an environment with moving human agents) and the phased formation of the reward function with the addition of social components. A key feature is the transition between stages, which is based on policy stability analysis. The experimental study was conducted in the developed Gazebo simulation environment using the Turtlebot3 Waffle mobile robot and the ROS 2Humble framework. Step-by-step training allows an autonomous mobile robot to first learn basic skills for avoiding static obstacles, then dynamic ones, and finally, at the final stage, to take into account social norms of interaction with people. The input data for the system is data from LiDAR, the status of the robot and people, and the target position. The result of the method is an optimized stochastic behavior policy that allows an autonomous mobile robot to make safe, efficient, and socially acceptable navigation decisions. A comparative analysis of the proposed method with the standard PPO algorithm was performed. The results confirm that the proposed method allows the formation of an effective policy of socially adaptive navigation, solving the problems of instability and slow convergence.

Item Type:	Article
Uncontrolled Keywords:	information technology; machine learning methods; reinforcement learning methods; deep reinforcement learning; curriculum learning; autonomous mobile robots; mobile robot navigation; ROS 2; Gazebo
Subjects:	Статті у періодичних виданнях > Фахові (входять до переліку фахових, затверджений МОН) Статті у періодичних виданнях > Наукові рецензовані журнали (входять до інших баз, крім перерахованих та Google Academy, мають ISSN, DOI, індекс цитування)
Divisions:	Факультет інформаційних технологій та математики > Кафедра комп'ютерних наук
Depositing User:	Dr. Sci. Aleksandr / A..V. Bushma
Date Deposited:	05 Jan 2026 09:18
Last Modified:	05 Jan 2026 09:18
URI:	https://elibrary.kubg.edu.ua/id/eprint/55858

Actions (login required)

View Item