A platform-agnostic deep reinforcement learning framework for effective Sim2Real transfer towards autonomous driving
D. Li, and O. Okhrin. Commun Eng, 3 (1):
147(October 2024)
Abstract
Autonomous driving presents unique challenges, particularly in
transferring agents trained in simulation to real-world
environments due to the discrepancies between the two. To
address this issue, here we propose a robust Deep Reinforcement
Learning (DRL) framework that incorporates platform-dependent
perception modules to extract task-relevant information,
enabling the training of a lane-following and overtaking agent
in simulation. This framework facilitates the efficient transfer
of the DRL agent to new simulated environments and the real
world with minimal adjustments. We assess the performance of the
agent across various driving scenarios in both simulation and
the real world, comparing it to human drivers and a
proportional-integral-derivative (PID) baseline in simulation.
Additionally, we contrast it with other DRL baselines to clarify
the rationale behind choosing this framework. Our proposed
approach helps bridge the gaps between different platforms and
the Simulation to Reality (Sim2Real) gap, allowing the trained
agent to perform consistently in both simulation and real-world
scenarios, effectively driving the vehicle.
%0 Journal Article
%1 Li2024-zw
%A Li, Dianzhao
%A Okhrin, Ostap
%D 2024
%I Springer Science and Business Media LLC
%J Commun Eng
%K driving framework platform-agnostic autonomous deep learning reinforcement from:scadsfct Sim2Real
%N 1
%P 147
%T A platform-agnostic deep reinforcement learning framework for effective Sim2Real transfer towards autonomous driving
%V 3
%X Autonomous driving presents unique challenges, particularly in
transferring agents trained in simulation to real-world
environments due to the discrepancies between the two. To
address this issue, here we propose a robust Deep Reinforcement
Learning (DRL) framework that incorporates platform-dependent
perception modules to extract task-relevant information,
enabling the training of a lane-following and overtaking agent
in simulation. This framework facilitates the efficient transfer
of the DRL agent to new simulated environments and the real
world with minimal adjustments. We assess the performance of the
agent across various driving scenarios in both simulation and
the real world, comparing it to human drivers and a
proportional-integral-derivative (PID) baseline in simulation.
Additionally, we contrast it with other DRL baselines to clarify
the rationale behind choosing this framework. Our proposed
approach helps bridge the gaps between different platforms and
the Simulation to Reality (Sim2Real) gap, allowing the trained
agent to perform consistently in both simulation and real-world
scenarios, effectively driving the vehicle.
@article{Li2024-zw,
abstract = {Autonomous driving presents unique challenges, particularly in
transferring agents trained in simulation to real-world
environments due to the discrepancies between the two. To
address this issue, here we propose a robust Deep Reinforcement
Learning (DRL) framework that incorporates platform-dependent
perception modules to extract task-relevant information,
enabling the training of a lane-following and overtaking agent
in simulation. This framework facilitates the efficient transfer
of the DRL agent to new simulated environments and the real
world with minimal adjustments. We assess the performance of the
agent across various driving scenarios in both simulation and
the real world, comparing it to human drivers and a
proportional-integral-derivative (PID) baseline in simulation.
Additionally, we contrast it with other DRL baselines to clarify
the rationale behind choosing this framework. Our proposed
approach helps bridge the gaps between different platforms and
the Simulation to Reality (Sim2Real) gap, allowing the trained
agent to perform consistently in both simulation and real-world
scenarios, effectively driving the vehicle.},
added-at = {2025-01-07T12:44:26.000+0100},
author = {Li, Dianzhao and Okhrin, Ostap},
biburl = {https://puma.scadsai.uni-leipzig.de/bibtex/29ccd847f68905e0c3828df0ff1a108dd/scads.ai},
copyright = {https://creativecommons.org/licenses/by/4.0},
interhash = {744463b3e7075d123227d2fbaf6bb734},
intrahash = {9ccd847f68905e0c3828df0ff1a108dd},
journal = {Commun Eng},
keywords = {driving framework platform-agnostic autonomous deep learning reinforcement from:scadsfct Sim2Real},
language = {en},
month = oct,
number = 1,
pages = 147,
publisher = {Springer Science and Business Media LLC},
timestamp = {2025-01-07T12:44:26.000+0100},
title = {A platform-agnostic deep reinforcement learning framework for effective {Sim2Real} transfer towards autonomous driving},
volume = 3,
year = 2024
}