基于数据驱动的无人帆船PPO-PID路径跟踪算法

    Data-driven PPO-PID path-tracking algorithm for an unmanned sailboat

    • 摘要: 传统控制算法未充分考虑无人帆船的特殊操纵特性,导致在迎风和横风等复杂工况下路径跟踪精度低、收敛慢。针对该问题,本文提出一种结合智能决策与鲁棒控制的数据驱动策略,设计了一种融入基于回报的优先经验池(RB-PEP)的近端策略优化—比例积分微分(PPO-PID)混合控制框架。该框架中,基于改进PPO算法设计制导律来输出离散航向指令,PID控制器据此实时调节舵角以跟踪航向。同时,构建了基于航向误差、横向误差与相对风向的自适应奖励函数,以提升帆船对不同风向的适应能力。经多风向随机路径训练与多段路径跟踪完成仿真验证,结果显示,本文改进的PPO-PID算法在多段路径跟踪中优于标准PPO-PID及经典LOS类控制方法,表现出更高的跟踪精度和更小误差。研究成果可为复杂海况下无人帆船的自主导航提供一种解决方案。

       

      Abstract: Traditional control algorithms do not adequately account for the distinctive maneuvering characteristics of unmanned sailboats,resulting in low path-tracking accuracy and slow convergence under complex operating conditions such as close-hauled (upwind) and beam-reach (crosswind) sailing. To address this issue,this paper proposes a data-driven strategy that integrates intelligent decision-making with robust control and develops a hybrid Proximal Policy Optimization-Proportional-Integral-Derivative (PPO-PID) control framework incorporating a Return-Based Prioritized Experience Pool (RB-PEP). In this framework,an improved PPO algorithm is employed to design a guidance law that outputs discrete heading commands,while a PID controller adjusts the rudder angle in real time to track the commanded heading.Meanwhile,an adaptive reward function is constructed based on heading error,cross-track error,and relative wind direction to enhance the sailboat' s adaptability to different wind conditions. Simulation validation is conducted through random-path training under multiple wind directions and multi-segment path-tracking tasks. The results demonstrate that the proposed PPO-PID algorithm outperforms the standard PPO-PID and classical Line-Of-Sight (LOS)-based control methods in multi-segment path tracking,achieving higher tracking accuracy and smaller errors. The proposed method provides a feasible solution for autonomous navigation of unmanned sailboats in complex sea conditions.

       

    /

    返回文章
    返回