Fusion of Indirect Methods and Iterative Learning for Persistent Velocity Trajectory Optimization of a Sustainably Powered Autonomous Surface Vessel

summary

Video file (mp4)

The gist

The gist: The methodology presents a closed-form control law derived from indirect optimal control methods combined with an iterative learning approach to achieve real-time velocity trajectory

In short

The research developed a real-time velocity optimization method for solar-powered autonomous surface vessels that avoids needing a solar forecast. It combines indirect optimal control with iterative learning to create a closed-form control law. This approach yields performance comparable to complex model predictive control, proving it is computationally efficient and robust against weather disturbances.

Key concepts

Indirect Optimal Control
This technique uses mathematical conditions derived from calculus (like necessary conditions) to find the best possible control inputs. In this paper, it helps determine that the optimal velocity remains constant during periods when battery constraints are not active.
Barrier Functions
These are mathematical tools used to enforce constraints, specifically the state of charge limits. The authors use them minimally to tighten these constraints just enough so that a solution is guaranteed to exist over a long time, ensuring 'persistent feasibility' despite unpredictable weather.
Iterative Learning
Since traditional methods struggle to find the exact optimal control value (costate), this method updates an estimate of that value repeatedly. It uses two types of updates—one based on current error and one based on past errors—to converge on the correct speed required for optimal performance.
Persistent Feasibility
This means ensuring that the vessel's battery state will remain within safe limits indefinitely, even when facing unpredictable disturbances like changing solar patterns or weather. The barrier functions are specifically designed to guarantee this long-term stability.

Terminology used across episodes

This episode discusses

The paper

Fusion of Indirect Methods and Iterative Learning for Persistent Velocity Trajectory Optimization of a Sustainably Powered Autonomous Surface Vessel · Read on arXiv

University of Michigan

In this paper, we present the methodology and results for a real-time velocity trajectory optimization for a solar-powered autonomous surface vessel (ASV), where we combine indirect optimal control techniques with iterative learning. The ASV exhibits cyclic operation due to the nature of the solar profile, but weather patterns create inevitable disturbances in this profile. The nature of the problem results in a formulation where the satisfaction of pointwise-in-time state of charge constraints does not generally guarantee persistent feasibility, and the goal is to maximize information gathered over a very long (ultimately persistent) time duration. To address these challenges, we first use barrier functions to tighten pointwise-in-time state of charge constraints by the minimal amount necessary to achieve persistent feasibility. We then use indirect methods to derive a simple switching control law, where the optimal velocity is shown to be an undetermined constant value during each constraint-inactive time segment. To identify this optimal constant velocity (which can vary from one segment to the next), we employ an iterative learning approach. The result is a simple closed-form control law that does not require a solar forecast. We present simulation-based validation results, based on a model of the SeaTrac SP-48 ASV and solar data from the North Carolina coast. These simulation results show that the proposed methodology, which amounts to a closed-form controller and simple iterative learning update law, performs nearly as well as a model predictive control approach that requires an accurate future solar forecast and significantly greater computational capability.

DOI: 10.1109/CCTA53793.2025.11151452

Transcript

Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.

Rosa: I'm Rosa.

Dev: And I'm Dev, here with Taro.

Rosa: Today's paper: "Fusion of Indirect Methods and Iterative Learning for Persistent Velocity Trajectory Optimization of a Sustainably Powered Autonomous Surface Vessel".

Dev: The gist:

Rosa: First, who's behind it and why it matters.

Title and authors: Rosa: We started by looking at the title of this paper, "Fusion of Indirect Methods and Iterative Learning for Persistent Velocity Trajectory Optimization of a Sustainably Powered Autonomous Surface Vessel". It immediately tells you what the paper is trying to achieve.

Dev: It’s a lot packed into that title. They are combining indirect optimal control methods with iterative learning to optimize velocity trajectories for an ASV that uses solar power sustainably.

Taro: So, it sounds like the core challenge they are addressing isn't just controlling the vessel, but doing it in a way that accounts for the unpredictable nature of solar energy and keeps it running reliably over a long period.

Rosa: Exactly. The paper frames this as having two main goals: first, using indirect methods to derive necessary conditions for provably optimal velocity trajectories under time-varying solar resources and state of charge constraints, which is what they did in the first part of the paper.

Dev: And the second goal is using those results from indirect control to create simple control laws that can approximate MPC performance while making tuning much simpler and cutting down on real-time computing needs, all without needing a forecast.

Taro: I’m thinking about what that means for someone trying to build this thing. It suggests you don't need a super complex predictive model for the sun if you want good control.

Rosa: Right. Because they use barrier functions to tighten those state of charge constraints minimally just enough so that the system can still guarantee persistent feasibility, even when the solar resource is unpredictable.

Dev: And then they introduce this iterative learning approach to figure out that constant velocity value using update laws like u i+one = u i + kp(b i(tf) − b i des) and a continuous rate-based update law <ref:2503.10884#pg1>.

Taro: So, the method is essentially a way to find the optimal speed iteratively rather than solving a massive optimization problem all at once upfront.

Rosa: Right. And this iterative learning approach converges to an optimal costate value, which they found corresponds to a speed of one point eight three meters per second <ref:2503.10884#pg1>.

Dev: That specific number is the output of that estimation process, and it’s what drives the subsequent control law derivation based on indirect methods.

Taro: It shows that even with these constraints in place, there is a theoretically optimal speed they can achieve under those conditions.

Rosa: It suggests a certain level of control quality can be achieved by focusing on these theoretical tools rather than just brute-forcing the optimization problem.

Dev: It’s about finding a way to get high performance with reduced computational demands, which is always a win for real-time loops.

The paper's summary: Rosa: Now let’s talk about what this paper actually summarizes, focusing on the methodology they used to tackle the problem of optimizing velocity for this solar-powered ASV.

Dev: They summarize their approach by first using indirect optimal control to find necessary conditions for optimal velocity trajectories in the presence of a time-varying solar resource and pointwise-in-time state of charge constraints.

Taro: So they are using Pontryagin’s Minimum Principle, which is the standard way to look at these kinds of problems, and they derive those necessary conditions.

Rosa: Right. And then they use those necessary conditions to benchmark MPC based results and try to better understand what the MPC optimization is actually deciding when it makes its choices.

Dev: The second part of their summary is using the results from indirect optimal control to derive simple control laws that can approximate the performance of MPC while making tuning much simpler and cutting down on real-time computational demands.

Taro: So, they are aiming for a simplified version of an optimal controller that still gets close to the performance of a more complex one but is easier to run in real time.

Rosa: And they do this all while eliminating the need for a forecast entirely, which is really the key selling point here.

Dev: They also use barrier functions to tighten those state of charge constraints by the minimal amount necessary to achieve persistent feasibility, which prevents running out of power when solar input is zero for some time.

Taro: So it’s a layered approach: first, constrain the energy states with barriers, then use indirect methods to find a simple control law that works under those constraints.

Rosa: Exactly. It’s a systematic way to handle the uncertainty in the solar profile and still get an optimal trajectory without needing perfect foresight.

Dev: The whole summary boils down to deriving a control law that is piecewise constant during each constraint-inactive time interval, which is derived from the indirect methods.

Taro: So, when the solar input changes suddenly, this control law just switches between a few different predefined constant velocities.

The paper's improvements: Rosa: Let’s discuss the specific improvements they propose in this paper compared to previous work on this problem.

Dev: One major improvement is their use of barrier functions to tighten the pointwise-in-time state of charge constraints by the minimal amount necessary to achieve persistent feasibility, which is a significant way they improve upon earlier approaches that might have failed when solar input was zero for a period.

Taro: So they are ensuring that even if the anticipated future solar resource is zero for some time, the system stays feasible, which addresses a specific failure mode.

Rosa: That’s right. And then they use an iterative learning approach to estimate this unknown constant velocity using update laws like u i+one = u i + kp(b i(tf) − b i des) and a continuous rate-based update law <ref:2503.10884#pg1>.

Dev: This iterative learning part is key because it lets them estimate that constant velocity value, which corresponds to the optimal costate value, and it converges to a solution.

Taro: So they’ve solved the issue of not having a straightforward way to solve for the co-state value p1 by using this iterative learning approach instead.

Rosa: And finally, they achieve a control law that is shown based on indirect optimal control methods to be piecewise constant during each constraint-inactive time interval, which makes it simple and easy to tune compared to other complex solutions.

Dev: So the improvements are three things: persistent feasibility guarantee via barrier functions, a closed-form control law derived from indirect optimal control that is piecewise constant, and the iterative learning approach for velocity estimation.

Taro: It’s a lot of machinery put together to solve a tricky problem in real time, but it sounds like it provides a robust framework for dealing with uncertain energy inputs.

Rosa: It does sound like they've made real progress by showing that you can get good performance without needing an environmental forecast or the associated computational burden.

Conclusion: Dev: So to wrap up, this paper, "Fusion of Indirect Methods and Iterative Learning for Persistent Velocity Trajectory Optimization of a Sustainably Powered Autonomous Surface Vessel", presents a method that combines indirect optimal control with iterative learning for real-time velocity optimization.

Rosa: The main implication is that you can achieve good performance without needing an environmental forecast by using barrier functions to ensure persistent feasibility and an iterative learning loop to estimate the constant velocity.

Taro: From my side, it’s interesting that they focused on moving toward actual information maximization in future work, which suggests a direction for making the system even smarter by optimizing what it gathers.

Dev: And from an engineering standpoint, we have a method that works well with reduced computational demands compared to MPC, and they validated it performs nearly as well in simulation without needing the forecast or the associated computational burden.

Rosa: This work shows that you can get comparable performance to MPC without needing a forecast or the associated computational burden for real-time operation.

Taro: I just want to say that their focus on experimental validation on their actual ASV is something I’m keen to see next, because seeing it handle real world misbehavior is the ultimate test of any control strategy.

Dev: Agreed, and the method provides a robust framework for dealing with uncertain energy inputs by making sure the vessel stays feasible even when power input is zero for some time.

Rosa: That’s it for this paper on this fusion of indirect methods and iterative learning to persistent velocity trajectory optimization of a sustainably powered autonomous surface vessel.

More episodes

← Home