ConceptioArchivearXiv CS
arXiv CSopen access

Pick-to-Learn Calibration of an MPC Policy for an Origin-to-Destination Flight Problem

Unknown · 2026 · arxiv_cs
arXiv CS · Papers · License: Open Access · 2026
Open Source ↗Direct PDF ↓
machine learning, deep learning, neural networks

Pick-to-Learn Calibration of an MPC Policy for an Origin-to-Destination Flight Problem Marco C. Campi and Simone Garatti ∗

arXiv:2607.16084v1 [eess.SY] 17 Jul 2026

Abstract This paper illustrates the Pick-to-Learn methodology applied to the calibration of a Model Predictive Control policy. While developed around a specific example, the presentation is meant to highlight a methodology of broad applicability. The example concerns an aircraft traveling from an origin point to a destination point in the presence of uncertain crosswinds and a low-connectivity zone that should be avoided. The MPC policy is parameterized by two hyperparameters, which are selected from data by the P2L procedure. Starting from a dataset of 400 wind realizations, also called scenarios, P2L identifies a final compression set containing only two informative scenarios. The resulting MPC policy avoids the low-connectivity zone on all available scenarios and, according to the P2L theory, satisfies a probabilistic risk bound of 4.8% at confidence level 1 − 10−5 , where the risk is the probability of entering the low-connectivity zone in a future flight under a new wind realization not included in the sample.

1

Introduction

Model Predictive Control (MPC) is a flexible methodology for feedback control design whose practical performance often depends on the choice of tuning parameters. These parameters may encode trade-offs between competing objectives, such as performance and constraint satisfaction. In applications affected by uncertainty, selecting such parameters is especially delicate because a controller that performs well on a nominal model may fail under future uncertainty realizations. This paper illustrates the application of the recently introduced Pick-to-Learn (P2L) methodology to the calibration of an MPC policy. P2L is a technique developed within the framework of the scenario approach, [1–3]. It stemmed from an idea originally introduced in [4] and was subsequently developed into a full-fledged methodology in [5–7]. The policy is learned from a finite dataset of uncertainty realizations and is accompanied by a probabilistic certificate on future constraint satisfaction. The methodology is demonstrated on an origin-to-destination flight problem in which an aircraft must reach a destination while avoiding a low-connectivity zone ∗

M.C. Campi is with the Department of Information Engineering, University of Brescia, via Branze 38, 25123 Brescia, Italy. S. Garatti is with the Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, piazza L. da Vinci 32, 20133 Milano, Italy. Email: [email protected], [email protected].

1

in the presence of uncertain crosswinds. While this example is intentionally a toy problem, it serves the purpose of clearly illustrating the methodology and the theoretical certification results provided by P2L. This same framework can be ported to substantially more complex MPC applications. Previous work on the use of P2L for MPC can be found in [8], which we credit as the pioneering contribution in this direction. The same authors had also earlier opened a line of research for the calibration of MPC parameters through alternative techniques, such as backpropagation and gradient estimation in [9–11], based on the closed-loop trajectory generated by the parametrized MPC policy. While in [8] P2L was seen as an instrument to evaluate the so-called “complexity” of the policy, which measures the level of data compression in policy construction, we introduce P2L here primarily as a means to achieve compression: P2L is seen as an enabler rather than simply as a tool for computing complexity. Further, the goal of this paper is to bring to light the use of state-of-the-art results, tighter than those used in [8], for the certification of constraint satisfaction. Finally, building on the so-called P2L+ methodology introduced in [7], this paper develops a post-design certification step that provides a rigorous basis for the formal verification of essentially any property of interest. In the flight problem, the MPC controller is specified by two hyperparameters, denoted by ρ and ν. For every fixed pair (ρ, ν), the repeated solution of a finitehorizon optimal control problem (FHOCP) defines a feedback policy, denoted by π = MPC(ρ, ν). P2L is then used to select (ρ, ν) from data. The desired property is avoidance of the low-connectivity zone under the wind realizations in the dataset. The final output is not only a calibrated MPC policy, but also a small compression set of scenarios that supports the probabilistic generalization guarantee.

1.1

P2L for MPC

Let D = (δ1 , . . . , δN ) be a dataset of independent uncertainty realizations. The elements of D are also called scenarios. In the flight example developed in Section 2, each scenario δi is one wind realization. P2L incrementally constructs a training set T ⊆ D. Given the current training set T , a learning block selects the MPC tuning parameters and hence returns the policy π(T ) = MPC(ρ, ν). The policy is then checked on the scenarios in D\T . If the desired property is satisfied for all those scenarios, the procedure terminates and returns the pair (π(T ), T ). Otherwise, one violating scenario is picked, added to T , and the learning step is repeated. The P2L procedure is illustrated in Figure 1. The P2L framework leaves two ingredients to the designer. The first is the learning block, namely the procedure that produces a policy from the current training set. As 2

Learning MPC( )

π π(T)

π(T), T

Figure 1: P2L loop specialized to MPC calibration. The current training set T is sent to the learning MPC block, which selects (ρ, ν) and returns the policy π(T ) = MPC(ρ, ν). The policy is checked on the remaining scenarios in D \ T . If a violation is found, one scenario is picked and added to T ; otherwise, the algorithm comes to termination. more precisely specified in the next section, in this paper the learning block tunes the MPC hyperparameters (ρ, ν) so as to minimize the distance traveled while avoiding the low-connectivity zone. The second is the rule used to choose which scenario in D \ T should be added to T when the current policy violates the desired property. In the flight example, the picking rule selects the wind realization producing the largest violation of the low-connectivity constraint. The key point is that P2L returns both a policy π(T ) and a final training set T . This set is interpreted as a compression of the original dataset: it contains the scenarios that were actually used by the algorithm to construct the policy. By utilizing the theory of learning under sample compression of [3], P2L turns the size of T into a probabilistic certificate. Let φ(π, δ) ∈ {0, 1} denote the property to be certified, where φ(π, δ) = 1 means that policy π satisfies the property under the uncertainty realization δ, and φ(π, δ) = 0 means that the property is violated. The risk of a policy is R(π) = Pδ {δ : φ(π, δ) = 0}, namely the probability that the property is violated for a new, previously unseen realization of the uncertainty. The following result is the P2L generalization theorem used in this paper and borrowed from [7]. Theorem 1 (P2L generalization bound). Let (π(T ), T ) be the output returned by P2L when applied to a dataset D of N independent uncertainty realizations. For any confidence parameter β ∈ (0, 1), with confidence at least 1 − β with respect to the random extraction of the dataset, the risk of the returned policy satisfies R(π(T )) ≤ ε(|T |, β, N ),

3

where, for k = 0, 1, . . . , N − 1, ε(k, β, N ) is the unique solution in [k/N, 1] of N −1

β X N m=k

m k  (1 − ε)−(N −m) = 1, N k



and ε(N, β, N ) = 1. For any given value of β and N , function ε(k, β, N ) is increasing in k. Thus, the smaller the final training set T , the tighter the resulting certificate. In the flight example below, P2L is applied to N = 400 wind realizations and terminates with |T | = 2. Theorem 1 is then used with β = 10−5 to obtain the bound R(π(T )) ≤ 4.8%. Here, R(π) is the probability that, under a fresh wind realization, the aircraft trajectory generated by the learned MPC policy enters the low-connectivity zone. Later in the paper, it is shown that the framework can also certify additional properties beyond constraint satisfaction through the extended methodology P2L+ . This include the satisfaction of more restrictive state constraints and an evaluation of the distance traveled by the aircraft.

2

Origin-to-Destination Flight Example

2.1

Problem Description

Consider an aircraft that must travel from the origin O = (0, 0) to the destination D = (0, 20). Throughout, we refer to the first coordinate as the horizontal coordinate and the second as the vertical coordinate. The nominal route is the vertical segment connecting these two points. The flight is affected by crosswind disturbances acting within a wind zone that extends from vertical coordinate 1 to vertical coordinate 15. The wind is uncertain and varies from one flight to another. In the data-driven formulation adopted here, each element of the dataset is a realization of this wind field. A low-connectivity zone is located close to the nominal route. If the aircraft enters this region, communication with ground infrastructure may deteriorate or be lost. The operational requirement is therefore that the aircraft should avoid this region, possibly at the price of traveling a slightly longer path. The setting is illustrated in Figure 2.

4

wind zone

D =(0,20)

low-connectivity zone

O = (0,0) Figure 2: Schematic representation of the origin-to-destination flight problem. The aircraft moves from O = (0, 0) to D = (0, 20) under uncertain crosswind disturbances. The low-connectivity zone is to be avoided.

2.2

Finite-Horizon Problem and MPC Policy

The complete trip is discretized into 200 sampling intervals. At each sampling instant MPC solves a finite-horizon optimal control problem (FHOCP) over a horizon of 20 steps. Only the first control input is applied; at the next time instant the horizon is shifted forward and the optimization is solved again. The aircraft is modeled as a point mass moving in a two-dimensional plane. We start from a continuous-time model that will be then discretized. The continuoustime state is x = (p1 , p2 , v1 , v2 ), where p1 and p2 are ground-relative positions along the two orthogonal horizontal and vertical axes, and v1 and v2 are the corresponding air-relative velocity components. The wind is represented by a scalar disturbance w acting along the first coordinate only. The continuous-time dynamics are ṗ1 = v1 + w, v̇1 = τ1 − 0.5v1 ,

ṗ2 = v2 , v̇2 = τ2 − 0.5v2 ,

where τ = (τ1 , τ2 ) ∈ R2 is the thrust command and the terms −0.5vi are viscous drags. The thrust command is constrained by ∥τ ∥ ≤ 2.1

5

The model is discretized using a sample-and-hold approach with sampling time Ts = 0.1. Thus, for t ∈ [kTs , (k + 1)Ts ), τ (t) = τk and, in closed-loop simulations with wind, w(t) = wk . With xk = (p1,k , p2,k , v1,k , v2,k ), the resulting discrete-time model is xk+1 = Axk + Bτk + Ewk ,

(1)

where  1.0000 0.0000 A= 0.0000 0.0000 and

0.0000 1.0000 0.0000 0.0000

0.0975 0.0000 0.9512 0.0000

 0.0000 0.0975 , 0.0000 0.9512

 0.0049 0.0000 B= 0.0975 0.0000

 0.0000 0.0049 , 0.0000 0.0975

  0.1000 0.0000  E= 0.0000 . 0.0000

Although the wind model is not used in the construction of the MPC policy, which is based only on wind realizations, we specify it here for completeness and reproducibility. The wind disturbance is denoted by wk (p2 ). It depends on the discrete time k and on the second position coordinate p2 ∈ [0, 20], while it is assumed to be constant along the p1 coordinate. Along the p2 direction, the wind field is represented by a stochastic piecewise-linear function on a uniform grid with spacing 0.5. Let j p2,j = , 2

j = 0, . . . , 40,

denote the grid points. At time k = 0, the values w0 (p2,j ) are generated as a stationary realization of the autoregressive process w0 (p2,j+1 ) = 0.95 w0 (p2,j ) + ηj ,

j = 0, . . . , 39,

where ηj ∼ N (0, 4 · 10−4 ) are independent Gaussian random variables. For k > 0, the wind field evolves according to wk+1 (p2,j ) = 0.95 wk (p2,j ) +

40 X

0.9|p2,j −p2,i | ηk,i ,

j = 0, . . . , 40,

i=0

where ηk,i ∼ N (0, 4 · 10−4 ). All Gaussian random variables appearing in the model are mutually independent. Values of wk (p2 ) at points not belonging to the grid are obtained by linear interpolation. 1

While the linear model considered here may come across as overly simple, more realistic nonlinear models come down to a similar formulation after applying a feedback linearization, see e.g. [12].

6

As previously described, the MPC policy is implemented over a total time horizon of 200 instants and relies on a finite-horizon optimal control problem (FHOCP) over a shorter prediction horizon of 20 steps, which is repeatedly solved at each sampling time according to a receding-horizon strategy. Moving to the description of the FHOCP, a wind-free model is used that is obtained from (1) by dropping the term Ewk . For a given value of (ρ, ν), the FHOCP contains three terms in the objective function. The first term attracts the aircraft toward the destination. The second term attracts the horizontal position toward a virtual vertical line located at horizontal coordinate ν. The third term penalizes the control effort. The parameter ρ is the weight assigned to the virtual-line attraction term. For a current state x, the FHOCP is written as min

τ̃0 ,...,τ̃19

20 X

2

∥p̃j − D∥ + ρ(p̃1,j − ν)

j=1

2



+

19 X

0.01∥τ̃j ∥2

(2)

j=0

subject to x̃j+1 = Ax̃j + B τ̃j , x̃0 = x, ∥τ̃j ∥ ≤ 2, j = 0, . . . , 19

j = 0, . . . , 19,

(we used the ~ notation to distinguish the variables as predicted in FHOCP from the actual system variables). As already anticipated, the wind is not appearing in the FHOCP. It enters only at the level of the P2L calibration loop, where different wind scenarios are used to evaluate the closed-loop trajectories generated by candidate values of (ρ, ν). Given (ρ, ν), FHOCP returns an optimal input sequence, of which the first input τ̃0 is selected. Setting τ = τ̃0 defines the feedback law τ = π(x), and the MPC control scheme is achieved by using τk = π(xk ) in (1). In what follows the feedback policy will be also denoted by MPC(ρ, ν) to emphasize its dependence on parameters ρ, ν. The MPC design problem considered here is therefore reduced to the selection of these two hyperparameters ρ and ν, a step that is implemented through the P2L procedure as explained in Section 1.1 and precisely specified for the flight problem in the next Section 3.

3

P2L Calibration of the MPC Hyperparameters

The available dataset contains N = 400 wind field realizations. Initially, the training set T is empty. The P2L procedure progressively augments T by selecting wind scenarios that are informative for the design of the MPC policy. For a given training set T , the learning block in Figure 1 selects (ρ, ν) by solving 1 X L(MPC(ρ, ν), δi ) (3) min ρ,ν |T | δ ∈T i

subject to φ(MPC(ρ, ν), δi ) = 1, 7

∀δi ∈ T.

Here L(MPC(ρ, ν), δi ) denotes the traveled distance of the closed-loop trajectory generated by the policy MPC(ρ, ν) under wind scenario δi . The constraint φ(MPC(ρ, ν), δi ) = 1 requires that the corresponding trajectory does not enter the low-connectivity zone. In the present example, the optimization problem in (3) involves only two variables, ρ and ν, and is therefore easy to solve, even by a grid-based procedure. In this numerical example, we solved it using a standard Bayesian optimization tool available in MATLAB. More generally, the outer optimization associated with the learning block can be a challenging step that deserves specific attention. Importantly, the risk evaluation derived in this paper maintains its validity even when only an approximated solution is available. After the learning step, the resulting policy is tested on all wind scenarios in D \ T . If no trajectory enters the low-connectivity zone, the procedure stops. If at least one trajectory violates the constraint, the next scenario is picked as the wind realization that produces the largest violation. In this example, the violation magnitude is measured by the spatial area of the trajectory lying inside the low-connectivity region. The selected realization is inserted into T and the learning step is repeated. This selection criterion is one possible choice. It is not imposed by the P2L theory. It is a user-defined rule intended to learn a good controller quickly by selecting an informative violating realization.

3.1

A Note on Robustification and Disturbance Handling

We close this section with a broader discussion on how disturbances are typically handled in MPC, and contrast this with the role they play in the P2L-based procedure studied here. Traditional robust or stochastic MPC design methods account for disturbances, when present, within the FHOCP, either explicitly through sampled disturbance scenarios, chance constraints, or min–max formulations, or indirectly through robustification mechanisms such as constraint tightening and tube-based constructions, [13–23]. This is important because, if disturbances are ignored in the FHOCP, the resulting control law may be significantly affected by them once implemented in closed-loop. For instance, a disturbance may push the state toward a forbidden region. If the FHOCP is formulated without accounting for this effect, then a current state lying outside the forbidden region may nonetheless lead, shortly afterwards, to a constraint violation. The P2L-based MPC procedure introduced here addresses this issue from a different perspective. The FHOCP itself does not include the disturbances. However, at the calibration level, P2L selects the MPC parameters (ρ, ν) so as to enforce constraint satisfaction on the closed-loop trajectories generated under the sampled disturbance realizations. In this sense, P2L provides an external, global supervision of the MPC policy: the FHOCP retains the basic receding-horizon structure of MPC and its implementation is further simplified by the fact that disturbances are not included at this level, while the effect of disturbances is accounted for by the P2L calibration performed at the level of complete closed-loop trajectories. At the same time, it should be noted that nothing in the proposed framework prevents one from incorporating disturbances or other robustification mechanisms directly in the FHOCP. The point is rather that, within the present P2L-based ap8

proach, this is not strictly necessary in order to obtain a global probabilistic certificate for the resulting closed-loop behavior.

4

Numerical Results

The procedure starts with ν = −5.

ρ = 0,

Since ρ = 0, the virtual-line term is inactive. Without wind, the aircraft would fly along the straight path from the origin to the destination. Under wind, however, the trajectories are displaced, and some enter the low-connectivity zone. Panel (a) in Figure 3 shows a representative subset of 20 trajectories among the 400 available. The red trajectory is the worst one according to the violation criterion. It is selected by P2L and inserted into the training set. 20

20

20

18

18

18

16

16

16

14

14

14

12

12

12

10

10

10

8

8

8

6

6

6

4

4

4

2

2

2

0

0

0

-1.5

-1

-0.5

0

0.5

1

1.5

-1.5

-1

-0.5

0

(a)

0.5

1

1.5

(b)

-1.5

-1

-0.5

0

0.5

1

1.5

(c)

Figure 3: Trajectories obtained at the three steps of P2L. Panel (a): trajectories with ρ = 0 and ν = −5. The red trajectory is the realization with the largest violation and is inserted into the training set. Panel (b): Trajectories after the first learning step. One remaining wind realization still violates the constraint and is added to the training set. Panel (c): Trajectories with the final policy obtained after two P2L picks. No trajectory violates the low-connectivity constraint. At this stage |T | = 1. The learning block optimizes ρ and ν using only this wind realization. The optimization returns ν = −4.71.

ρ = 14.11,

The corresponding MPC policy is then tested on the remaining 399 wind realizations. One of the trajectories corresponding to a wind realization still enters the low-connectivity zone, as shown in Panel (b) of Figure 3. This violating realization is picked and inserted into T .

9

The training set now contains two wind realizations. The learning problem is solved again, minimizing the average traveled distance over these two cases while enforcing avoidance of the low-connectivity zone for both. The new values are ν = −4.55.

ρ = 7.59,

With this policy, none of the trajectories corresponding to the remaining 398 wind realizations enters the low-connectivity zone, see Panel (c) of Figure 3. The final training set has cardinality |T | = 2. Using confidence parameter β = 10−5 , Theorem 1 gives R(π(T )) ≤ 4.8%. Here, the risk is the probability that, under a fresh and previously unseen wind realization, the aircraft trajectory generated by the designed policy enters the lowconnectivity zone. Thus, with confidence 1 − 10−5 , the violation probability of the learned MPC policy is no larger than 4.8%.

5

Post-Design Certification of Additional Properties

The P2L run described above was carried out with one specific property in mind, namely avoidance of the original low-connectivity zone. Once the MPC policy has been designed, however, one may want to certify other properties without changing the control policy. This is the role of the post-design evaluation step. The idea is the one formalized by P2L+ in [7]: a property can be evaluated after the design by adding to the original compression set the scenarios, among those not already in the compression set, that violate the new property. Let π(T ) = MPC(ρ, ν) be the policy returned by the P2L procedure and let T be the final training set. In the numerical experiment of Section 4, |T | = 2. Consider now a new property P , different from the property used during the design phase. For each wind realization δi , let ψP (π(T ), δi ) ∈ {0, 1} be the corresponding indicator, where ψP (π(T ), δi ) = 1 means that the closed-loop trajectory generated by π(T ) under δi satisfies P . Define UP = {δi ∈ D \ T : ψP (π(T ), δi ) = 0}. Thus, UP contains the scenarios, not already in the compression set, for which the new property is violated. The empirical count |UP | contributes to the new complexity according to formula kP = |T | + |UP |. The following result is the post-design specialization of P2L+ and it will be used below in the current example. 10

Theorem 2 (Post-design P2L+ certificate). Let (π(T ), T ) be the output returned by P2L when applied to a dataset D of N independent uncertainty realizations. Let P be any additional property of interest and let UP be the set of elements in D \ T that violate P under policy π(T ). Define RP (π(T )) = Pδ {δ : ψP (π(T ), δ) = 0}. Then, for any confidence parameter β ∈ (0, 1), with confidence at least 1 − β with respect to the random extraction of the dataset, RP (π(T )) ≤ ε(|T | + |UP |, β, N ), where ε(·, β, N ) is the same function as in Theorem 1. The theorem gives a direct operational rule. To certify a new property after the MPC design, one simulates the closed loop on the scenarios in D \ T , counts how many of them violate the property, adds this number to |T |, and evaluates the same bound used earlier in the paper. The empirical violation count is therefore the starting point of the certificate, but the final statement concerns the probability of violation under a fresh wind realization. This procedure is illustrated for the flight problem in the next subsections.

5.1

A More Conservative Connectivity Requirement

We first reconsider the connectivity constraint. The original design required the aircraft to avoid the low-connectivity zone represented in Figure 2. Suppose now that connectivity degrades gradually around this region and that, to remain on the safe side, the aircraft should avoid a larger set. This enlarged set is represented in green in Figure 4. The policy is not redesigned and we want to evaluate the probability of violating this more stringent constraint. The new property is Pgreen :

the trajectory does not enter the enlarged green region.

Among the scenarios in D \ T , 14 trajectories enter the enlarged region. Therefore kgreen = |T | + 14 = 2 + 14 = 16. Using Theorem 2 with N = 400 and β = 10−5 gives Rgreen (π(T )) ≤ 11.4%. This is a bound on the probability, certified with confidence 1 − 10−5 , that a new wind realization causes the trajectory of the learned MPC policy to enter the enlarged low-connectivity region. Suppose now that losing connectivity for a few sampling instants does not cause a major operational problem. We therefore fix a tolerance threshold of 10 consecutive sampling instants and declare a trajectory violating only if it remains inside the enlarged green region for at least 10 consecutive instants. This gives the property Pgreen,10 : the trajectory does not remain in the enlarged green region for 10 consecutive sampling instants or more. 11

wind zone

D =(0,20)

low-connectivity zone

Figure 4: Post-design evaluation for an enlarged low-connectivity zone. The green region represents the more conservative connectivity constraint and corresponds to the original region shifted left by 0.125. A representative subset of the trajectories generated by the final MPC policy is shown. In this case, the post-design count gives 3 violating scenarios in D \ T , and hence kgreen,10 = |T | + 3 = 2 + 3 = 5. With N = 400 and β = 10−5 , Theorem 2 yields Rgreen,10 (π(T )) ≤ 6.4%.

5.2

Certification of Traveled Distance

The same post-design mechanism can be applied to performance properties. Let L(π, δ) denote the total distance traveled by the closed-loop trajectory generated by policy π under wind realization δ. For a threshold γ, define Pγ :

L(π, δ) ≤ γ.

The risk associated with this property is Rγ (π(T )) = Pδ {δ : L(π(T ), δ) > γ}. Equivalently, if FL is the cumulative distribution function of the random traveled distance, then FL (γ) = 1 − Rγ (π(T )).

12

For example, consider the threshold γ = 20.05, which adds 0.05 to the minimal distance from Origin to Destination. Among the scenarios in D \ T , 105 trajectories travel a distance larger than 20.05. Thus, k20.05 = |T | + 105 = 2 + 105 = 107. Using Theorem 2 with N = 400 and β = 10−7 gives R20.05 (π) ≤ 41.2%, and therefore FL (20.05) ≥ 58.8% with confidence at least 1 − 10−7 . Repeating the same computation for a grid of thresholds γ1 , . . . , γ100 produces a lower bound on the cumulative distribution function of the random traveled distance. Specifically, for each threshold γj , let Uj = {δi ∈ D \ T : L(π, δi ) > γj },

kj = |T | + |Uj |.

Then FL (γj ) ≥ 1 − ε(kj , 10−7 , 400),

j = 1, . . . , 100,

holds simultaneously for all 100 thresholds with confidence at least 1 − 10−5 , by the union bound. The resulting lower bound for the flight problem is shown in Figure 5. 1 0.9 0.8

0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 20

20.01

20.02

20.03

20.04

20.05

20.06

20.07

20.08

20.09

20.1

Figure 5: Certified lower bound on the cumulative distribution function of the traveled distance. The bound is obtained by applying the post-design certificate at 100 distance thresholds with confidence parameter 10−7 for each threshold, yielding an overall confidence level at least 1 − 10−5 .

13

6

Discussion and Conclusions

We have addressed in this paper a specific flight-control problem to illustrate how P2L can be used to calibrate an MPC policy and certify its closed-loop behavior. The flight-control application considered here is merely intended as an example of a general methodology. In this methodology, the finite-horizon optimization problem defines a family of MPC policies, while P2L operates at the policy level by selecting the parameters that achieve the desired closed-loop behavior over the available disturbance scenarios. The same methodology can be used in other MPC settings where robustness against disturbances is required. A natural example is tube MPC. In tube MPC, one considers a tube around a nominal trajectory designed so that the deviation induced by the disturbance remains inside the tube. The tube is then required to lie within the constraint-admissible region, thereby ensuring constraint satisfaction for all disturbances in the prescribed uncertainty set. This is a worst-case construction. A similar approach can be pursued using the P2L methodology of this paper, if a relaxation of the worst-case requirement is tolerable. For instance, one may introduce a constraint enlargement, or equivalently a tightening of the nominal admissible region, as in tube MPC, when solving the FHOCP. However, rather than fixing this enlargement a priori from a worst-case disturbance model, one could calibrate it with P2L in the same spirit in which the parameters ρ and ν have been calibrated here. This would provide a probabilistic, data-driven alternative to worst-case tube design, while preserving the possibility of certifying the resulting closed-loop behavior. Along this approach, another important advantage is that the disturbance model used to generate the scenarios can be arbitrarily complex, and no explicit knowledge of its probability distribution is required beyond the availability of independent draws. Thus, the proposed methodology can be applied with disturbance scenarios generated by detailed simulators, high-fidelity models, or other complex procedures, while still providing rigorous and typically tight certificates for the resulting closed-loop behavior. Finally, the disturbance scenarios used by P2L need not be generated from a model. They may instead be obtained directly as observations. In this case, one can avoid specifying a probabilistic model for the disturbance and still obtain rigorous guarantees, thanks to the distribution-free nature of the P2L certificate. Moreover, since P2L does not require setting aside data for testing or calibration, all available observations can be used in the construction and certification of the policy.

References [1] M.C. Campi and S. Garatti. Introduction to the scenario approach. SIAM, 2018. [2] M.C. Campi, A. Carè, and S. Garatti. The scenario approach: a tool at the service of data-driven decision making. Annual Reviews in Control, 52:1–17, 2021. [3] M.C. Campi and S. Garatti. Compression, generalization and learning. Journal of Machine Learning Research, 24(339):1–74, 2023. 14

[4] M.C. Campi, S. Garatti, and F.A. Ramponi. Non-convex scenario optimization with application to system identification. In Proceedings of the 54th IEEE Conference on Decision and Control, pages 4023–4028, 2015. [5] D. Paccagnan, M.C. Campi, and S. Garatti. The Pick-to-Learn algorithm: Empowering compression for tight generalization bounds and improved posttraining performance. In Advances in Neural Information Processing Systems, volume 36, pages 18165–18185. Curran Associates, Inc., 2023. [6] D. Paccagnan, D. Marks, M.C. Campi, and S. Garatti. Pick-to-Learn for systems and control: theoretical review with a showcase in reachability analysis. In Proceedings of the 64th IEEE Conference on Decision and Control, pages 1980– 1985, 2025. [7] D. Paccagnan, D. Marks, M.C. Campi, and S. Garatti. Pick-to-learn for systems and control: Data-driven synthesis with state-of-the-art safety guarantees. ArXiv, 2512.04781, 2025. https://arxiv.org/abs/2512.04781. [8] R. Zuliani, E.C. Balta, and J. Lygeros. Closed-loop performance optimization of model predictive control with robustness guarantees. European Journal of Control, 86:101319, 2025. [9] R. Zuliani, E.C. Balta, and J. Lygeros. BP-MPC: Optimizing the closed-loop performance of MPC using backpropagation. IEEE Transactions on Automatic Control, 70(9):5690–5704, September 2025. [10] R. Zuliani, E.C. Balta, and J. Lygeros. Policy optimization for unknown systems using differentiable mpc. In Gaurav Sukhatme, Lars Lindemann, Stephen Tu, Adam Wierman, and Nikolay Atanasov, editors, Proceedings of The 8th Annual Learning for Dynamics and Control Conference, volume 331 of Proceedings of Machine Learning Research, pages 1275–1287. PMLR, 2026. [11] R. Zuliani, E.C. Balta, and J. Lygeros. Policy optimization with differentiable mpc: Convergence analysis under uncertainty. ArXiv, 2601.01940, 2026. https://arxiv.org/abs/2601.01940. [12] L. Deori, S. Garatti, and M. Prandini. 4-d flight trajectory tracking: A receding horizon approach integrating feedback linearization and scenario optimization. IEEE Transactions on Control Systems Technology, 27(3):981–996, 2019. [13] A. Bemporad, F. Borrelli, and M. Morari. Min-max control of constrained uncertain discrete-time linear systems. IEEE Transactions on Automatic Control, 48(9):1600–1606, 2003. [14] W. Langson, I. Chryssochoos, S.V. Raković, and D.Q. Mayne. Robust model predictive control using tubes. Automatica, 40(1):125–133, 2004. [15] D.Q. Mayne, M.M. Seron, and S.V. Raković. Robust model predictive control of constrained linear systems with bounded disturbances. Automatica, 41(2):219– 224, 2005. 15

[16] M. Cannon, Q. Cheng, B. Kouvaritakis, and S.V. Raković. Stochastic tube MPC with state estimation. Automatica, 48(3):536–541, 2012. [17] M. Prandini, S. Garatti, and J. Lygeros. A randomized approach to stochastic model predictive control. In Proceedings of the 51st IEEE Conference on Decision and Control, pages 7315–7320, 2012. [18] G. Schildbach, L. Fagiano, C. Frei, and M. Morari. The scenario approach for stochastic model predictive control with bounds on closed-loop constraint violations. Automatica, 50(12):3009–3018, 2014. [19] M. Farina, L. Giulioni, and R. Scattolini. Stochastic linear model predictive control with chance constraints: A review. Journal of Process Control, 44:53– 67, 2016. [20] M.C. Campi, S. Garatti, and M. Prandini. Scenario optimization for MPC. In Saša V. Raković and William S. Levine, editors, Handbook of Model Predictive Control. Birkhäuser, 2018. [21] L. Deori, S. Garatti, and M. Prandini. A randomized relaxation method to ensure feasibility in stochastic control of linear systems subject to state and input constraints. Automatica, 115:108854, 2020. [22] S.V. Raković. The implicit rigid tube model predictive control. Automatica, 157:111234, 2023. [23] K. Wang, S. Zhang, S. Gros, and S.V. Raković. Tube MPC with time-varying cross-sections. IEEE Transactions on Automatic Control, 70(3):1851–1858, 2025.

16

Record · ID 381735 · SHA-256 59e470f315098828
Retrieved via Conceptio — every document is proof-bundled with source, license, and retrieval metadata.