Abstract
This paper displays an optimal fault-tolerant formation control method, which is applied to a heterogeneous multi-agent system(HMAS) consisting of multiple uncrewed aerial vehicles (UAVs) and uncrewed ground vehicles (UGVs), solving the problem of UAVs and UGVs cooperative formation control under the partial loss of effectiveness and interruption faults. The system uses the Kronecker product to embed the UAVs system model and UGVs system model into the state-space equation, addressing the issue of inconsistent matrix dimensions between the UAVs and UGVs system models. Considering the fault-tolerant control problem of directed topology HMAS with actuator partial loss of effectiveness (PLOE) faults and interrupt faults, a control allocation algorithm that does not require controller reconstruction is introduced. Combining optimization theory with control allocation algorithms, a fault-tolerant controller that does not require solving the Hamilton-Jacob-Bellman equation is obtained. Further, introduce the controller into the formation control problem of leader-follower HMAS, and demonstrate the effectiveness of the proposed algorithm through the Lyapunov stability theory. The algorithm is applied to the heterogeneous MAS, compensating for actuator faults. Finally, simulations are carried out on a formation system of three UAVs and three UGVs to assess the effectiveness of the proposed protocol.
Similar content being viewed by others
Introduction
In light of the robust advancement of multi-agent system theory, substantial achievements have been realized in investigating cooperative control within MAS1,2,3. Among the myriad intriguing topics in the practical application of motion coordination, formation control4,5,6,7 emerges as particularly compelling, as it primarily seeks to synthesize essential multi-agent activities, including surrounding detection, data collection, task allocation, and target tracking to achieve the establishment and sustained maintenance of a designated high-dimensional spatial configuration. The preceding discussion pertains exclusively to isomorphic MAS, in which all agents possess identical model parameters. However, in practical scenarios, variations in environmental conditions and functional requirements may result in systems comprising individual agents that diverge in model parameters, dimensions, and functionalities. For instance, a HMAS composed of UAVs and UGVs can effectively capitalize on the strengths of UAVs while offsetting the shortcomings of UGVs, thereby facilitating the collaborative execution of more intricate tasks. HMAS in air-ground collaboration exhibits a broad spectrum of application domains8,9, encompassing fire monitoring10, as well as reconnaissance and search-and-rescue operations11,12.
Major military powers worldwide emphasize the collaborative capabilities and robust performance of air-ground combat systems composed of UAVs and UGVs. In recent years, heterogeneous uncrewed combat systems formed by UAVs and UGVs have garnered favor among military powers due to their rapid response times, formidable communication capabilities, inconspicuous sizes, and precise target reconnaissance accuracy13,14,15,16,17,18,19. The increasing diversity of application domains for UAVs and UGVs has led to a surge in the demand for enhanced reliability and safety of complex control systems within contemporary industrial frameworks. This is particularly pertinent for MAS, where the failure of a single agent may bring about functioning loss, and the propagation of such failures through inter-agent communication links can amplify their impact, potentially leading to the collapse of the entire system. Consequently, FTC technology is an indispensable component, as fault-tolerant mechanisms can provide technical assurances for individual stability, global stability of MAS, task accomplishment, and performance maintenance. Research on fault-tolerant technology for MAS has sparked considerable enthusiasm among scholars. Reference20 proposes a fault detection and FTC strategy for fixed-wing UAVs under actuator faults, sensor malfunctions, and environmental disturbances. An unknown input observer has been developed to estimate system faults, disturbances, and state information. By integrating the estimates from the observer, an FTFC based on the backstepping method has been engineered. Reference21 investigates the collision avoidance capabilities of leader-follower multi-UAV systems under actuator failures and saturation conditions. The developed fault-tolerant mechanism effectively compensates for the effects induced by actuator failures.
Additionally, a collision avoidance mechanism has been designed to replan feasible and safe trajectories, ensuring the performance of trajectory tracking. Reference22 investigates the UAV formation control problem involving multiple vertical takeoff and landing (VTOL) drones while accounting for actuator failures, parameter variations, and external disturbances, proposing a corresponding adaptive distributed FTC algorithm. This algorithm is proficient in precisely achieving formation objectives and demonstrates excellent fault tolerance against actuator failures and robustness to external disturbances. Reference23 introduces a fixed-time FTC method and proposes a fuzzy adaptive FTC to address the problem of rapid time-constrained tracking for hypersonic vehicles. Reference24 investigates the fixed-time fault-tolerant consensus problem within directed topologies of higher-order nonlinear multi-agent models. A fixed-time observer based on power technology has been designed to monitor unpredictable actuator failures effectively. The fixed-time tracking protocol, developed in conjunction with observational information, effectively compensates for the impact of failures. It is evident that the research focus of MAS is not limited to conventional aerial vehicles; spacecraft also represent one of the prominent areas of study25,26,27. While a substantial body of research exists on fault-tolerant control for isomorphic MAS, the fault-tolerant methods specifically designed for heterogeneous systems comprising UAVs and UGVs remain relatively scarce. This represents one of the motivations for the present study. Reference28 examines the FTFC problem for heterogeneous UAV-UGV systems with finite sequence failures, proposing a formation tactic deriving from backstepping and adaptive FTC that enables UAVs and UGVs to achieve the desired formation in the XOY plane while ensuring convergence of the UAVs along the Z-axis. Reference29 investigates the air-ground coordination problem between UAVs with actuator faults, external disturbances, model uncertainties, and healthy UGVs. A neuro-adaptive nonsingular fast terminal sliding mode control(SMC) has been created by integrating adaptive neural network control(NNC) laws. The proposed controller’s effectiveness was confirmed through experiments involving three designed UAVs and UGVs. The methods mentioned earlier are primarily robust-based strategies, focusing on observers, SMC, adaptive control, and NNC, with the primary objective of addressing system reliability. However, extensive research has been lacking in addressing the optimization and FTFC problem to conserve system resource costs.
Reference30 introduces a control allocation strategy for leader-follower MAS governed by general dynamic equations that can handle actuator failures. By leveraging local information and optimization theory, a distributed fault-tolerant consensus algorithm for MAS has been proposed, and its effectiveness has been validated. The proposed control allocation strategy effectively addresses actuator shutdown failures and partial failure issues, ensuring the consensus error converges to zero. It focuses solely on the design for homogeneous agents, and the designed allocation control strategy is applied to leader-following MAS. Reference31 investigates the fixed-time optimal FTFC output problem for heterogeneous MAS. A hierarchical FTFC framework is proposed to isolate the faults’ effects, thereby preventing cascading failures. A new adaptive fixed-time FTFC has been constructed for each agent, which can rapidly converge the formation error of faulty agents to a vicinity near the origin, incorporating optimization theory; the formulated formation control strategy is a fixed-time FTC output tracking method. Both methods are fault-tolerant-based, but their emphases are different.
Thus, this paper introduces a leader-following-based fault-tolerant formation control method for heterogeneous UAV-UGV systems, combining optimal control theory to propose an optimal fault-tolerant controller with optimized performance. It solves the FTFC problem of heterogeneous UAVs-UGV systems with actuator the partial loss of effectiveness(PLOE) and interruption faults. The contributions of this study are as follows:
-
1.
First, the state equations of UAVs and UGVs are introduced, utilizing the Kronecker product to formulate a state space representation that integrates both UAVs and UGVs into a heterogeneous system. An actuator fault model is established, and the fault model is incorporated into the heterogeneous state space, resulting in the heterogeneous MAS fault model.
-
2.
An optimal fault-tolerant controller is designed, constructing a performance index function comprising error vectors and control variables for each agent in the UAVs-UGVs heterogeneous system. Based on optimal control theory, a Hamiltonian function incorporating actuator fault information is formulated, yielding the solution that minimizes the Hamiltonian, which serves as the optimal FTC law. A new Lyapunov function is developed to demonstrate its stability.
-
3.
Finally, a control allocation algorithm combined with optimization theory is introduced, resulting in an optimal FTFC method that can handle leaders with unknown inputs and external environmental disturbances. The feasibility of the control law is proven using the Lyapunov stability theory. The optimal FTC effectively compensates for the impacts caused by actuator faults, overcoming PLOE and interruption faults under conditions where the leader has unknown inputs and external environmental disturbances.
The balance of this paper is listed as follows. Section “Preliminaries and problem formulation” presents several foundational principles and preparatory knowledge, including establishing models for UAVs and UGVs and problem descriptions. Section “Fault-tolerant formation controller design and analysis” details the principle of the control allocation algorithm and the design of the optimal fault-tolerant controller, along with its proof. Section “Simulations” provides the experimental and designed simulation results of the control laws. Section “Conclusions” concludes this study and outlines the focus of future work.
Preliminaries and problem formulation
A. Graph theory
The weighted undirected graph \(G=(V,E,A)\) is utilized to Symbolize the communication network for \(\text {n}\) agents within MAS, where \(V=\begin{pmatrix}v_1,v_2,\ldots v_n\end{pmatrix}\) indicate the nodes set in the graph \(\text {G}\). \(E=\left\{ e_{ij}=\left( v_{i},v_{j}\right) \right\} \subseteq v\times v\) signifies the communication between the \(\text {n}\) nodes, and \({e}_{ij}=\begin{pmatrix}v_i,v_j\end{pmatrix}\) refers to the graph G ’s edge set. If the information exchange occurs bidirectionally, G is classified as an undirected graph; conversely, that is classified as a directed graph. \(A=\begin{bmatrix}a_{ij}\end{bmatrix}_{n\times n}\) represents the graph G ’s adjacency matrix, where \(a_{ij}\) indicates the data transfer between nodes \(\nu _{i}\) and \(\nu _{j}\), specifically, \({a}_{ij}>0\) indicates communication, while \(a_{ij}=0\) denotes a lack of communication. We then define the Laplacian matrix \(L=[l_{ij}]\in R^{n\times n}\) between the follower agents as follows.
The leader is denoted by \(V_0\) , and the matrix \(D=diag(d_{01},d_{02},\ldots ,d_{0n})\) represents the communication relationship between the leader and followers. The overall matrix of the leader-following MAS network topology is defined by \(\mathscr {G}=L+D\) .
B. Second-order dynamic model of the UGV
Informed by reference32, the dynamic equation for the UGV is obtained as follows:
where \(p_{gi}=\begin{bmatrix}p_{gi}^x,p_{gi}^y\end{bmatrix}^T\) embodies the formation of the ground position for UGV. \(v_{gi}=\left[ v_{gi}^{x},v_{gi}^{y}\right] ^{T}\) corresponds to the formation of their speeds and \(u_{gi}=\left[ u_{gi}^{x},u_{gi}^{y}\right] ^{T}\) represents the input in the systems.
We assume that there are \(\text {m}\) UGV in the system. The multi-vehicle system can be expressed as:
where \(x_{Gi}=\left( p_{i}^{x} ,p_{i}^{y} ,v_{i}^{x} ,v_{i}^{y} \right) ^{T},u_{Gi}=\left( u_{i}^{x} ,u_{i}^{y} \right) ,i=1,2,...,m\),\(f(t,x_{Gi})\)represents the external environmental disturbance acting on the UGV.
Here, \(\otimes\) designates the Kronecker product. \(A_{g},B_{g}\) represent the state matrix and output matrix of the UGV, respectively.
Let the expected formation of the formation be denoted as \(h_{g}=\begin{pmatrix}h_{g}^{x},h_{g}^{y}\end{pmatrix}^{T}\). Based on this \(h_{g}\) , the formation error can be represented as \(\delta _{G}=\left( \delta _{G}^{x},\delta _{G}^{y}\right) ^{T}=\left( p_{gi}^{x}-h_{g}^{x},p_{gi}^{y}-h_{g}^{y}\right) ^{T}\). Therefore, when the UGVs system experiences actuator failures, the following conditions must be met for the formation to be considered complete:
C. Second-order dynamic model of the UAV
Informed by reference33, the dynamic equation for the UAV is obtained as follows:
where \(p^{x},p^{y},p^{z}\) manifests the positions of the drone along the X, Y, and Z axes in the global coordinate system; \(\phi ,\theta ,\psi\) denote the drone’s three turning angles are in 3D; \(f_{z}\) illustrates the total lift generated by the four propellers; \(I_{_x},I_{_y},I_{_z}\) refer to the moments of inertia about the X, Y, and Z axes, respectively; \(g\ddot{\phi },g\theta ,\dot{\psi }\) represents the control inputs required to maneuver the drone’s rotation about the three coordinate axes.
We assume that there are l UAVs in the system. The multi-vehicle system can be expressed as:
where \(x_{Ai}=(p_{i},v_{i},\Omega _{i},\Omega _{i})^{T},\) \(p_{i}=\left( p_{i}^{x},p_{i}^{y},p_{i}^{z}\right) ^{T},\) \(v_{i}=\left( v_{i}^{x},v_{i}^{y},v_{i}^{z}\right) ^{T},\) \(u_{Ai}=\left( u_{i}^{x},u_{i}^{y},u_{i}^{z}\right) ^{T}\), \(\Omega _{i}=\left( g\theta _{i},-g \phi _{i},\psi \right) ^{T},\)\(\dot{\Omega }_{i}=\left( g\dot{\theta }_{i},-g \dot{\phi }_{i},\ddot{\psi } \right) ^{T},i=1,2,\ldots ,l\), \(f(t,x_{Ai})\)stands for the external environmental disturbance acting on the UAV.
Here, \(\otimes\) designates the Kronecker product. \(A_{a},B_{a}\) represent the state matrix and output matrix of the UAV, respectively.
Let the expected formation of the formation be denoted as \(h_a=\left( h_a^x,h_a^y,h_a^z\right) ^T\) . Based on this \(h_{a}\) , the formation error can be represented as \(\delta _{A}=\left( \delta _{A}^{x},\delta _{A}^{y},\delta _{A}^{z}\right) ^{T}=\left( p_{ai}^{x}-h_{a}^{x},p_{ai}^{y}-h_{a}^{\nu },p_{ai}^{z}-h_{a}^{z}\right) ^{T}\) . Therefore, when the UGVs system experiences actuator failures, the following conditions must be met for the formation to be considered complete:
D. Heterogeneous multi-agent systems
By establishing models (2) and (5) for UAVs and UGVs in the preceding chapters and introducing the actuator failure model (9), we can construct the state space expression for the actuator failure in the heterogeneous MAS by merging state variables. The formal definition of the heterogeneous MAS state space model is as follows:
where
To more effectively illustrate the communication relationships among heterogeneous MAS, a basic linear transformation of the system’s Laplacian matrix is required. When there are \(\text {m}\) UGV and \(\text {l}\) UAV in the system, the corresponding Laplacian matrix is as follows:
where \(L_{AG},L_{GA}\) represents information between heterogeneous agents. The expected formation for the heterogeneous MAS is denoted as \(h=\left( h_a^T,h_g^T\right) ^T\) , and the corresponding formation error is represented as
Therefore, when the UGV and UAV systems experience actuator failures, the following conditions must be fulfilled for the formation to be deemed complete:
E. Actator fault model
Due to the variability of the operational environment, actuator failures in UAV and UGV systems are inevitable; for instance, a propeller of the UAV may become jammed, or a drive wheel of the UGV may experience insufficient power. This study primarily focuses on actuator failure faults, collectively representing the failure model as follows:
where \(\mathscr {P}_{i}\) designates the actuator failure coefficient. The actuator failure for the UGV can be expressed as \(\mathscr {P}_{Gi}=diag(\rho _{ix},\rho _{iy})\in R^{2}\), while for the UAV it can also be represented as \(\mathscr {P}_{Ai}=diag(\rho _{ix},\rho _{iy},\rho _{iz})\in R^{3}\) , with the constraint \(\mathscr {P}_{Gi},\mathscr {P}_{Ai}\in [0,1]\). Based on Eq. (9), we can derive the system state model after actuator failure as follows:
Fault-tolerant formation controller design and analysis
Currently, most fault-tolerant consistency control methods for MAS focus on addressing PLOE and external environmental disturbance faults, while research on handling actuator interruption faults in HMAS is still relatively limited. This chapter primarily investigates how to achieve system consistency in a leader-following HMAS under partial actuator failure and actuator interruption faults and how to complete formation tasks based on consistency.
A. Control allocation algorithm
Based on Ref.34, we can derive the principle of the control allocation algorithm, and its application can solve the stability problem when actuator saturation faults occur. The dynamic model of the leader-following heterogeneous MAS after introducing the control allocation algorithm is:
where \(v_{i}\in R^{k}\) represents the virtual control input of the i -th agent and represents the consistency fault-tolerant controller obtained by the control allocation algorithm. When the system experiences actuator faults, we have the following mathematical equations to describe the situation.
Based on the concept of the virtual controller in the control allocation algorithm, we can derive the following optimization equation:
where \(W_{i}^{-1}(t)=\left( W_{i}^{-1}(t)\right) ^{T}\in R^{m\times m},i=1,2,...,N\) is a positive definite matrix. Generally, \(W_{i}(t)\) represents the optimization objective function, and in the absence of actuator faults, \(W_{i}(t)=I\) . When actuator faults occur in the system, \(W_{i}(t)\) can be expressed as: \(W_{i}(t)=(1+\varepsilon )I-\mathscr {P}_{i}(t)\) , \(\varepsilon \rightarrow 0^{+}\) is a nonzero normal constant that ensures \(W_{i}(t)\) remains an invertible matrix after an actuator interruption fault occurs.
Next, we present some basic assumptions used in the analysis.
Assumption 1
The communication graph among the followers is strongly connected, with at least one follower being directly linked to the leader.
Assumption 2
The matrix B is of deficient rank, \(rank(B)<\min (m,n)\) .
Note 1
The validity of Assumption 1 indicates that the matrix B has a nontrivial full-rank decomposition. That is, there exist matrices \(B_{\nu }\in R^{n\times k}\) and \(C\in R^{k\times m}\) such that \(B=B_{_v}C\) , and \(rank(B)=rank(B_{_v})=rank(C)\) .
Assumption 3
35In the leader-follower MAS, even if \(m-k\) actuator faults occur, the remaining actuators can still function properly and ensure the completion of the specified task.
Note 2
Assumption 3 is the fundamental condition for ensuring system controllability. The i -th agent’s stability depends on the number of actuator interruption faults l. If \((m-k)<l\) , then, the system can achieve stability; otherwise, the system will approach collapse.
B. Optimal FTC derived from the control allocation algorithm
All control objective problems have been transformed into a consensus problem aimed at driving the error vector of the controlled objects toward zero. For a single UAV and UGV, we first define the state vector as follows:
the design and analysis of the fault-tolerant controller after introducing the control allocation algorithm are presented. Then, the theoretical results are extended to scenarios where the leader has unknown control inputs and the follower agents’ actuators are affected by external environmental disturbances. The effectiveness and stability of the proposed algorithm are verified through theoretical analysis. The consensus error for the i -th follower is defined as,
Since the dimensionality of the UAV state vector differs from that of the UGV state vector, the weight coefficient for the UAV is set as \(Q=q^{*}I_{12},R=r*I_{3}\), where \(q>0,r>0\). The weight coefficient for the UGV is set as \(T=\lambda *I_{6},\gamma =\mu *I_{3}\), where \(\lambda>0,\mu >0.\)
When actuator faults occur in the system, the performance index function (13), after introducing the control allocation algorithm, will change as follows:
where \(R_{\textrm{iv}}(t)\in R^{k\times k}\) is a positive definite symmetric matrix. The virtual controller \(v_i\) that minimizes it can be obtained by solving the performance index function represented by Eq. (14). Then, using Eq. (12), the optimal consensus FTC can be derived.
Next, we present some lemmas required to obtain the optimal fault-tolerant controller.
Lemma 1
36Consider the performance index function represented by Eqs. (13) and (14). If the matrices in these equations satisfy the following relationship:
Then, it can be concluded that the optimal virtual controller \(v_i\) obtained from Eq. (13) and the optimal control obtained from Eq. (14) satisfy: \(Cu_{iu}^*=v_i^*\) . Meanwhile, the state trajectories of the agents obtained by the two different methods are identical.
Lemma 2
36If the matrices in the performance index function \(J_{iv}\) and \(J_{iu}\) satisfy the following conditions:
Then, the two optimal FTC obtained from Eqs. (12–14) are identical.
Theorem 1
For a leader-follower MAS, the dynamics equation of the leader with unknown control input is given by:
The dynamics equation of the follower affected by external environmental disturbances can be expressed as:
Meanwhile, the performance index functions (12), (13) and Eq. (14) are defined for the follower agent. Furthermore, Assumptions 1, 2, and 3 are all satisfied. For the given matrices \(R_{\textrm{iv}}(t)\) and \(W_{i}(t),R_{iu}(t)\) satisfies the equation \(R_{iu}(t)=W_{i}^{-1}(t)+C^{T}[R_{iv}(t)-(CW_{i}(t)C^{T})^{-1}]C\).Meanwhile, \(u_0\) and \(f(t,x_i)\) are both independent of the controller \(u_i\) . At this point, the optimal fault-tolerant consensus controller for the i -th follower is:
where \(\lambda _{i}^{*}\in R^{n}\) represents an auxiliary variable. Meanwhile, under the effect of this optimal consensus FTC, the consensus error of the leader-follower MAS can achieve asymptotic stability despite actuator PLOE and interruption faults. Proof: First, solve for the optimal consensus FTC \(u_{iv}^*(t)\) under actuator PLOE and interruption faults. According to the system dynamics model (18), the derivative of the consensus error for the i -th follower can be calculated as:
Here, we let matric \(f(t,x_i)=f(t,x_j)\), defined a Hamiltonian function as follows:
where \(\lambda\) is the co-state vector. Since \(u_{iu}^{*}\) are unconstrained, the minimum condition is that the Hamiltonian function (21) takes an unconditional minimum to the control input \(u_{iu}\) . Compute t the function’s derivative for the input:
Since
Therefore, let \(\frac{\partial H_{i}(t,e_{i},u_{iu},\lambda _{i})}{\partial u_{iu}}=0\),we obtain the following:
Equation (24) is the control that minimizes the Hamiltonian function (21), i.e., the optimal control. According to the canonical equation, we obtain:
Therefore, we obtain the optimal consensus controller in the absence of faults as:
We can obtain the optimal consensus controller according to Lemma 1 and the conclusions in36. At the same time, the leader has an unknown input, and the followers handle actuator PLOE, interruption faults, and external environmental disturbances. The controller is expressed as:
Next, we analyze whether the leader-follower system with unknown inputs and external disturbances can achieve consensus under the effect of equation (27) and examine the stability of the leader-follower MAS.
First, we perform the following transformation on the variables:
The Kronecker product form of equation (20) can be written as:
Built on the Lyapunov stability theory, we define the Lyapunov function for the error system represented by Eqs. (28) and (29) as follows:
where \(R_{\nu }(t)=diag(R_{1\nu }(t),R_{2\nu }(t),...,R_{N\nu }(t))\in R^{Nk\times Nk},R_{u}(t)=diag(R_{1u}(t),R_{2u}(t),...,R_{Nu}(t))\in R^{Nm\times Nm}\) represents the matrix composed of positive definite matrices in the function (13). The optimal controller can make the Hamiltonian function equal to 0.
Based on37, Eq. (32) can be rewritten as:
where \(V_{iu}(e_{iu}^{*}(t))>0\) and \(V_{iu}(0)=0\), Eq. (33) can be rewritten as:
By computing the time derivative of the Lyapunov function \(V_{iu}(e_{iu}^{*}(t))\) , we obtain:
Since the matrices Q and R are both positive definite, the following inequality can be obtained:
For the error system represented by Eq. (29) and the corresponding Lyapunov function in Eq. (31), its derivative can be expressed as:
\(V_{_u}(e_{_u}(t))>0\) is positive definite, and \(\dot{V}_u(e_u(t))<0\) . According to the Lyapunov stability theory, this error system can achieve asymptotic stability. From Eq. (12), the obtained virtual controller \(v_{i}\in R^{k}\) ensures that the leader-follower MAS achieves consensus without faults. The optimal consensus FTC \(u_{iv}^{*}(t)\) obtained through the control allocation algorithm enables the leader-follower MAS with actuator faults and complete the formation task effectively.
Next, we apply the control allocation algorithm to the leader-follower UAV-UGV system to obtain the optimal FTC law for UAVs and UGVs.
For each UAV, the control input is:
For each UGV, the control input is:
Simulations
This section designs experiments for the optimal FTFC of the HMAS presented in Chapter 3, verifying the feasibility of the FTFC algorithm through these experiments. This study considers an experimental setup with a heterogeneous MAS composed of 3 UAVs and 3 UGVs. The leader is UAV node 0, 1, 2, and 3 represent UAVs, while 4, 5, and 6 represent UGVs, and the communication relationships among follower agents are shown in Fig. 1.
Based on the communication topology in Fig. 1, we can obtain the corresponding Laplacian matrix and overall matrix as follows:
Suppose UAV2 and UGV2 do not experience any failures while the remaining agents undergo actuator faults to varying degrees, with the specific fault levels given by:
The UAV system’s initial states are presented in Table 1, while the UGV system’s initial states are given in Table 2, as shown below.
The experimental platform used in this section is Matlab 2017a, and the states of UAVs and UGVs are defined as \(\tilde{x}_{Ai}=\left( \delta _{ai}^{x},\delta _{ai}^{y},\delta _{ai}^{z},\nu _{ai}^{x},\nu _{ai}^{y},\nu _{ai}^{z},g\theta ,-g\phi ,\dot{\psi },g\dot{\theta },-g\dot{\phi },\ddot{\psi }\right) ^{T},\tilde{x}_{Gi}=\left( \delta _{gi}^{x},\delta _{gi}^{y},\nu _{gi}^{x},\nu _{gi}^{y}\right) ^{T},i=1,2,3\) in section “B. Optimal FTC derived from the control allocation algorithm”. The value of \(\varepsilon\) is set to 0.0001, \(Q=60^{*}I_{12},R_{,}=40^{*}I_{6},T=60^{*}I_{4},\gamma _{,}=40^{*}I_{4}\) , formation information is set to \(h_{a1}=[0,0,0]^T,h_{a2}=[-10,15,0]^T,h_{a3}=[0,30,0]^T;h_{g1}=[0,0]^T,h_{g2}=[-10,15]^T,h_{g3}=[0,30]^T\), the environmental disturbance is set to \(f(t,x_{i})=-0.33\sin x_{i}\) , and the correlation coefficient matrices of UAVs and UGVs are set as follows:
Based on the aforementioned formation equations of the leader-follower heterogeneous MAS, the topology Fig. 1, and the corresponding parameter matrix design, the following section conducts simulation experiments on three types of agent faults. It provides the corresponding simulation results and analysis.
A. Simulation results without control input
First, we conduct simulation experiments under the condition that the leader has no control input, with the actuator failures of the follower agents present from the beginning of the system operation. The total runtime of the experimental design is as described above, and the actuator failure coefficient matrix of the followers is as well.
Figures 2, 3, 4, 5, 6, 7, 8 and 9 show the simulation results of the optimal FTFC law. Figures 2 and 3 illustrate the state changes of the UAV and UGV heterogeneous MAS under the optimal fault-tolerant formation control protocol. From Figure 2, it can be observed that UAV’s position states and UGV’s position states eventually tend towards stable values. The position states of the X-axis achieve consensus at \(t=20s\) . The X-axis stabilizes at two values. Figure 3 shows that UAV’s position states and UGV’s position states approach stable values at \(t=20s\) . The Y-axis stabilizes at three values, forming a triangular formation.
From Fig. 4, we can see that the UAVs’ Z-axis position states converge at \(t=15s\). As a result of Figs. 2 and 3, the leader-follower heterogeneous MAS completes the formation task at \(t = 20s.\)
Figures 5 and 6 show the velocity states of UAVs and UGVs along the X and Y axes under external environmental disturbances using the control allocation algorithm. Figure 5 shows that the X-axis velocity state of the leader in the heterogeneous MAS stabilizes over \(t=20s\) under the condition of no input from the leader and external environmental disturbances. Figure 6 shows that the Y-axis velocity states of UAVs and UGVs converge to 0 m/s over \(t=20s\) , completing the formation task. The three UAVs and three UGVs converge to the same position. The Y-axis velocity error of the UAVs stabilizes at 0 m/s.
Figures 7 and 8 show the simulation results under the optimal FTFC protocol. Figure 7 shows the velocity state along the Z-axis of UAVs under the condition of actuator partial failure. From the figure, it is evident that the UAV’s velocity state of the Z-axis stabilizes at \(t=20s\). Figure 8 shows the UAV’s attitude angles and angular velocity states during the formation process with actuator failure. It can be observed that the attitude angle of the UAVs approaches zero rad at \(t=15s\) , and the pitch angle, yaw angle, and steering angle, along with their angular velocities, eventually approach 0 rad and 0 rad/s . That is, the UAVs ultimately reach stability.
Figure 8 shows the formation state of UAVs and UGVs in a three-dimensional coordinate system using the optimal FTFC. Figure 8 shows that the UAVs and UGVs system completes the formation at \(t=30s\), even under actuator failures and external disturbances. The three UAVs and three UGVs converge to the same corresponding position.
Figure 9 shows the positions of UAVs and UGVs at \(t=30s\) and \(t=45s\) are marked with circles and stars , respectively, and their corresponding positions are connected using line segments to visually display the dynamic relationship. Through comparative analysis, it can be concluded that both UAVs and UGVs successfully constructed triangular formations at the time points of \(t=30s\) and \(t=45s\), and the formation structure remained strictly consistent. Specifically, each UAV’s position formed a one-to-one mapping relationship with the UAV’s position, verifying the accuracy and synchronization of the formation control strategy. Further observation reveals that despite the passage of time, the two can still maintain a stable relative distance and angle during the movement process, fully demonstrating the robustness of the formation algorithm. This result not only confirms the collaborative feasibility of HMAS (UAVs and UGVs) in complex environments, but also provides important experimental support for MAS formation optimization and FTC.
B. Simulation results with control input from the leader
We provide the simulation results with the leader having control input. In this simulation, the experiment is designed with one leader and six follower HMAS, with a system runtime of 50 seconds. The actuator failures in the follower agents do not occur initially but appear during the simulation, with different actuator failure coefficient matrices applied at various time intervals.
At \(t\in (0,20]\), no actuator faults occur for all UAVs and UGVs, and the actuator failure coefficient matrix is:
At \(t\in [20,50]\), all UAVs and UGVs experience actuator failures, with the failure coefficient matrix being the same as in Experiment A. The leader’s control input is \(u_{0}=[0,0,1]^{T}\) ,let \(f(t,x_{i})=-10\sin x_{i}\) , the external interference of UAVs and UGVs is set to \([-10 sin(x_i), -10 sin(x_i), 0,0,0,0], [-10 sin(x_i), -10 sin(x_i), 0,0].\)
Figures 10, 11, 12, 13 and 14 show the simulation results with the leader having control input and external environmental disturbances. Figures 10 and 11 display the state changes of the UAVs and UGVs heterogeneous MAS under the optimal FTFC. From Figure 10 , it can be observed that the UAV and UGV position states eventually converge to a stable value. The X-axis position state reaches consensus at \(t=20s\). The X-axis stabilizes at two values. Figure 11 shows that the UAV and UGV position states stabilize at \(t=20s\) . The Y-axis stabilizes at three values, completing the triangular formation.
Figure 11 portrays the formation trajectory of UAVs and UGVs in three-dimensional space using the optimal FTFC protocol. From the figure, that can be observed the UAVs and UGVs converge to the desired positions and achieve a triangular formation under conditions of partial actuator failure. Three UAVs and three UGVs converge to the corresponding identical positions, with the UAVs ultimately stabilizing at a height of 80 m.
From Fig. 12, it is clear that the UAV’s Z-axis position state converges at \(t=15s\). Figures 10 and 11 show that the leader-following heterogeneous MAS completes the formation task at \(t=20s\) .
Figure 13 shows the UAV’s attitude angles and angular velocity states during the formation process with actuator failure. One can observe that the UAVs’ attitude angle approaches zero rad at \(t=15s\). After the faults occur at \(t=20s\) , the angle states and angular velocities converge to 0 rad and 0 rad/s , meaning the UAVs eventually reach stability.
Figure 14 shows the positions of UAVs and UGVs at \(t = 30s\) and \(t =45s\) are marked with circles and stars , respectively, and their corresponding positions are connected using line segments to visually display the dynamic relationship. Under the coupling effect of unknown input from the leader and external environmental interference from followers, the drone and unmanned vehicle successfully achieved a triangular formation, and the formation strictly remained consistent. Despite the local shaking of the drone trajectory caused by environmental interference, based on the optimal FTFC under the control allocation algorithm, all agents converge to the preset position within a finite time. This result indicates that the proposed FTC strategy can effectively coordinate the collaborative motion of heterogeneous agents in dynamic disturbance environments, providing a solution that combines accuracy and FTC for MAS formation control in complex scenarios.
Conclusions
This paper investigates the FTFC problem for a heterogeneous MAS composed of quadrotor UAVs and Mecanum wheeled UGVs under actuator faults. Firstly, a control system model for UAVs and UGVs with actuator faults is established, utilizing the Kronecker product to incorporate UAVs and UGVs of differing dimensions into the state equations, thereby forming a heterogeneous system, solving the formation problem caused by the mismatch in state-space dimensions of UAVs and UGVs. We defined performance indices for each UAV and UGV, considering the leader’s unknown inputs, external disturbances, and actuator faults. Using optimal control theory, we obtained the optimal fault-tolerant controllers. By combining control allocation with optimal control, we designed the optimal FTFC for HMAS, proving its effectiveness in addressing actuator PLOE and interruptions faults. Finally, simulation experiments validate the designed optimal FTC’s effectiveness. In subsequent research, we will concentrate on the FTCC under conditions of unknown actuator faults, fixed time, and switching topologies, ensuring the system possesses both strong robustness and rapid responsiveness.
Data availability
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Yan, B., Shi, P. & Lim, C.-C. Robust formation control for nonlinear heterogeneous multiagent systems based on adaptive event-triggered strategy. IEEE Trans. Autom. Sci. Eng. 19, 2788–2800. https://doi.org/10.1109/TASE.2021.3103877 (2022).
Zhang, W., Dong, C., Ran, M. & Liu, Y. Fully distributed time-varying formation tracking control for multiple quadrotor vehicles via finite-time convergent extended state observer. Chin. J. Aeronaut. 33, 2907–2920. https://doi.org/10.1016/j.cja.2020.03.004 (2020).
Li, Z., Song, Y. & Wen, G. Reinforcement learning based optimized sliding-mode consensus control of high-order nonlinear canonical dynamic multiagent system. IEEE Syst. J. 17, 6302–6311. https://doi.org/10.1109/JSYST.2023.3280192 (2023).
Quan, L., Yin, L., Xu, C. & Gao, F. Distributed swarm trajectory optimization for formation flight in dense environments. In 2022 International Conference on Robotics and Automation (ICRA) 4979–4985 (2022). https://doi.org/10.1109/ICRA46639.2022.9812050.
Zhao, Y., Duan, Q., Wen, G., Zhang, D. & Wang, B. Time-varying formation for general linear multiagent systems over directed topologies: a fully distributed adaptive technique. IEEE Trans. Syst. Man Cybern. Syst. 51, 532–541. https://doi.org/10.1109/TSMC.2018.2877818 (2021).
Li, D., Ge, S. S., He, W., Li, C. & Ma, G. Distributed formation control of multiple euler lagrange systems: a multilayer framework. IEEE Trans. Cybern. 52, 3325–3332. https://doi.org/10.1109/TCYB.2020.3022535 (2022).
Wang, R., Dong, X., Li, Q. & Ren, Z. Distributed time-varying formation control for multiagent systems with directed topology using an adaptive output-feedback approach. IEEE Trans. Ind. Inf. 15, 4676–4685. https://doi.org/10.1109/TII.2019.2891714 (2019).
Hua, Y., Dong, X., Hu, G., Li, Q. & Ren, Z. Distributed time-varying output formation tracking for heterogeneous linear multiagent systems with a nonautonomous leader of unknown input. IEEE Trans. Autom. Control 64, 4292–4299. https://doi.org/10.1109/TAC.2019.2893978 (2019).
Jiang, P., Zhang, W., Yan, C. & Hu, Z. Fully distributed event-triggered bipartite output formation control for heterogeneous mass with directed graphs. IEEE Trans. Circ. Syst. II: Express Briefs 70, 2072–2076. https://doi.org/10.1109/TCSII.2022.3233370 (2023).
Hu, J., Niu, H., Carrasco, J., Lennox, B. & Arvin, F. Fault-tolerant cooperative navigation of networked uav swarms for forest fire monitoring. Aerospace Sci. Technol. 123, 107494. https://doi.org/10.1016/j.ast.2022.107494 (2022).
Zhang, L., Gao, F., Deng, F., Xi, L. & Chen, J. Distributed estimation of a layered architecture for collaborative air ground target geolocation in outdoor environments. IEEE Trans. Ind. Electron. 70, 2822–2832. https://doi.org/10.1109/TIE.2022.3165245 (2023).
Li, J., Zhang, G., Zhang, X. & Zhang, W. Integrating dynamic event-triggered and sensor-tolerant control: application to usv-uavs cooperative formation system for maritime parallel search. IEEE Trans. Intell. Transport. Syst. 25, 3986–3998. https://doi.org/10.1109/TITS.2023.3326271 (2024).
Fenglan Sun, H. L., Peiyong Liu & Zhu, W. Fixed-time consensus of heterogeneous multi-agent systems based on distributed observer. Int. J. Syst. Sci. 52, 1780–1789. https://doi.org/10.1080/00207721.2020.1871105 (2021).
Zhou, S., Dong, X., Li, Q. & Zhang, R. Time-varying formation control and disturbance rejection for uav-ugv heterogeneous swarm system. Acta Aeronaut. Astronaut. Sin. 41, 12. https://doi.org/10.3873/j.issn.1000-6893.2020.01.002 (2020).
Tian, L., Zhao, Q., Dong, X., Li, Q. & Ren, Z. Time-varying output group formation tracking for heterogeneous multi-agent systems. Acta Aeronaut. Astronaut. Sin. 41, 323727. https://doi.org/10.7527/S1000-6893.2019.23727 (2020).
Zhou, S., Dong, X., Li, Q. & Ren, Z. Air-ground time varying formation tracking control for heterogeneous uav-ugv swarm system. Aero Weaponry 26, 54. https://doi.org/10.12132/ISSN.1673-5048.2019.0149 (2019).
Zhang, J., Yue, X., Zhang, H. & Xiao, T. Optimal unmanned ground vehicle unmanned aerial vehicle formation-maintenance control for air-ground cooperation. Appl. Sci. 12, 1456. https://doi.org/10.3390/app12073598 (2022).
Xiong, H., Deng, H., Liu, C. & Wu, J. Distributed event-triggered formation control of ugv-uav heterogeneous multi-agent systems for ground-air cooperation. Chin. J. Aeronaut. https://doi.org/10.1016/j.cja.2024.05.035 (2024).
Zhou, S., Dong, X., Li, Q. & Ren, Z. Time-varying formation tracking control for uav-ugv heterogeneous swarm systems with switching directed topologies. In 2020 IEEE 16th International Conference on Control & Automation (ICCA) 1068–1073 (2020). https://doi.org/10.1109/ICCA51439.2020.9264359.
Yang, Z. et al. Fault detection and fault-tolerant cooperative control of multi-uavs under actuator faults, sensor faults, and wind disturbances. Drones 7, 1456. https://doi.org/10.3390/drones7080503 (2023).
Liu, Z., Yuan, C., Yu, X. & Zhang, Y. Fault-tolerant formation control of unmanned aerial vehicles in the presence of actuator faults and obstacles. Unmanned Syst. 04, 197–211. https://doi.org/10.1142/S2301385016500060 (2016).
Zou, Y., Xia, K. & He, W. Adaptive fault-tolerant distributed formation control of clustered vertical takeoff and landing uavs. IEEE Trans. Aerospace Electron. Syst. 58, 1069–1082. https://doi.org/10.1109/TAES.2021.3117368 (2022).
Lv, M., Li, Y., Wan, L., Dai, J. & Chang, J. Fast nonsingular fixed-time fuzzy fault-tolerant control for hfvs with guaranteed time-varying flight state constraints. IEEE Trans. Fuzzy Syst. 30, 4555–4567. https://doi.org/10.1109/TFUZZ.2022.3157393 (2022).
Cui, B., Mao, L., Xia, Y., Ma, T. & Gao, H. Fixed-time fault-tolerant consensus control for high-order nonlinear multiagent systems under directed topology. IEEE Trans. Control Netw. Syst. 11, 197–209. https://doi.org/10.1109/TCNS.2023.3274700 (2024).
Chai, R. et al. Review of advanced guidance and control algorithms for space/aerospace vehicles. Progress Aerospace Sci. 122, 100696. https://doi.org/10.1016/j.paerosci.2021.100696 (2021).
Shen, Q., Yue, C., Goh, C. H. & Wang, D. Active fault-tolerant control system design for spacecraft attitude maneuvers with actuator saturation and faults. IEEE Trans. Ind. Electron. 66, 3763–3772. https://doi.org/10.1109/TIE.2018.2854602 (2019).
Shi, Y., Hu, Q., Li, D. & Lv, M. Adaptive optimal tracking control for spacecraft formation flying with event-triggered input. IEEE Trans. Ind. Inf. 19, 6418–6428. https://doi.org/10.1109/TII.2022.3181067 (2023).
Ma, Y., Jiang, B., Wang, J. & Gong, J. Adaptive fault-tolerant formation control for heterogeneous uavs-ugvs systems with multiple actuator faults. IEEE Trans. Aerospace Electron. Syst. 59, 6705–6716. https://doi.org/10.1109/TAES.2023.3277424 (2023).
Cheng, W., Jiang, B., Zhang, K. & Ding, S. X. Robust finite-time cooperative formation control of ugv-uav with model uncertainties and actuator faults. J. Franklin Inst. 358, 8811–8837. https://doi.org/10.1016/j.jfranklin.2021.08.038 (2021).
Liu, Z., Wang, X., Wang, F. & Chen, Z. Fault-tolerant consensus control with control allocation in a leader-following multi-agent system. J. Franklin Inst. 357, 9614–9632. https://doi.org/10.1016/j.jfranklin.2020.07.029 (2020).
Cheng, W., Zhang, K. & Jiang, B. Hierarchical structure-based fixed-time optimal fault-tolerant time-varying output formation control for heterogeneous multiagent systems. IEEE Trans. Syst. Man Cybern. Syst. 53, 4856–4866. https://doi.org/10.1109/TSMC.2023.3257426 (2023).
Zhao, J., Dai, F. & Song, Y. Consensus of heterogeneous mixed-order multi-agent systems including ugv and uav. In Proceedings of 2021 Chinese Intelligent Systems Conference (eds. Jia, Y. et al.) 202–210 (Springer, 2022).
Lai, L. C., Yang, C. C. & Wu, C. J. Time-optimal control of a hovering quad-rotor helicopter. J. Intell. Robot. Syst. 45, 115–135. https://doi.org/10.1007/s10846-005-9015-3 (2006).
Zou, W., Zhou, C. & Xiang, Z. Sampled-data leader-following consensus of nonlinear multi-agent systems subject to impulsive perturbations. Commun. Nonlinear Sci. Numer. Simul. 78, 104884. https://doi.org/10.1016/j.cnsns.2019.104884 (2019).
Ye, D., Zhao, X. & Cao, B. Distributed adaptive fault-tolerant consensus tracking of multi-agent systems against time-varying actuator faults. IET Control Theory Appl. 10, 554–563 (2016).
Härkegård, O. & Glad, S. T. Resolving actuator redundancy optimal control vs. control allocation. Automatica 41, 137–144 (2005).
Vamvoudakis, K. G., Lewis, F. L. & Hudas, G. R. Multi-agent differential graphical games: online adaptive learning solution for synchronization with optimality. Automatica 48, 1598–1611. https://doi.org/10.1016/j.automatica.2012.05.074 (2012).
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grant 62473278; and in part by the Scientific Research Project of Heilongjiang Provincial Universities, China under Grant 145409322.
Author information
Authors and Affiliations
Contributions
Conceptualization, Y.L; methodology, Y.L. and Y.L.; validation, Y.L. and L.Z.; formal analysis, Y.L. and L.Z.; writing-original draft preparation, Y.L.; writing-review and editing, Y.L. and Y.L.; supervision, Y.L., L.Z. and Y.G.; project administration, Y.G.; software Y.L. and L.Z.; funding acquisition, Y.L. and Y.G.. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
Li, Y., Liu, Y., Zhu, L. et al. Fault-tolerant formation control of heterogeneous multi-agent systems with unknown inputs and external disturbances. Sci Rep 15, 20773 (2025). https://doi.org/10.1038/s41598-025-07625-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-025-07625-y