Multi-UAV Continuum Deformation Flight Optimization in Cluttered Urban Environments

Multi-agent coordination has been widely studied over the past two decades. Formation flight offers several advantages such as failure resilience [1] and reduced mission cost [2]. Multi-agent coordination applications include but are not limited to surveillance [3], air traffic management [4], formation flight [5], and connected vehicle control [6].

Extensive previous work has been undertaken for multi-agent coordination with application to ground and air vehicles. Virtual structure, consensus, containment control, and continuum deformation offer agent coordination in a $3D$ motion space. Virtual structure formulations coordinate agents in a centralized fashion. In a virtual structure, each agent’s desired position consists of a reference position vector and a relative displacement vector with respect to the reference [7]. If the agents’ relative distances from a reference position remain constant, the multi-agent system can be treated as a rigid body [8]. A flexible virtual structure formulation is also studied in [9]. Consensus [10, 11, 12], containment [13, 14], and continuum deformation [15, 16, 17, 18, 19] are decentralized multi-agent coordination approaches. Consensus is perhaps the most common approach for formation and cooperative control. Both leaderless [10] and leader-based [12] consensus approaches have been proposed. Consensus under switching communication topologies is studied in Refs. [20, 21, 22], while stability of consensus coordination is analyzed in Refs. [23, 24].

With containment control, leaders move independently and guide motions of the agent team. Followers communicate with select in-neighbor agents to acquire coordination through local communication [13, 14]. Containment control is studied in Refs. [25] and [26]. Retarded containment control stability is analyzed in Ref. [27]. Finite-time [28] and heterogeneous agent [29] containment control formulations have also been developed.

Under continuum deformation, inter-agent distances can change significantly while inter-agent collision is avoided [30, 31]. Coordination is formulated as a decentralized leader-follower formation control problem in Ref. [17]. Ref. [17] formulates an $n$-dimensional ($n=1,2,3$) homogeneous transformation based on the trajectories of $n+1$ leaders forming an $n$-dimensional polytope in a $3D$ motion space, while Ref. [17] shows how follower agents can acquire desired trajectories through local communication. Decentralized continuum deformation coordination using an area preservation and alignment strategy is demonstrated in [16] and [19], while Ref. [15] investigates the stability of continuum deformation coordination with communication delay. Sufficient conditions for safe continuum deformation coordination and inter-agent collision avoidance are developed in Refs. [15, 16]. Ref. [18] formulates continuum deformation coordination under switching communication topologies.

Robot motion planning has been widely studied in the literature. A* [32] and dynamic programming [33] support globally-optimal planning over a discrete grid or predefined waypoint set. Rapidly-expanding Random Trees (RRT) [34] and reachability graphs [35] are available graph-based methods for real-time motion planning. In Ref. [36] Gaussian process (GP) and RRT are applied build real-time motion plans. Model predictive control (MPC) [37] is a well-known approach for real-time optimization as well as real-time path planning in an obstacle laden environment [38].

This paper advances the authors’ previous continuum deformation contributions for single/double integrator agents to safe continuum deformation optimization of UAVs with nonlinear dynamics. We consider coordination of a UAV team forming a triangle in a $2D$ motion plane, called a leading triangle. UAV coordination is guided by three leaders at the vertices of the leading triangle and acquired by followers through direct communication with leaders. Compared to previous work, we offer a novel contribution on continuum deformation optimization of a UAV team over a populated and geometrically-constrained environment by incorporating obstacle (no-fly-zone) and population risk metrics to the formulation. While inter-agent and obstacle collision avoidance are guaranteed, UAV coordination is optimized by minimizing travel distance and time of flight over populated areas.

This paper is organized as follows. Theoretical background in Section 2 is followed by a review of multi-quadcopter system (MQS) continuum deformation in Section 3. MQS continuum deformation optimization is mathematically defined in Section 4. The path planning optimization strategy in Section 5 is followed by MQS evolution analysis in Section 6. UAV dynamics and control are modeled in Sections 7 and 8, respectively. Simulation results in Section 9 are followed by concluding remarks in Section 10.

Consider a group of $N$ UAVs moving in a $2D$ motion space. UAVs are identified by index numbers $1$ through $N$ defined by the set $\mathcal{V}$, e.g. $\mathcal{V}=\{1,\cdots,N\}$. UAVs are enclosed by a triangular domain, called leading triangle. MQS collective dynamics is guided by three leaders with identification numbers $1$, $2$, and $3$ defined by set $\mathcal{V}_{L}$, e.g. $\mathcal{V}_{L}=\{1,2,3\}$. The remaining UAVs inside the leading triangle are followers. Follower UAVs’ index numbers are defined by the set $\mathcal{V}_{F}=\mathcal{V}\setminus\mathcal{V}_{L}$. Global desired position of UAV $i\in\mathcal{V}$ is defined by a homogeneous transformation

where $Q\in\mathbb{R}^{3\times 3}$ is the continuum deformation Jacobian matrix and $\mathbf{D}(t)$ is a rigid-body displacement vector. Because this paper studies $2D$ continuum deformation in the $X-Y$ plane,

Because the $z$ component of $\mathbf{D}$ is $0$, ${z}_{i,HT}\left(t\right)={Z}_{i,0}$ ($\forall i\in\mathcal{V},\forall t$). This paper assumes that the $z$ components of the agents’ global desired positions are the same:

Leaders form a triangle at all times $t\geq t_{0}$, therefore,

Because the rank condition (9) is satisfied at initial time $t_{0}$, elements of $Q_{\mathrm{CD}}$, $D_{1}$ and $D_{2}$ are uniquely related to leaders’ global desired positions components:

Using polar decomposition, $Q_{\mathrm{CD}}$ can be expressed as

where $U_{\mathrm{CD}}$ is a positive definite (and symmetric) matrix and $R_{\mathrm{CD}}$ is an orthogonal matrix, e.g $\mathcal{R}_{\mathrm{CD}}^{T}\mathcal{R}_{\mathrm{CD}}=I_{2}$. Eigenvalues of the matrix $U_{\mathrm{CD}}$ are positive and real and denoted by $\lambda_{1}$ and $\lambda_{2}$ ($0<\lambda_{1}\leq\lambda_{2}$).

Key Property of a Homogeneous Deformation: Let leaders form a triangle at all times $t$. Therefore,

Under a homogeneous deformation, $X$ and $Y$ components of the global desired position of UAV $i\in\mathcal{V}$ can be expressed as [15]

where $\alpha_{i,1}$, $\alpha_{i,2}$, are $\alpha_{i,3}$ time-invariant parameters and

Parameters $\alpha_{i,1}$, $\alpha_{i,2}$, and $\alpha_{i,3}$ are computed from the initial position of UAV $i$ and the three leaders as follows [15]:

Consider a team of $N$ UAVs inside the leading triangle. Three leader UAVs, located at the vertices of the leading triangle, define the geometry of a triangle enclosing the follower UAVs. The paper makes the following assumptions:

1. 1.

   Initial and target configurations of the leading triangle are known.

2. 2.

   The leading triangle must significantly deform to reach the target configuration.

3. 3.

   All UAVs have the same size and each UAV can be enclosed by a ball with radius $\epsilon>0$.

The objective is to minimize total UAV travel distance given initial and target configurations of the leading triangle such that risks to the overflown population and of collision are minimized. It is also desired that the team avoid flying over any "No-Fly-Zones" in the motion space. Let $\mathbf{r}=x\hat{\mathbf{e}}_{1}+y\hat{\mathbf{e}}_{2}\in\mathbf{R}^{2}$ and let $t$ denote time. Then, $\mathcal{MO}=\mathcal{MO}\left(\mathbf{r}\right)\subset\mathbb{R}^{2}$ defines the motion space set and $\Omega_{NFZ}(\mathbf{r)}\subset\mathcal{MO}$ defines the "No-Fly-Zone" in the motion space set.

We define the following legends:

The above constrained optimization problem can be mathematically defined as follows:

subject to rank condition (9) and the following two conditions:

Note that $\zeta_{s,i}>0$ and $\zeta_{h,i}>0$ are constant scaling parameters and $\mathrm{Pr}\left(\mathrm{Human}|\mathbf{r}_{i},t\right)$ assigns likelihood of human presence on the navigable zone $\Omega_{NAV}$. Human presence probability, or population density, is treated as an optimization cost in this work. Furthermore,

is the path length of the UAV $i\in\mathcal{V}$. Also, $S_{F,i}$ is the length of UAV $i$’s path connecting $\mathbf{R}_{i,0}$ and $\mathbf{R}_{i,F}$. Satisfaction of Eq. (9) ensures that leaders form a convex hull at all times $t$. This is in fact a requirement for MUS evolution as continuum deformation. The constraint Eq. (16a) ensures that no two UAVs approach closer than $2\epsilon$ in a continuum deformation coordination. Notice that inter-agent collision avoidance can be guaranteed if both conditions (9) and (16a) are satisfied. In addition, condition (16b) ensures that the "No-Fly-Zone" is never entered by any UAV in the continuum deformation.

Assuming UAV $i\in\mathcal{V}$ moves on a straight path over $t\in[t_{k-1},t_{k}]$, we apply A* search to find the optimal path connecting initial and target positions of UAV $i\in\mathcal{V}$.

Suppose $\bar{\mathbf{T}}_{c}=(\mathbf{P}_{1,c},\mathbf{P}_{2,c},\mathbf{P}_{3,c})$ defines the desired configuration of the leading triangle in the $X-Y$ plane at the current time, where

is the position of leader $l\in\mathcal{V}_{L}$ expressed with respect to the ground coordinate system. The next desired configuration of the leading triangle is denoted by $\bar{\mathbf{T}}_{n}=(\mathbf{P}_{1,n},\mathbf{P}_{2,n},\mathbf{P}_{3,n})$, where

Leaders’ waypoints are obtained by uniform discretization of the $X-Y$ plane, where

and

The paper assumes initial and target configurations of the leading triangle are given. In addition, $\bar{\mathbf{T}}_{g}=(\mathbf{P}_{1,g},\mathbf{P}_{2,g},\mathbf{P}_{3,g})$ and $\bar{\mathbf{T}}_{0}=(\mathbf{P}_{1,0},\mathbf{P}_{2,0},\mathbf{P}_{3,0})$ are the goal and initial configurations of the leading triangle $j\in\Omega_{CL}$, where

Assuming leaders move on a straight path, the path of leader $l\in\mathcal{V}_{L}$ is defined by

where MQS elevation $z_{HT}$ is constant, $l\in\mathcal{V}_{L}^{j},~j\in\Omega_{CL}$, and $\beta\in[0,1]$.

Proof: See the proof in [16].

Corollary: If the constraint Eq. (24) is met, then, we can guarantee that no two UAVs collide (i.e., Eq. (16a) is satisfied).

Definition (Valid Continuum Deformation): A leading triangle configuration $\bar{\mathbf{T}}_{n}$ is called a valid deformation, if

1. 1.

   $\mathbf{P}_{l,n}$ is defined by Eqs. (18) and (19) and

2. 2.

   Constraint Eqs. (9), (16a), and (16b) are all satisfied.

Dynamics of UAV $i\in\mathcal{V}_{F}$ is given by

Note that $\phi_{i}$, $\theta_{i}$, and $\psi_{i}$ are UAV $i$’s Euler angles, $m_{i}$ is mass, thrust force $F_{T,i}$$g=9.81{m\over{s^{2}}}$ is the gravity, $\bar{F}_{T,i}={F_{T,i}\over m_{i}}$ is thrust force per mass $m_{i}$, and $\hat{\mathbf{k}}_{b,i}$ is the unit vector assigning direction of the thrust force $\bar{F}_{T,i}$.

Dynamics (33) can be rewritten in the following form:

where

is the control state, $\mathbf{r}_{i}$ is the control output, and $\mathbf{V}_{i}=[u_{T,i}~u_{\phi,i}~u_{\theta,i}]$ is the control input vector.

Yaw Control: In this paper, $\ddot{\psi}_{i}=u_{\psi,i}$ is chosen as follows:

where $k_{\psi_{i}}>0$ and $k_{\dot{\psi}_{i}}>0$ are constant. It is assumed that $\psi_{d,i}$, $\dot{\psi}_{d,i}$, and $\ddot{\psi}_{d,i}$ are known. Therefore, $\psi_{i}$ is updated as follows:

In this section, we simulate continuum deformation of an MQS in a complex environment. We consider two cases. In the first case-study, MQS continuum deformation is planned given human presence probability distribution over the motion field. In the second case study, MQS continnum deformation is optimized given deterministic motion of a human.

This paper studies the problem of continuum deformation optimization of a UAV team flying over a populated and geometrically constrained area. Continuum deformation is planned so that safety requirements associated with collision avoidance are satisfied and optimization cost metrics are minimized. The paper defines cost as the weighted sum of leaders’ travel distances and likelihood of human presence under the flight region. The UAV optimization strategy proposed in this paper can be applied in a variety of missions given extensions to assure resilience given system failures. Such regions will likely contain "No-Fly-Zones", and it will be advantageous to minimize time of flight over people.