Abstract
This paper is devoted to the control of aerial robots interacting physically with objects in the environment and with other aerial robots. The paper presents a controller for the particular case of a small-scaled autonomous helicopter equipped with a robotic arm for aerial manipulation. Two types of influences are imposed on the helicopter from a manipulator: coherent and non-coherent influence. In the former case, the forces and torques imposed on the helicopter by the manipulator change with frequencies close to those of the helicopter movement. The paper shows that even small interaction forces imposed on the fuselage periodically in proper phase could yield to low frequency instabilities and oscillations, so-called phase circles.
Keywords
1. Introduction
Aerial manipulators are a particular class of Unmanned Aerial Systems (UAS) physically interacting with the environment. Other classes include aerial slung load transportation and deployment as in Bernard et al. (2011), perching for refuelling and battery recharging remote inspection by contact as in the European AIRobot (http://www.airobots.eu/) project and the cleaning of windows or walls by applying forces while maintaining flight stability that can be found for example in Albers et al. (2010).
Free flying robots with some manipulation capabilities have been proposed for space applications since the 1980s. These applications include inspection, assembly, capture, repair and maintenance capabilities in orbit. Unlike fixed-based robots, the base body of free flying robots is allowed to respond freely to dynamic reaction forces due to the motion of the arm or arms. In these systems there is a dynamic coupling between the motion of the arm (or arms) and the base. Also the joint control torques are limited due to actuator weight constraints in space.
The kinematics and dynamics of free-floating space manipulator systems were described 25 years ago using the virtual manipulator approach in Vafa & Dubowsky (1987; 1990). In Umetani & Yoshida (1987), a generalized Jacobian matrix that reflects both momentum conservation laws and kinematic relations is used to study rigid space manipulators with revolute joints by assuming that no external forces are applied. This generalized Jacobian converges to the conventional Jacobian of the manipulator when the base is relatively massive. In Caccavale & Siciliano (2001), the generalized Jacobian is used to study the inverse kinematics. In Moosavian & Papadopoulos (1998), approaches for the kinematics modelling of a multibody space robotic system are presented. In Moosavian & Papadopoulos (2007), a review of dynamic modeling, planning and control problems for free flying robots in space is presented.
Recently, several researchers have been proposing unmanned aerial systems with grasping capabilities. In Pounds & Dollar (2010), a small RC helicopter with a gripper is able to grasp an object on the ground while in flight by means of a underactuated compliant gripper mounted ventrally between the aircraft's skids. In Pounds et al. (2011), the stability of the helicopter in contact with the object and/or the ground is studied. In particular, the longitudinal dynamics is studied and the payload effect is modelled by means of a pitch moment.
In Mellinger et al. (2010), grasping and cooperative transporting loads with quadrotors is presented. Furthermore, in Mellinger et al. (2011), several lightweight, low-complexity grippers that allow quadrotors to grasp and perch on branches or beams and pick up and transport payloads are presented. The inertial parameters of the grasped object are estimated and used to adapt the controller and improve performance during flight.
Reference Lindsey et al. (2011) presents structure construction experiments by means of indoor quadrotors with grippers.
In Korpela et al. (2012), a hybrid quadrotor-blimp prototype to test some aerial manipulation concepts is presented. In Orsag et al. (2012), the challenges in controlling a mobile manipulating UAV using a commercially available aircraft with three light-weight arms each with two degrees of freedom (DoF) is investigated.
Section 2 introduces general concepts related to aerial manipulation in the context of the European FP7 project ARCAS. The particular case of an autonomous helicopter equipped with a hand that can be used for general manipulation tasks is presented. Section 3 discusses control systems for aerial manipulation. In Section 4 the closed-loop behaviour is analysed and some simulations are presented. Section 5 closes the paper with the conclusions.
2. Aerial manipulation – the ARCAS project
In a broad sense, aerial manipulation involves a large number of functionalities from taking sole probes and picking up objects, to performing assembly operations involving force interactions with the objects.
The limitation in payloads and in general of take-off weight is a main concern and implies manipulators with reduced working space or even with less than six degrees of freedom (DoF). Therefore, it is desirable to increase the helicopter positioning precision in order to facilitate the manipulation task or even to realize some DoF of Tool Centre Point (TCP) of the manipulator by moving the helicopter fuselage.
Figure 1 shows an aerial manipulator system comprising a helicopter and a manipulator mounted on the fuselage. The task of this system is to fly close enough to the object to perform a manipulation task. The helicopter is equipped with a position sensor (e.g., GPS) and an orientation sensor (e.g., IMU) for estimation of the fuselage position and orientation in an inertial frame. The on-board perception system can be used for precise positioning and to track the position and orientation of the object with respect to the TCP.

Scheme of the system for aerial manipulation based on an autonomous helicopter.
As mentioned above, one of the main limitations in aerial manipulation is the payload of the Unmanned Aerial Vehicle (UAV). In order to overcome this limitation, the ARCAS project aims at the development and experimental validation of the first cooperative flying robot system for assembly and structure construction. In addition to the payload limitation, the adoption of several unmanned aerial aircraft instead of a single powerful one presents advantages such as enhanced manipulation capabilities, increased reliability and reduced costs.
In ARCAS both helicopters and quadrotor systems with arms, manipulation and perception devices are being developed.
Figure 2 shows the first helicopter-based set-up for experimenting on precision positioning helicopter control. This set-up is composed of an electrical helicopter with the take-off weight of 15 kg and the rotor diameter of 2 m. The helicopter is equipped with a mechanical hand mounted on a cardan joint that compensates the roll and pitch angles of the fuselage. The cardan joint will be replaced by a manipulator with five DoF.

Experimental set-up for precision control with integrated vision system.
A perception system has been integrated on the helicopter for precise positioning, tracking and guidance of the assembly operations. Alternatively, in ARCAS, the environment perception system can be carried out by other UAS by implementing cooperative perception systems. The integration of the information from multiple aerial robots will also be used in range-only Simultaneous Localization and Mapping (SLAM) techniques.
ARCAS also includes the development of coordinated control of multiple cooperating aerial systems grasping the same object and cooperative planning for assembly, disassembly or inspection tasks by maintaining the safety in the simultaneous operation of multiple flying robots. The ARCAS architecture will integrate autonomous perception, planning and control with the intervention of human operators by using virtual reality haptics.
ARCAS experiments with autonomous helicopters as shown in Fig. 2 are being performed in an outdoor scenario in order to demonstrate advanced manipulation and assembly capabilities with integrated force/torque sensors. Moreover, indoor experiments are being performed with autonomous quadrotors and the VICON system for positioning to test basic manipulation and assembly functions with simple and light devices satisfying the payload constraints of the indoor quadrotors.
ARCAS is also targeting industrial inspection, maintenance and repair scenarios, as well as space applications with free-flying robots.
3. Control systems
Figure 3 shows a basic control scheme composed of an inner loop for orientation control, R

Control scheme used for experimental set-up.
Using this set-up in the flight experiments it was possible to validate that the grasping of a simple object is even possible without translational movement of TCP relative to the helicopter fuselage.
The autonomous manipulation can be decomposed in the following phases:
Approaching phase. The helicopter is guided to some position not far from the object. The control system uses the GPS, eventually with the differential corrections (DGPS). If the position of the object is not known, the perception system on board the aerial robot (see Fig. 3) should be able to detect and localize the object. In the ARCAS project, radio systems with a transmitter embedded in the object are also being used.
Precise positioning control. In this case the perception system can be used to calculate the position and orientation of the object, and grasping configurations. The output of the vision system was used only to calculate the appropriate desired position of the helicopter (see Fig. 3). The lack of reliability of the perception system in outdoor scenarios should be analysed. In particular, it is well-known that vision systems are significantly affected by environmental problems such as occlusions and variability of lighting conditions. If the pose of the object is known, sensor data fusion with DGPS is very valuable. With ideal weather conditions, we could achieve a precision of TCP positioning up to 1 cm.
Manipulation control. This phase refers to the control of the helicopter and manipulator in the last phase. This can be realized using one of the following approaches or their combinations:
a) Completely decoupled control. The helicopter and the manipulator are controlled independently. Usually, the helicopter will try to maintain a hovering position trying to compensate the disturbances from the manipulator; the manipulator
will try to keep the TCP on the object compensating the disturbances caused by the helicopter movement around the hovering position.
b) Coupling on the kinematical level. The controller for helicopter and manipulator are coupled by the positions and velocities of both subsystems.
c) Coupling on the dynamical level. The overall controller for both subsystems considers the dynamical model of the whole system. This is the most general case and potentially will provide the best possible performance from the theoretical point of view. However, the practical considerations make this general conclusion not obvious. For instance, the quality of the sensor signals, often, does not allow precise state estimation of the coupled system. In addition, the dynamical model of the coupled system is complicated and the model-based controller will usually be sensitive to system parameters, non-modelled effects and disturbances.
When the masses of the helicopter are significantly greater than the mass of the manipulator, the dynamical coupling cannot improve the performance of the whole system significantly and it might be preferable to adopt approaches (a) and (b) for control. However, if the mass of the arm is relatively significant, then the approach (c) to control the force interaction is preferable.
Regardless of which control approach and which system set-up is chosen, the following aspects should be investigated in order to design a particular control scheme and to estimate the achievable control performance:
precision control of the helicopter
force interaction between helicopter and environment
movement of the centre of gravity (CoG) due to the manipulator movement
The understanding of the above listed aspects constitutes a base for further development of approaches and technologies for aerial manipulation.
4. Closed-loop behaviour
A manipulator or other grasping device imposes forces and torques on the helicopter fuselage which influence the helicopter motion. This is illustrated in Fig. 4. The description and analysis of the interaction between helicopter and manipulator is complicated. The translational movement of the helicopter generates the interaction forces between manipulator and the fuselage. These forces change the orientation of the fuselage and the main rotor plane which again results in changes of the translational movement. Please note that the dynamical equations for translation and orientation of the helicopter without manipulator are coupled only in one direction. This means that the equations for the rotation are independent from translational movement, e.g., see Eqs. (1). The translation depends, of course, on the orientation of the main rotor plane. For the system composed of a helicopter with a manipulator, there is coupling between translational and rotational dynamics in both directions. The equations of the rotational dynamic depend on the translational movement. This fact makes the analysis of the system and, therefore, the model-based controller design, complicated.

Force torque interaction between manipulator and helicopter fuselage.
4.1 Orientation Controller
The control system is based in the same approach used by the authors for the load transportation system by means of autonomous helicopters. The key element is the orientation controller in the inner loop. The rotation dynamics for a single helicopter, represented by two rigid bodies for the fuselage and the main rotor, can be expressed (see Kondak et al. (2006)) by the following equations:
where
Block
The simulation experiments have shown that, unlike in the case of a helicopter without a manipulator, the orientation controller with inversion block

Scheme for the orientation control.
With the usage of block
There are two reasons for this robustness: first, the actual influence of the manipulator on the fuselage is measured through
We distinguish between two types of influences imposed on the helicopter from a manipulator: coherent and noncoherent. In case of coherent influence, the forces and torques imposed on the helicopter by the manipulator change with frequencies close to those of the helicopter movement, whereby in the case of non-coherent influence they do not change in time significantly or change with frequencies different to those of the helicopter movement.
The small-size helicopters are insensitive to the noncoherent influences. This can be verified in simulation or by analysis of the dynamical equations as well as in flight experiments. Even large non-coherent torques imposed on the fuselage are compensated by the proposed controller with compensator
The opposite is true for the coherent influence. Even small interaction forces imposed on the fuselage periodically in proper phase could yield to low frequency instabilities and oscillations, so-called phase circles. Unfortunately, these phase circles appear often when the manipulator is compensating the helicopter movement in hovering, as explained in Sect. 4.2 in more detail. In this case, the proposed controller with compensator C works only with a perfectly modelled system. Therefore, for practical applications, in addition to this controller, a coupling between the helicopter and manipulator controllers should be used in order to prevent phase circles.
4.2 Movement of the CoG
Let us consider two feedback controlled systems

Scheme of the system with a coupling between two outputs
with
Considering symmetric systems with
where only the product of both coupling blocks
On the other hand, let us consider the set-up for aerial manipulation shown in Fig. 1. Let us imagine that the TCP is fixed on the object (does not move relative to the ground) and the manipulator is compensating the movement of the helicopter caused by a wind gust or the ground effect, see Fig. 7. The displacement of the fuselage δ

Movement of the manipulator CoG while compensating the displacement of the helicopter.
To see that δ
Here β depends on the rotor properties and its rotation speed around the rotor axis (which is assumed to be constant). Furthermore
where γ is a function of mass and geometry properties of the fuselage and the rotor, and ω
shows that, due to the gyroscopic effect of the main rotor, the applied torque induces the rotation speed of the fuselage in perpendicular direction, e.g.,
where coordinates
Taking into account that δ

Simplified scheme of the helicopter with manipulator using decoupled control.
It can be shown that the transfer function
Using for
As in (2)

Movement of system poles λ while increasing gains in

Movement of the helicopter induced by a manipulator which moves its CoG in two dimensions (horizontal plain).
One possible solution to avoid phase circles is to set
This means that manipulator CoG moves only in
In Fig. 10, the two horizontal coordinates (

Movement of the helicopter induced by a manipulator which moves its CoG along only one dimension.
Please note that even if the displacement of the manipulator CoG and the corresponding torques acting on the fuselage are small, compared to torques generated by the main rotor, they act in the phase with the fuselage movement and can induce phase circles. The disturbance torque, imposed on the fuselage, which is not changing in the phase with the fuselage movement, e.g., static displacement of the CoG, does not cause the phase circles described above and can be rejected by the helicopter controller well – even if its absolute value is comparable with the torques generated by the main rotor.
Condition (6) and the results from the second simulation experiment shown in Fig. 11 are verified in flight experiments using the set-up shown in Fig. 12. An electrical helicopter with the take-off weight of 15 kg is equipped with a pendulum, which can move a mass of 1 kg along the roll axis of the fuselage. The distance between the pendulum CoG and its rotation point is 0.12 m. The displacement of the pendulum CoG, while hovering, did not induce the oscillations as shown in Fig. 10.

Experimental platform with pendulum for displacement of the helicopter CoG.
5. Conclusions
Aerial robots physically interacting with the environment could be very useful for many applications. However, the models involved in the design of the control system are complicated due to dynamic coupling between the parts of the system. This was illustrated in the particular case of autonomous helicopters used for aerial manipulation. It was also shown that for analysis and control design of helicopters with manipulators, simplifications could be found which lead to practical, relevant solutions. Preliminary results for aerial manipulation were presented and discussed. In particular, it has been shown that if the forces and torques imposed by a manipulator on a helicopter change with frequencies close to those of the helicopter movement, even small interaction forces can generate low frequency instabilities and oscillations, so-called phase circles.
Footnotes
6. Acknowledgements
This work was partially supported by the projects ARCAS (European Commission, 7 th Framework Program, ICT-2011-287617) and by the national projects RANCOM (P11-TIC-7066) and CLEAR (DPI2011–28937-C02–01).
