Model Helicopter Control Using Body-Mounted Vibro-Tactile Transducers

The sense of touch as a man-machine communication channel can be as acute as the sense of sight and sound. In some scenarios such as those seen in aerobatics, stunt flying, and combat flights, tactile sensors can even outperform the conventional non-contact sensors in terms of situation awareness. Fusion of tactile sensory information with those obtained via sight and sound can avoid diverting the user’s attention away from the operational task at hand as well. In this study, the performance of an operator, to servo control the motion of a 2-dof model helicopter with pitch/yaw maneuverability, subjected to an intuitive body-referenced arrangement of a cluster of vibro-tactile sensors is investigated. A blindfolded operator will then control the helicopter to a safe attraction zone via a joystick based on this tactile sensory information. A fine-tuned local controller would take over for the end-of-motion precise homing. This study can pave the way towards a systematic integration and characterization of tactile sensors in high performance weapon platforms with improved situation awareness in visually awkward maneuvers such as those seen in aerial combat scenarios.


Introduction
Highly maneuverable flying machines such as helicopters are widely used in search and rescue, and surveillance due to their agility [1].Control of these machines lends itself as a challenging Multi-Input Multi-Output (MIMO) problem due to the nonlinear dynamics and strong interaction between controlled variables.Incorporating haptic sensors into the closed-loop feedback control of flying machines has recently drawn a great deal of attention in both academia and the industry sector [2].When employing body-referenced haptic sensors, the man-machine interaction can be as acute as that when using sense of sight and/or sound.In [3], a haptic interface for UAV collision avoidance was used.It was reported that, with the limited visual information, the collision could be avoided using haptic clues.Literature pertinent to the control of highly maneuverable aircrafts is vast.In particular, the robust and optimal controls of helicopters have been studied for the past two decades, (e.g., Refs.[1] [4]).
An effective human-in-the-loop hybrid control strategy based on sensory information obtained via an array of body-mounted haptic sensors (i.e., vibrating motors) is proposed.This method was successfully tested on a 2dof model helicopter.The control strategy is summarized below.
At the first stage, a user attempts to navigate the model helicopter to an attraction zone through haptic sensory feedback by using a joystick.In the second stage, an autonomous nonlinear controller takes over making the helicopter hover at steady state with high precision.A simple switching algorithm is adopted for smooth transition between the human-and computer-based controls.
The experimental model helicopter used in this study has two degrees of freedom, namely pitch and yaw (see Figure 1).The pitch propeller is driven by a voltage-controlled DC motor.Nose up is considered as positive pitch.Correspondingly, the yaw propeller is driven by a smaller voltage-controlled DC motor.Due to the gyroscopic effect, the propeller causing pitch would also cause a load torque on the motor's shaft which is in turn seen at the yaw axis.The model helicopter is pivoted on a fixed stand.Its center of gravity is located off the pivot point with a considerable offset in a way that the gravitation force will push the helicopter's nose down all the time.Pitch and yaw angles are measured through optical encoders.The pitch angle is limited to ±40 degrees from the level configuration, while, thanks to the slip-ring employed at the pivot point, the yaw angle can vary, and being measured by an optical encoder, indefinitely.
The layout of the paper is as follows: The governing dynamics equations of the system are described in Section 2. The control strategy is explained in Section 3. The experimental setup and results are given in Sections 4 and 5, respectively.Section 6 concludes the paper and described the future works.

Dynamics Model of the Helicopter
Figure 1 shows a schematic of the main components of the model helicopter.The governing dynamics equations are as follows [5]: Definition of parameters in Equations ( 1) and ( 2) are given in Table 1.
The nonlinear governing dynamics given in Equations ( 1) and ( 2) can be linearized about the quiescent point defined at 0 0 θ =  , 0 0 ψ =  , and 0 0 0 θ ψ = =    as follows: The linearized dynamics equations can be presented in the state space, disregarding the gravitational torque term, namely heli cm m gl as follows: heli cm , heli cm , heli cm 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 p pp py eq p eq p eq p p yp yy eq p eq p eq p where the state and control vectors are: T , , , As can be seen from Equation (1), the gravitational force generates a torque around the pivot point as In order to compensate this torque, a non-linear term, ff u was fed-forward to the voltage provided to the pitch DC motor as follows: where ff u is: In Equation ( 7), ff K denotes the feed-forward control gain (normally considered as 1) and d θ denotes the desired pitch angle.The gravitational force would have no effect on yaw motion.Therefore, the overall pitch/yaw control input denoted by  can be presented as:

The Proposed Control Strategy
The control strategy is carried out in two phases.In the first phase, a human operator attempts to bring the robot within an attraction zone using a joystick via haptic sensory information.We call this a human-in-the-loop control strategy.In the second phase, a nonlinear controller takes over for the precise end-of-motion servoing purpose.A simple switching law is adopted for smooth transition between the two controllers.The control strategies and the switching law are described in the following sections.

Human-in-the-Loop Control
The key to the successful integration of vibro-tactile sensory information into a control loop is to convey an organized tactile sensation to the user via lightweight and compact devices mounted on user's body without impairing his/her movement.In this context, an array of four small-size vibrating DC motors (denoted as front, back, left and right motors) was mounted on the user's body (see Figure 2).The voltage provided to the quadruplet vibro-motors, and correspondingly their vibration amplitudes, will change proportional to the error and also rate of change of error between the pitch and yaw angles and their desired values.Mathematically this can be written as: ( ) where p u and m u denote the voltages provided to the two pairs (i.e., front-back and left-right) of the body- mounted vibro-motors corresponding to pitch and yaw errors, respectively, the calib K denotes the calibration constant, the LQR K denotes the Linear Quadratic Regulator (LQR) gain, and d X denotes the desired state of the helicopter.The arrangement of the voltages provided to the quadruplet vibro motors are as follows: In Equation (10), F V , B V , R V , and L V denote the voltages provided to the front, back, right and left motors mounted on operator's body as seen in Figure 2. In the next section, a description on calculating the LQR K is given.

The Linear Quadratic Regulator, an Overview
In a Linear Quadratic Regulator (LQR), the control gain, K in a linear full-state feedback control law of the form u K = − X is calculated by minimizing a quadratic objective function, J defined as: ( ) where Q and R are weighting matrices on states and the control variables, respectively.The following weight- ing matrices were adopted in our experiments: The LQR control gain matrix, LQR K was calculated as: LQR 14.1 1.33 7.33 0.95 1.33 14.1 0.26 7.99

The Switching Law
The user controls the motion of the model helicopter based on vibro-tactile sensation he/she receives through four body-mounted motors.A human-based control would shift to an autonomous control strategy after helicopter is brought to a safe zone (i.e., attraction zone).A weighted 2-norm of the state error as a performance index, η was used to trigger the switching between the human-and computer-based controllers.Mathematically it can be represented as: where i w denotes the weighting factors, i x denote the states, and id x denotes the desired value of states.Weighting factors, i w and the calibration constant, calib K were tuned offline during operator's training based on his/her level of comfort when controlling the model helicopter.The overall structure of the proposed control strategy is depicted in Figure 3.

End-of-Motion Servo Control
A full-state feedback control law similar to that in LQR was developed for the end-of-motion servoing.However, a loop-shaping optimization process was utilized to calculate the controller gains.The nonlinear model of the helicopter was assumed within the optimization process.Furthermore, the pitch/yaw motor saturation was taken into consideration through the optimization process as well.Geometric hard constrains on parameters such as settling time, rise time and the overshoot in system's response were defined offline prior to optimization.The Response Optimization Toolbox from Math Work was used for this purpose [6].As an example, Figure 4 shows the simulated yaw response of the model helicopter when using the LQR design described in Section (3.1.1). Figure 5 shows the system's response based on the response optimization technique described earlier.As can be seen from Figure 5, a lesser overshoot, settling time, and rise time were achieved without saturating the yaw motor.Figure 6 shows the geometric constrains imposed on the system's response along with a number of iterations on calculated response trajectories.It is noteworthy that two integral terms on pitch and yaw angles were also added to the state vector further on to reduce the steady state error.The modified state vector X  was: The optimal gain opt K was calculated as:

Experimental Setup
Figure 7 shows the experimental apparatus.Two power modules were used to drive pitch and yaw motors of the model helicopter.Linear Pulse Width Modulated (PWM) servo amplifiers were also used to drive body-mounted vibrating motors.The motion of the helicopter can be controlled in real time via a Logitech joystick (shown in the figure) or completely autonomously.The Q8 board from Quanser was used for control and data acquisition in real time [7].Wincon from Quanser along with a third-party real-time kernel provide a real-time operating environment within the Simulink.The Q8 board can support 8 analogue outputs and 8 quadratic encoder chan-     nels.Two rotary optical encoders measure the pitch and yaw angles in real time.Pitch motion is limited to 40 ± degrees from the level configuration.However, the yaw angle can change indefinitely thanks to the slip-ring mechanism used at the pivot point connecting the stand and the helicopter's main body.The pitch motor can generate a larger thrust than that in the yaw motor.This extra power would be needed to compensate for the gravitational torque around the pivot due to the offset between the helicopter's center of gravity and the hinge on the helicopter's stand.

Experimental Result
Figure 8 and Figure 9 show two representative experimental results.The desired pitch and yaw angles were set at 0 and 90 degrees, respectively in both experiments.Pitch and yaw angles along with voltages provided to the pitch/yaw motors are shown in figures.The initial elapsed time for controllers to take effect in both experiments was set at 3 seconds approximately.In the first experiment shown in Figure 8, the human-in-the-loop control strategy is in place for 15 seconds following the initialization.The computer-based controller starts at 18 seconds introducing some small overshoots in both pitch and yaw motions before bringing the helicopter to steady state.In the second experimentation, the calibration constant, calib K , and also the switching threshold, η were changed based on operator's learning and comfort level.A lesser overshoot was achieved but at the cost of an increased settling time.It is noteworthy that the sensitivity of the joystick was also decreased in the second experimentation.In both experiments the operator could guide the model helicopter to a safe zone blindfolded.In both figures, the dashed line represents the time at which the computer-based controller takes effect.

Conclusions and Future Work
A methodology to incorporate tactile sensory information into the feedback control loop of a 2-dof model helicopter was addressed.It was shown through some experiments that body-referenced touch sensors can provide the human operator with sufficient information to guide a free-flying object even in the case that visual clues are obstructed.A blindfolded operator, after going through a training period, could navigate the model helicopter to a safe zone.The overall control strategy was divided into two main stages, namely the human-in-the-loop and the computer-based control.An LQR-based control strategy would suffice to generate proper control cues to the operator, subjected to a cluster of vibro-tactile motors mounted on his/her body.A computer-based control takes effect at the end of motion for precise homing.

Figure 1 .
Figure 1.A schematic of the 2-dof model helicopter.

Figure 3 .
Figure 3.The proposed control structure.

Figure 5 .
Figure 5. Simulated yaw response of the 2-dof model helicopter via loopshaping and response optimization.

Figure 6 .
Figure 6.User-defined geometric hard constraints on the 2-dof model helicopter's yaw response.

Figure 9 .
Figure 9. Experimental result after changing parameters (original in color).

Table 1 .
Physical parameters of the system.