Skip to main content
Search
Search
Quick Search anywhere
Quick Search fdjslkfh
Advanced search
Cart
Join AIAA Institution Login
Skip main navigation
Journal of Aerospace Information Systems logo
Skip to article control options
No AccessFull-Length Papers

Haptic Assistance for Helicopter Control Based on Pilot Intent Estimation

Published Online:15 Jan 2020https://doi.org/10.2514/1.I010773

Abstract

Haptic support systems have been widely used for supporting human operators when performing a manual control task. These systems are commonly designed to track known target trajectories. However, the trajectory to track is not known in many realistic cases. For instance, the pilot-intended trajectory is not known beforehand when considering a helicopter pilot flying in free-flight. This paper proposes a possible approach to design a haptic shared control system when the target trajectory is not known a priori. Especially, the aim of the proposed design is to help minimally trained pilots during a 2-degree-of-freedom lateral/longitudinal helicopter free-flight task. To accomplish this goal, first, a Pilot Intent Estimator (PIE) is developed to infer pilot intent. Then, the corresponding intended trajectory is generated. Finally, a haptic feedback is designed to track the estimated intended trajectory. The designed PIE was evaluated in a preliminary test with an experienced helicopter pilot. Then, a human-in-the-loop experiment with minimally trained participants was conducted to assess the proposed shared control system. Results showed the effectiveness of the PIE to estimate the correct direction of motion chosen by the pilot. Furthermore, the haptic feedback helped participants to accomplish the control task with better task performance (i.e., lower tracking errors and lower amount of control activity) compared with manual control.

References

  • [1] Wise J. A., Hopkin V. D. and Garland D. J., Handbook of Aviation Human Factors, 2nd ed., CRC Press, Taylor & Francis Group, Boca Raton, FL, 2010, Chap. 8. Google Scholar

  • [2] Parasuraman R., “Human-Computer Monitoring,” Human Factors, Vol. 29, No. 6, 1987, pp. 695–706. https://doi.org/10.1177/001872088702900609 CrossrefGoogle Scholar

  • [3] Parasuraman R. and Mouloua M., “Interaction of Signal Discriminability and Task Type in Vigilance Decrement,” Perception & Psychophysics, Vol. 41, No. 1, 1987, pp. 17–22. https://doi.org/10.3758/BF03208208 CrossrefGoogle Scholar

  • [4] Abbink D. A., Mulder M. and Boer E. R., “Haptic Shared Control: Smoothly Shifting Control Authority?” Cognition, Technology and Work, Vol. 14, No. 1, 2012, pp. 19–28. https://doi.org/10.1007/s10111-011-0192-5 CrossrefGoogle Scholar

  • [5] Alaimo S. M. C., Pollini L., Bresciani J. P. and Bülthoff H. H., “A Comparison of Direct and Indirect Haptic Aiding for Remotely Piloted Vehicles,” Proceedings of IEEE International Workshop on Robot and Human Interactive Communication, 2010, pp. 506–512. https://doi.org/10.1109/ROMAN.2010.5598647 Google Scholar

  • [6] Olivari M., Nieuwenhuizen F. M., Bülthoff H. H. and Pollini L., “Pilot Adaptation to Different Classes of Haptic Aids in Tracking Tasks,” Journal of Guidance, Navigation, and Dynamics, Vol. 37, No. 6, 2014, pp. 1741–1753. https://doi.org/10.2514/1.G000534 LinkGoogle Scholar

  • [7] Mulder M., Mulder M., Van Passen M. M. and Abbink D. A., “Haptic Gas Pedal Feedback,” Ergonomics, Vol. 51, No. 11, 2008, pp. 1710–1720. https://doi.org/10.1080/00140130802331583 CrossrefGoogle Scholar

  • [8] Maimeri M., Olivari M., Bülthoff H. H. and Pollini L., “On Effects of Failures in Haptic and Automated Pilot Support Systems,” AIAA SciTech Conference, AIAA Paper 2016-1181, 2016. https://doi.org/10.2514/6.2016-1181 LinkGoogle Scholar

  • [9] D’Intino G., Olivari M., Geluardi S., Venrooij J., Innocenti M., Bülthoff H. H. and Pollini L., “Evaluation of Haptic Support Systems for Training Purposes in a Tracking Task,” Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 2016, pp. 2169–2174. https://doi.org/10.1109/SMC.2016.7844560 Google Scholar

  • [10] D’Intino G., Olivari M., Geluardi S., Venrooij J., Pollini L. and Bülthoff H. H., “Experimental Evaluation of a Haptic Support System for Learning a 2-DoF Tracking Task,” AIAA SciTech Conference, AIAA Paper 2017-1083, 2017. https://doi.org/10.2514/6.2017-1083 LinkGoogle Scholar

  • [11] Bufalo F., Olivari M., Geluardi S., Gerboni C. A., Pollini L. and Bülthoff H. H., “Variable Force-Stiffness Haptic Feedback for Learning a Disturbance Rejection Task,” Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 2017, pp. 1517–1522. https://doi.org/10.1109/SMC.2017.8122829 Google Scholar

  • [12] Nieuwenhuizen F. M. and Bülthoff H. H., “Evaluation of Haptic Shared Control and a Highway-in-the-Sky Display for Personal Aerial Vehicles,” AIAA SciTech Conference, AIAA Paper 2014-0808, 2014. https://doi.org/10.2514/6.2014-0808 LinkGoogle Scholar

  • [13] Mulder M., Abbink D. A. and Boer E. R., “The Effect of Haptic Guidance on Curve Negotiation Behavior of Young, Experienced Drivers,” Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 2008, pp. 804–809. https://doi.org/10.1109/ICSMC.2008.4811377 Google Scholar

  • [14] Profumo L., Pollini L. and Abbink D. A., “Direct and Indirect Haptic Aiding for Curve Negotiation,” Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 2013, pp. 1846–1852. https://doi.org/10.1109/SMC.2013.318 Google Scholar

  • [15] Hoeckx F., “Machine Learning for Haptic Shared Control: The Effect of Individualized Haptic Guidance Paths for Free-Air Teleoperation Tasks,” M.Sc. Thesis, TU Delft, Delft, The Netherlands, 2016. Google Scholar

  • [16] Krozel J. and Andrisani D., “Intent Inference with Path Prediction,” Journal of Guidance, Control, and Dynamics, Vol. 29, No. 2, 2006, pp. 225–236. https://doi.org/10.2514/1.14348 LinkGoogle Scholar

  • [17] D’Intino G., Olivari M., Geluardi S., Fabbroni D., Bülthoff H. H. and Pollini L., “A Pilot Intent Estimator for Haptic Support Systems in Helicopter Maneuvering Tasks,” AIAA SciTech Conference, AIAA Paper 2018-0116, 2018. https://doi.org/10.2514/6.2018-0116 LinkGoogle Scholar

  • [18] Mazor E., Averbuch A., Bar-Shalom Y. and Dayan J., “Interacting Multiple Model Methods in Target Tracking: A Survey,” IEEE Transaction on Aerospace and Electronic Systems, Vol. 34, No. 1, 1998, pp. 103–123. https://doi.org/10.1109/7.640267 Google Scholar

  • [19] D’Intino G., Arenella A., Olivar M., Bülthoff H. H. and Pollini L., “Experimental Evaluation of a 2-DoF Haptic Shared Control System Based on Pilot Intent Estimation,” Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 2018, pp. 3225–3230. https://doi.org/10.1109/SMC.2018.00546 Google Scholar

  • [20] Bar-Shalom Y., Li X. R. and Kirubarajan T., Estimation with Application to Tracking and Navigation, John Wiley & Sons, New York, 2001, Chap. 11. CrossrefGoogle Scholar

  • [21] Geluardi S., Identification and Augmentation of a Civil Light Helicopter: Transforming Helicopters into Personal Aerial Vehicles, Logos Verlag GmbH, Berlin, 2016, Chap. 2. Google Scholar

  • [22] McRuer D. T., Human Pilot Dynamics in Compensatory Systems: Theory, Models and Experiments with Controlled Element and Forcing Function Variations, British Library Landing Division, Wetherby, U.K., 1965, Chap. 3. CrossrefGoogle Scholar

  • [23] Drop M. F., “Control-Theoretic Models of Feedforward in Manual Control,” Doctoral Thesis, TU Delft Univ., Delft, The Netherlands, 2016, Chaps. 2–4. https://doi.org/10.4233/uuid:7c1f62db-9a5a-4e02-8f11-488d6a299500. Google Scholar

  • [24] Itoh M., Flemisch F. and Abbink D. A., “A Hierarchical Framework to Analyze Shared Control Conflicts Between Human and Machine,” IFAC-PapersOnLine, Vol. 49, No. 19, 2016, pp. 96–101. https://doi.org/10.1016/j.ifacol.2016.10.468 CrossrefGoogle Scholar

  • [25] Scholtens W. M., “Reducing Conflicts in Haptic Shared Control During Curve Negotiation,” M.Sc. Thesis, TU Delft, Delft, The Netherlands, 2018. Google Scholar

  • [26] Baskett B. J., “Aeronautical Design Standard Performance Specification Handling Qualities Requirements for Military Rotorcraft,” United States Army Aviation and Missile Command, Aviation Engineering Directorate, Redstone Arsenal, Alabama, 2000, Chap. 3. Google Scholar

  • [27] Perfect P., Jump M. and White M. D., “Handling Qualities Requirements for Future Personal Aerial Vehicles,” Journal of Guidance, Control, and Dynamics, Vol. 38, No. 12, 2015, pp. 2386–2398. https://doi.org/10.2514/1.G001073 LinkGoogle Scholar

  • [28] Nieuwenhuizen F. M. and Bülthoff H. H., “The MPI Cybermotion Simulator: A Novel Research Platform to Investigate Human Control Behavior,” Journal of Computing Science and Engineering, Vol. 7, No. 2, 2013, pp. 122–131. https://doi.org/10.5626/JCSE.2013.7.2.122 CrossrefGoogle Scholar

  • [29] Fabbroni D., Bufalo F., D’Intino G., Geluardi S., Gerboni C. A., Olivari M. and Bülthoff H. H., “Transfer of Training from Fixed- and Motion-Base Simulators to a Light-Weight Helicopter,” Annual Forum Proceedings 74th AHS International, Modelling and Simulation, 2018. Google Scholar

  • [30] Scaramuzzino P. F., D’Intino G., Pavel M. D., Pool D. M., Stroosma O., Mulder M. and Bülthoff H. H., “Effectiveness of a Computer-Based Helicopter Trainer for Initial Hover Training,” Proceedings of the 44th European Rotorcraft Forum, 2018. Google Scholar

  • [31] Pinheiro J. C. and Douglas M. B., “Unconstrained Parametrizations for Variance-Covariance Matrices,” Statistics and Computing, Vol. 6, No. 3, 1996, pp. 289–296. https://doi.org/10.1007/BF00140873 CrossrefGoogle Scholar

Previous article
Next article