Tactile Display Design for Securing Flight and Reducing the Saturation of Pilot’s Visual Channel

Khaled Fellah, Mohamed Guiatni

2016

Abstract

Visual channel dominates the design of the cockpit, and auditory channel is progressively being used as well. However, tactile displays are almost abstract in the cockpit designs. Whereas, many research proved that several applications exist where the tactile displays may become an important or even essential choice. This is due to the fact that the visual feedback is not suitable, not adequate, or surcharged and that the visual attention is usually limited to a simple entity. In this paper, we propose a design of a low-cost tactile feedback system to provide the pilot with better insight in the flight path and prevent limitations during flight. In the first part of the paper, we develop an effective control strategy based on inverse dynamic to solve the problems of use of the low-cost tactors. The obtained results showed reduction of 48 % in settling time. The second part describes the use of Fuzzy Logic Controllers (FLC) to compute a new form of tactile output of the translation of a pertinent flight data information and flight envelope to vibrotactile feedback signals. And in the last part, we develop a wireless (and USB) vibrotactile feedback device consisting of 16 embedded tactors controlled with an inverse dynamic strategy via an arm Cortex M3 architecture. Pilots equipped with the developed tactile display were capable of successfully flying in a simulator. They confirm that tactile feedback is an interesting way of feeding back information about the airplane’s state, in order to give a better understanding of what the airplane is doing during controlled flight.

References

  1. Arasan, A., Basdogan, C., and Sezgin, T. M. (2013). Haptic stylus with inertial and vibro-tactile feedback. In World Haptics Conference (WHC), 2013, pages 425- 430. IEEE.
  2. Brown, L. M., Brewster, S. A., and Purchase, H. C. (2005). A first investigation into the effectiveness of tactons. In Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005. World Haptics 2005. First Joint, pages 167-176. IEEE.
  3. Brown, L. M. and Kaaresoja, T. (2006). Feel who's talking: using tactons for mobile phone alerts. In CHI'06 extended abstracts on Human factors in computing systems, pages 604-609. ACM.
  4. Choi, S. and Kuchenbecker, K. J. (2013). Vibrotactile display: Perception, technology, and applications. Proceedings of the IEEE, 101(9):2093-2104.
  5. Cholewiak, R. W., Brill, J. C., and Schwab, A. (2004). Vibrotactile localization on the abdomen: Effects of place and space. Perception & Psychophysics, 66(6):970-987.
  6. Cholewiak, R. W. and Collins, A. A. (2003). Vibrotactile localization on the arm: Effects of place, space, and age. Perception & psychophysics, 65(7):1058-1077.
  7. Erp, V., Jan, B., Veltman, J., van Veen, H., and Oving, A. (2003). Tactile torso display as countermeasure to reduce night vision goggles induced drift. Technical report, DTIC Document.
  8. Feng, G. (2006). A survey on analysis and design of modelbased fuzzy control systems. Fuzzy systems, IEEE Transactions on, 14(5):676-697.
  9. Fisch, F., Lenz, J., Holzapfel, F., and Sachs, G. (2012). On the solution of bilevel optimal control problems to increase the fairness in air races. Journal of Guidance, Control, and Dynamics, 35(4):1292-1298.
  10. Jansen, C., Wennemers, A., Vos, W., and Groen, E. (2008). Flytact: A tactile display improves a helicopter pilots landing performance in degraded visual environments. Springer.
  11. Jantzen, J. (1998). Tuning of fuzzy pid controllers. Technical University of Denmark, report.
  12. Jiang, T. and Li, Y. (1996). Generalized defuzzification strategies and their parameter learning procedures. Fuzzy Systems, IEEE Transactions on, 4(1):64-71.
  13. Jones, L. A. and Sarter, N. B. (2008). Tactile displays: Guidance for their design and application. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50(1):90-111.
  14. Kaaresoja, T. and Linjama, J. (2005). Perception of short tactile pulses generated by a vibration motor in a mobile phone. In Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005. World Haptics 2005. First Joint, pages 471-472. IEEE.
  15. Kapur, P., Jensen, M., Buxbaum, L. J., Jax, S. A., and Kuchenbecker, K. J. (2010). Spatially distributed tactile feedback for kinesthetic motion guidance. In Haptics Symposium, 2010 IEEE, pages 519-526. IEEE.
  16. Kelley, A. M., Cheung, B., Lawson, B. D., Rath, E., Chiasson, J., Ramiccio, J. G., and Rupert, A. H. (2013). Efficacy of directional cues from a tactile system for target orientation in helicopter extractions over moving targets. Technical report, DTIC Document.
  17. Lawson, B. D. and Rupert, A. H. (2014). Coalition warfare program tactile situation awareness system for aviation applications: System development. Technical report, DTIC Document.
  18. Lloyd, D. M., Merat, N., Mcglone, F., and Spence, C. (2003). Crossmodal links between audition and touch in covert endogenous spatial attention. Perception & Psychophysics, 65(6):901-924.
  19. McGrath, B. J. (2000). Tactile instrument for aviation. Technical report, DTIC Document.
  20. Nojima, T. and Funabiki, K. (2005). Cockpit display using tactile sensation. In null, pages 501-502. IEEE.
  21. Petit, G. (2013). Conception, prototypage et évaluation dun système pour l'exploration audio-tactile et spatiale de pages web par des utilisateurs non-voyants. PhD thesis, Ócole Polytechnique de Montréal.
  22. Precup, R.-E. and Hellendoorn, H. (2011). A survey on industrial applications of fuzzy control. Computers in Industry, 62(3):213-226.
  23. Renwick, K. (2008). Effectiveness of vibration-based haptic feedback effects for 3d object manipulation.
  24. Rosenblum, L. D. (2011). See what I'm Saying: The Extraordinary Powers of Our Five Senses. WW Norton & Company.
  25. Sala, A., Guerra, T. M., and Babus?ka, R. (2005). Perspectives of fuzzy systems and control. Fuzzy Sets and Systems, 156(3):432-444.
  26. Salzer, Y. and Oron-Gilad, T. (2015). Evaluation of an onthigh vibrotactile collision avoidance alerting component in a simulated flight mission. Human-Machine Systems, IEEE Transactions on, 45(2):251-255.
  27. Schmidt-Skipiol, F. J. (2015). Tactile feedback and situation awareness.
  28. Seiderman, A., Marcus, S. E., and Hapgood, D. (1989). 20/20 is not enough: the new world of vision. Alfred A. Knopf.
  29. Self, B., Van Erp, J. B., Eriksson, L., and Elliott, L. (2008). Human factors issues of tactile displays for military environments. Tactile Displays for Orientation, Navigation and Communication in Air, Sea and Land Environments, pages 1-18.
  30. Sepehri, N. and Lawrence, P. D. (1998). Fuzzy logic control of a teleoperated log loader machine. In Intelligent Robots and Systems, 1998. Proceedings., 1998 IEEE/RSJ International Conference on, volume 3, pages 1571-1577. IEEE.
  31. Tang, F., McMahan, R. P., and Allen, T. T. (2014). Development of a low-cost tactile sleeve for autism intervention. In Haptic, Audio and Visual Environments and Games (HAVE), 2014 IEEE International Symposium on, pages 35-40. IEEE.
  32. Thomas, P., Biswas, P., and Langdon, P. (2015). State-ofthe-art and future concepts for interaction in aircraft cockpits. In Universal Access in Human-Computer Interaction. Access to Interaction, pages 538-549. Springer.
  33. Van Erp, J. and Self, B. (2008). Introduction to tactile displays in military environments. Tactile Displays for Orientation, Navigation and Communication in Air, Sea, and Land Environments, pages 1-1.
  34. Van Erp, J. B., Van Veen, H. A., Jansen, C., and Dobbins, T. (2005). Waypoint navigation with a vibrotactile waist belt. ACM Transactions on Applied Perception (TAP), 2(2):106-117.
  35. Van Veen, H. A. and Van Erp, J. B. (2001). Tactile information presentation in the cockpit. In Haptic HumanComputer Interaction, pages 174-181. Springer.
  36. van Wassenhove, V. (2009). Minding time in an amodal representational space. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 364(1525):1815-1830.
  37. Vartholomeos, P. and Papadopoulos, E. (2006). Analysis, design and control of a planar micro-robot driven by two centripetal-force actuators. In Robotics and Automation, 2006. ICRA 2006. Proceedings 2006 IEEE International Conference on, pages 649-654. IEEE.
  38. Wellman, P. S., Peine, W. J., Favalora, G., and Howe, R. D. (1998). Mechanical design and control of a highbandwidth shape memory alloy tactile display. In Experimental robotics V, pages 56-66. Springer.
  39. Zhang, F., Braun, S., and Holzapfel, F. (2014). Physically integrated reference model and its aids in validation of requirements to flight control systems. In AIAA Guidance, Navigation and Control Conference, pages 2014-0962.
Download


Paper Citation


in Harvard Style

Fellah K. and Guiatni M. (2016). Tactile Display Design for Securing Flight and Reducing the Saturation of Pilot’s Visual Channel . In Proceedings of the 13th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO, ISBN 978-989-758-198-4, pages 362-373. DOI: 10.5220/0005984303620373


in Bibtex Style

@conference{icinco16,
author={Khaled Fellah and Mohamed Guiatni},
title={Tactile Display Design for Securing Flight and Reducing the Saturation of Pilot’s Visual Channel},
booktitle={Proceedings of the 13th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},
year={2016},
pages={362-373},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005984303620373},
isbn={978-989-758-198-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 13th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,
TI - Tactile Display Design for Securing Flight and Reducing the Saturation of Pilot’s Visual Channel
SN - 978-989-758-198-4
AU - Fellah K.
AU - Guiatni M.
PY - 2016
SP - 362
EP - 373
DO - 10.5220/0005984303620373