Increasing Fault Tolerance in Operational Centres using Human Sensing Technologies: Approach and Initial Results

Nelson Silva

2015

Abstract

The analysis of users’ behaviours when working with user interfaces is a complex task. It requires various sensing technologies and complex modelling of input/response relationships. A huge amount of data is collected and analysed today but there are multiple crucial factors that play an unknown role in improving human decision processes. The development of new user interfaces and the usage of suitable techniques to recognize interaction patterns, is crucial for creating adaptive systems. Our work is focused on fault tolerance of Human Machine Interfaces and we develop systems that accept physical user measurements as additional inputs. This can be applied to multiple domains such as Operational Control Centres.We have conducted experiments with professional air traffic controllers with the company Frequentis AG and we present and discuss the results obtained in a project called Sixth Sense. We also discuss limitations and extensions for future systems.

References

  1. Anne, I., Steven, T. S., Barry, K.: Human error in European air traffic management: the HERA project. Vol. 75. Reliability Engineering & System Safety, Elsevier (2002) 257-272
  2. Bernard, J., Daberkow, D., Fellner, D., Fischer, K., Koepler, O., Kohlhammer, J., Runnwerth, M., Ruppert, T., Schreck, T., Sens, I.: VisInfo: a digital library system for time series research data based on exploratory search - a user-centered design approach. Vol. 16. Intern. Journal on Digital Libraries (2015) 37-59
  3. Bishop, C.: Pattern Recognition and Machine Learning. Springer (2006) 605-674
  4. Brunton, B., Botvinick, M., Brody, C.: Rats and humans can optimally accumulate evidence for decision-making. Vol. 340. Science AAAS, New York (2013) 1-108
  5. Carayon, P.: Handbook of Human Factors and Ergonomics, Human Error. L. Erlbaum Associates Inc. (2006) 708-760
  6. Cugola, G., Margara, A.: Processing Flows of Information: From Data Stream to Complex Event Processing. Vol. 44. ACM Comput. Surv. (2012) Art. no. 15
  7. Duchowski, A.: Eye tracking methodology: Theory and practice. Vol. 373. Springer (2007) 3-179
  8. EUROCONTROL: Recommendations for HMI Evaluation in the Context of CWP Development: A Synthesis Of Relevant Literature. Core Requirements for ATM Working Positions, Project HRS/HSP-006. EUROCONTROL (2003)
  9. EUROCONTROL: The Development of Situation Awareness Measures in ATM Systems. EATMP Method and Tool, Edition 1.0. EUROCONTROL (2003)
  10. Frequentis, DFS: iCWP R - Integrated Controller Working Position. SESAR (2012)
  11. GAIN, Working Group B: Analytical Methods and Tools, Guide to Methods and Tools for Safety Analysis in ATM, http:// flightsafety.org/ files/ methods tools safety analysis.pdf. GAIN (2003)
  12. Guo, Q., Agichtein, E.: Exploring mouse movements for inferring query intent. Conference on Research and Development in Information Retrieval. ACM SIGIR 7808, New York (2008) 707-708
  13. Hart, S.G.: NASA-Task Load Index (NASA-TLX); 20 years later. NASA technical report, http:// humansystems. arc. nasa.gov/ groups/ TLX/ tlxpublications.html. NASA (2006)
  14. Hoang, T., Jung, Y. C., Holbrook, J. B., Malik, W. A.: Tower Controllers Assessment of the Spot and Runway Departure Advisor (SARDA) Concept. Ninth USA/Europe Air Traffic Management Research and Development Seminar (2011)
  15. Huang, J., White, R., Buscher, G.: User see, user point: gaze and cursor alignment in web search. CHI'12 (2012) 1341-1350
  16. Janetzko, H., Stoffel, F., Mittelstadt, S., Keim, D. A.: Anomaly detection for visual analytics of power consumption data. Vol. 38. Computers & Graphics. Elsevier (2014) 27-37
  17. Jouili, S., Vansteenberghe, V.: An Empirical Comparison of Graph Databases. International Conference on Social Computing (SocialCom) (2013) 708-715
  18. Karahasanovic, A., Andersen, B., Hansson, L., Langlo, J. A., Swengaard, H. E., Zeh, T., Grantz, V., Rubenser, R.: Zero Failure Management at Maximum Productivity in Safety Critical Control Room. SID2011 (EUROCONTROL; ISBN 978-2-87497-024-5). SESAR; Project N:10.10.02 (2011)
  19. Keim, D., Andrienko, G., Fekete, J., Gorg, C., Kohlhammer, J., Melancon, G.: Information Visualization - Human-Centered Issues and Perspectives. Lecture Notes in Computer Science. Springer (2008) 154-175
  20. Lam, H.: A Framework of Interaction Costs in Information Visualization. Vol. 14. IEEE Trans. Vis. Comput. Graph. (2008) 1149-1156
  21. Langlo, J. A., Wegner, E., Karahasanovic, A., Hansson, L., Swengaard, H., Andersen, B., Zeh, T., Kind, S., Rokitansky, C., Gräupl, T.: Usefulness of FMECA for improvement of productivity of TWR process. SID2012 (2012)
  22. Lehmann, S., Dörner, R., Schwanecke, U., Haubner, N., Luderschmidt, J.: UTIL: Complex, Post-WIMP Human Computer Interaction with Complex Event Processing Methods. Workshop ”Virtuelle und Erweiterte Realitt” der GI-Fachgruppe VR/AR, Aachen (2013) 109-120
  23. Myers, B., Hudson, S. E., Pausch, R.: Past, Present, and Future of User Interface Software Tools. Vol. 7. ACM Trans. Comput.-Hum. Interact. (2000) 3-28
  24. Patern, F., Santoro, C.: User Interface Evaluation When User Errors May Have SafetyCritical Effects. INTERACT 01, Tokyo (2001) 270-277
  25. Perez, D., Zhang, L., Schaefer, M., Schreck, T., Keim, D., Diaz, I.: Interactive feature space extension for multidimensional data projection. Vol. 150. Neurocomputing. Elsevier (2015) 611-626
  26. Rayner, K., Li, X., Williams, C., Cave, K., Well, A.: Eye movements during information processing tasks: Individual differences and cultural effects. Vol. 47. Vision Research. Elsevier (2007) 2714-2726
  27. Salvucci, D.: Inferring intent in eye-based interfaces: tracing eye movements with process models. CHI'99 (1999) 254-261
  28. Sauro, J., Lewis, j.: Quantifying the User Experience: Practical Statistics for User Research. MK (2012) 19-157
  29. Seminario, C., Wilson, D.: Case Study Evaluation of Mahout as a Recommender Platform. Workshop on Recommendation Utility Evaluation: Beyond RMSE (2012) 45-50
  30. Shorrock, S., Kirwan, B.: Development and application of a human error identification tool for air traffic control. Applied Ergonomics (2002)
  31. Silva, N., Eggeling, E., Settgast, V., Dieter, F.: Sixth sense - air traffic control prediction scenario augmented by sensors. i-KNOW 7814 Proceedings of the 14th International Conference on Knowledge Technologies and Data-driven Business, Article no. 34. doi: 10.1145/2637748.2638441 (2014)
  32. Steiger, M., Bernard, J., Mittelstadt, S., Lucke-Tieke, H., Keim, D., May, T., Kohlhammer, J.: Visual Analysis of Time-Series Similarities for Anomaly Detection in Sensor Networks. Computer Graphics Forum (2014) 401-410
  33. Stoffel, F., Fischer, F., Keim, D.: Finding Anomalies in Time-series Using Visual Correlation for Interactive Root Cause Analysis. VizSec. ACM (2013) 65-72
  34. Tsonis, C.: An analysis of information complexity in air traffic control human machine interaction. HAL2006-04. MIT (2006)
  35. Winkelholz, C., Schlick, C.: Statistical variable length Markov chains for the parameterization of stochastic user models from sparse data. IEEE International Conference on Systems, Man and Cybernetics (2004) 1770-1776
  36. Xing, J., Manning A. C.: Complexity and Automation Displays of Air Traffic Control: Literature Review and Analysis, Final Report, Civil Aerospace Medical Institute, Federal Aviation Administration. Office of Aerospace Medicine, Washington DC (2015)
  37. Xu, F., Griffiths, T.: Probabilistic models of cognitive development: Towards a rational constructivist approach to the study of learning and development. Journal of Cognition. Elsevier (2011) 299-301
  38. Yampolskiy, R.V.: Behavioral Modeling: an Overview. Vol. 5. American Journal of Applied Sciences (2008) 496-503
Download


Paper Citation


in Harvard Style

Silva N. (2015). Increasing Fault Tolerance in Operational Centres using Human Sensing Technologies: Approach and Initial Results . In European Project Space on Computer Vision, Graphics, Optics and Photonics - EPS Berlin, ISBN 978-989-758-156-4, pages 25-49. DOI: 10.5220/0006164100250049


in Bibtex Style

@conference{eps berlin15,
author={Nelson Silva},
title={Increasing Fault Tolerance in Operational Centres using Human Sensing Technologies: Approach and Initial Results},
booktitle={European Project Space on Computer Vision, Graphics, Optics and Photonics - EPS Berlin,},
year={2015},
pages={25-49},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006164100250049},
isbn={978-989-758-156-4},
}


in EndNote Style

TY - CONF
JO - European Project Space on Computer Vision, Graphics, Optics and Photonics - EPS Berlin,
TI - Increasing Fault Tolerance in Operational Centres using Human Sensing Technologies: Approach and Initial Results
SN - 978-989-758-156-4
AU - Silva N.
PY - 2015
SP - 25
EP - 49
DO - 10.5220/0006164100250049