A System Design for Teleoperated Road Vehicles

Sebastian Gnatzig, Frederic Chucholowski, Tito Tang, Markus Lienkamp


The possibility to provision road vehicles unmanned and on demand will have an important influence on the development of new mobility concepts. We therefore present the teleoperated driving of road vehicles. This paper outlines the basic concepts, including a static multi-camera design, an operator interface with a sensor fusion based display, and a cellular network based video transmission and communication architecture. We also show how we manage to fulfill the system’s technical requirements with our hard- and software design and point out the occurring problems due to communication limitations and lack of situation awareness. Finally, we propose solutions to guarantee driving safety.


  1. 3GPP - 3rd Generation Partnership Project (2013). 3GPP - HSPA. http://www.3gpp.org/HSPA. [Online; accessed 18-April-2013].
  2. Abendroth, B. and Bruder, R. (2009). Die Leistungsfähigkeit des Menschen für die Fahrzeugführung. In Winner, H., Hakuli, S., and Wolf, G., editors, Handbuch Fahrerassistenzsysteme, pages 4-14. Vieweg + Teubner, Wiesbaden.
  3. Appelqvist, P., Knuuttila, J., and Ahtiaine, J. (2010). Mechatronics Design of an Unmanned Ground Vehicle for Military Applications. In Di Paola, A. M. D. and Cicirelli, G., editors, Mechatronic Systems Applications, pages 237-262. InTech.
  4. Canzler, W. and Knie, A. (2009). Grüne Wege aus der Autokrise: Vom Autobauer zum Mobilitätsdienstleister ; ein Strategiepapier. Heinrich-Böll-Stiftung, Berlin.
  5. Chucholowski, F., Büchner, S., Reicheneder, J., and Lienkamp, M. (2013). Prediction Methods for Teleoperated Road Vehicles. In Conference on Future Automotive Technology - Focus Electromobility, Garching. Bayern Innovativ GmbH.
  6. Dickmanns, E. D. (2005). Vision: Von Assistenz zum Autonomen Fahren. In Maurer, M. and Stiller, C., editors, Fahrerassistenzsysteme mit maschineller Wahrnehmung, pages 203-237. Springer, Berlin.
  7. Diermeyer, F., Gnatzig, S., Chucholowski, F., Tang, T., and Lienkamp, M. (2011). Der Mensch als Sensor - Der Weg zum teleoperierten Fahren. In AAET - Automatisierungssysteme, Assistenzsysteme und eingebettete Systeme für Transportmittel, Braunschweig. ITS Niedersachsen.
  8. Durrant-Whyte, H. F. (1988). Sensor Models and Multisensor Integration. The International Journal of Robotics Research, 7(6):97-113.
  9. Farr, N., Bowen, A., Ware, J., Pontbriand, C., and Tivey, M. (2010). An integrated, underwater optical /acoustic communications system. In Proceedings of the OCEANS 2010 IEEE SYDNEY Conference & Exhibition.
  10. Fletcher, L., Teller, S., Olson, E., Moore, D., Kuwata, Y., How, J., Leonard, J., Miller, I., Campbell, M., Huttenlocher, D., Nathan, A., and Kline, F.-R. (2008). The MIT-Cornell collision and why it happened. Journal of Field Robotics, 25(10):775-807.
  11. Fong, T. and Thorpe, C. (2001). Vehicle Teleoperation Interfaces. Autonomous Robots, 11(1):9-18.
  12. Fong, T., Thorpe, C., and Baur, C. (2001). Advanced Interfaces for Vehicle Teleoperation: Collaborative Control, Sensor Fusion Displays, and Remote Driving Tools. Autonomous Robots, 11(1):77-85.
  13. Gnatzig, S., Haas, E., and Lienkamp, M. (2012a). Die Teleoperation als Ansatz zur fahrerlosen Fahrzeugführung. In 5. Tagung Fahrerassistenz.
  14. Gnatzig, S., Schuller, F., and Lienkamp, M. (2012b). Human-Machine Interaction as Key Technology for Driverless Driving - A Trajectory-Based Shared Autonomy Control Approach. In 21st IEEE International Symposium on Robot and Human Interactive Communication.
  15. Goldstein, E. B., Irtel, H., and Plata, G. (2008). Wahrnehmungspsychologie: Der Grundkurs. Spektrum, Akad. Verl., Berlin [u.a.], 7 edition.
  16. Isermann, R. (2006). Fault-diagnosis systems: An introduction from fault detection to fault tolerance. Springer, Berlin and New York.
  17. Jürgensohn, T. and Timpe, K.-P. (2001). Kraftfahrzeugführung. Springer, Berlin [u.a.].
  18. Kammel, S., Ziegler, J., Pitzer, B., Werling, M., Gindele, T., Jagzent, D., Schröder, J., Thuy, M., Goebl, M., Hundelshausen, F. v., Pink, O., Frese, C., and Stiller, C. (2008). Team AnnieWAY's autonomous system for the 2007 DARPA Urban Challenge. Journal of Field Robotics, 25(9):615-639.
  19. Kay, J. (1997). STRIPE: Remote Driving Using Limited Image Data. Ph.D. dissertation, Carnegie Mellon University, Pittsburgh.
  20. Kay, J. and Thorpe, C. (1995). Operator Interface Design Issues In A Low-Bandwidth And High-Latency Vehicle Teleoperation System. In International Conference on Environmental Systems.
  21. Krenik, B. (2008). 4G wireless technology: When will it happen? What does it offer? In 2008 IEEE Asian Solid-State Circuits Conference, pages 141- 144. IEEE.
  22. Lank, C. (2010). Einfluss von Fahrzeuginnenraumakustik und vibrationen auf die Geschwindigkeitswahl von Kraftfahrern. Ph.D. dissertation, RheinischWestfälischen Technischen Hochschule Aachen.
  23. Lutz, L., Tang, T., and Lienkamp, M. (2012). Analyse der rechtlichen Situation von teleoperierten und autonomen Fahrzeugen. In 5. Tagung Fahrerassistenz.
  24. McGovern, D. (1987). Experiences in teleoperation of land vehicles. Technical Report N90-22918, Sandia National Labs., Albuquerque NM (USA).
  25. Negele, H. J. (2007). Anwendungsgerechte Konzipierung von Fahrsimulatoren für die Fahrzeugentwicklung. Ph.D. dissertation, Technischen Universität München.
  26. Prokkola, J., Perala, P. H. J., Hanski, M., and Piri, E. (2009). 3G/HSPA Performance in Live Networks from the End User Perspective. In 2009 IEEE International Conference on Communications, pages 1-6. IEEE.
  27. Scribner, D. R. and Gombash, J. W. (1998). The Effect of Stereoscopic and Wide Field of View Conditions on Teleoperator Performance. Technical Report ARLTR-1598, Army Research Laboratory.
  28. Sheridan, T. B. and Verplank, W. L. (1978). Human and computer control of undersea teleoperators. Technical Report N00014-77-C-0256, Massachusetts Institute of Technology.
  29. Statistisches Bundesamt (2011). Unfallentwicklung auf deutschen Straßen 2010.
  30. Stiller, C. (2005). Fahrerassistenzsysteme - Von realisierten Funktionen zum vernetzt wahrnehmenden, selbstorganisierenden Verkehr. In Maurer, M. and Stiller, C., editors, Fahrerassistenzsysteme mit maschineller Wahrnehmung, pages 1-20. Springer, Berlin.
  31. Tenorio, S., Exadaktylos, K., McWilliams, B., and Le Pezennec, Y. (2010). Mobile broadband field network performance with HSPA+. In 2010 European Wireless Conference (EW), pages 269-273. IEEE.
  32. The European Parliament And The Council (1977). 77/649/EWG.
  33. The European Parliament And The Council (2004). 2003/97/EG.
  34. United Nations (2012). World Urbanization Prospects: The 2011 Revision. Technical Report ESA/P/WP/224.
  35. Winfield, A. F. T. (1999). Wireless Video Tele-operation using Internet Protocols. In Proceedings of the 14th International Conference on Unmanned Air Vehicle Systems.
  36. Winfield, A. F. T. (2000). Future Directions in Teleoperated Robotics. In Schilling, T., editor, Telerobotic applications, pages 147-163. Professional Engineering Pub., London.

Paper Citation

in Harvard Style

Gnatzig S., Chucholowski F., Tang T. and Lienkamp M. (2013). A System Design for Teleoperated Road Vehicles . In Proceedings of the 10th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-8565-71-6, pages 231-238. DOI: 10.5220/0004475802310238

in Bibtex Style

author={Sebastian Gnatzig and Frederic Chucholowski and Tito Tang and Markus Lienkamp},
title={A System Design for Teleoperated Road Vehicles},
booktitle={Proceedings of the 10th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},

in EndNote Style

JO - Proceedings of the 10th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - A System Design for Teleoperated Road Vehicles
SN - 978-989-8565-71-6
AU - Gnatzig S.
AU - Chucholowski F.
AU - Tang T.
AU - Lienkamp M.
PY - 2013
SP - 231
EP - 238
DO - 10.5220/0004475802310238