Long Range Optical Truck Tracking

Christian Winkens, Dietrich Paulus

2017

Abstract

Platooning applications require precise knowledge about position and orientation (pose) of the leading vehicle especially in rough terrain. We present an optical solution for a robust pose estimation using artificial markers and a camera as the only sensor. Temporal coherence of image sequences is used in a Kalman filter to obtain precise estimates. Furthermore based on the marker detections we utilize an adaptive model building algorithm which learns a keypoint based representation of the leading vehicle at runtime. The model is continuously updated and allows a markerless tracking of the vehicle for up to 70meters even when driving at high velocities. The system is designed for and tested in off-road scenarios. A pose evaluation is performed in a simulation testbed.

References

  1. Barth, A. and Franke, U. (2008). Where will the oncoming vehicle be the next second? In IEEE Intelligent Vehicles Symposium, pages 1068-1073.
  2. Barth, A. and Franke, U. (2009). Estimating the driving state of oncoming vehicles from a moving platform using stereo vision. IEEE Transactions on Intelligent Transportation Systems, 10(4):560-571.
  3. Benhimane, S., Malis, E., Rives, P., and Azinheira, J. (2005). Vision-based control for car platooning using homography decomposition. In IEEE International Conference on Robotics and Automation, pages 2161- 2166.
  4. Bergenhem, C., Shladover, S., Coelingh, E., Englund, C., and Tsugawa, S. (2012). Overview of platooning systems. In Proceedings of the 19th ITS World Congress, Vienna.
  5. Fiala, M. (2005). Artag, a fiducial marker system using digital techniques. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, volume 2, pages 590-596. IEEE.
  6. Fischler, M. A. and Bolles, R. C. (1981). Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6):381-395.
  7. Franke, U., Bottiger, F., Zomotor, Z., and Seeberger, D. (1995). Truck platooning in mixed traffic. In IEEE Intelligent Vehicles Symposium, pages 1-6.
  8. Fuchs, C., Eggert, S., Knopp, B., and Z öbel, D. (2014a). Pose detection in truck and trailer combinations for advanced driver assistance systems. In IEEE Intelligent Vehicles Symposium Proceedings, pages 1175- 1180. IEEE.
  9. Fuchs, C., Z öbel, D., and Paulus, D. (2014b). 3-d pose detection for articulated vehicles. In 13th International Conference on Intelligent Autonomous Systems (IAS).
  10. Gehring, O. and Fritz, H. (1997). Practical results of a longitudinal control concept for truck platooning with vehicle to vehicle communication. In IEEE Conference on Intelligent Transportation System (ITSC), pages 117- 122.
  11. Hare, S., Saffari, A., and Torr, P. H. (2011). Struck: Structured output tracking with kernels. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 263-270. IEEE.
  12. Henriques, J. F., Caseiro, R., Martins, P., and Batista, J. (2015). High-speed tracking with kernelized correlation filters. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 37(3):583-596.
  13. Huynh, D. (2009). Metrics for 3d rotations: Comparison and analysis. Journal of Mathematical Imaging and Vision, 35(2):155-164.
  14. Kalal, Z., Mikolajczyk, K., and Matas, J. (2010). Forwardbackward error: Automatic detection of tracking failures. In In Proceedings of the 2010 20th International Conference on Pattern Recognition, ICPR 10, pages 2756-2759. IEEE Computer Society.
  15. Kalman, R. E. (1960). A new approach to linear filtering and prediction problems. Journal of Fluids Engineering, 82(1):35-45.
  16. Kato, H. and Billinghurst, M. (1999). Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In 2nd IEEE and ACM International Workshop on Augmented Reality. (IWAR'99) Proceedings., pages 85-94. IEEE.
  17. Leutenegger, S., Chli, M., and Siegwart, R. Y. (2011). Brisk: Binary robust invariant scalable keypoints. In Proceedings of the 2011 International Conference on Computer Vision, ICCV 7811, pages 2548-2555, Washington, DC, USA. IEEE Computer Society.
  18. Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60:91-110.
  19. Manz, M., Luettel, T., von Hundelshausen, F., and Wuensche, H.-J. (2011). Monocular model-based 3d vehicle tracking for autonomous vehicles in unstructured environment. In IEEE International Conference on Robotics and Automation (ICRA), pages 2465-2471.
  20. Maresca, M. E. and Petrosino, A. (2013). Image Analysis and Processing - ICIAP 2013: 17th International Conference, Naples, Italy, September 9-13, 2013, Proceedings, Part II, chapter MATRIOSKA: A Multilevel Approach to Fast Tracking by Learning, pages 419-428. Springer Berlin Heidelberg, Berlin, Heidelberg.
  21. Matthews, I., Ishikawa, T., and Baker, S. (2004). The template update problem. IEEE Transactions on Pattern Analysis & Machine Intelligence, (6):810-815.
  22. Nam, H., Baek, M., and Han, B. (2016). Modeling and propagating cnns in a tree structure for visual tracking. arXiv preprint arXiv:1608.07242.
  23. Nam, H., Hong, S., and Han, B. (2014). Online graph-based tracking. In Computer Vision-ECCV 2014, pages 112-126. Springer.
  24. Nebehay, G. and Pflugfelder, R. (2014). Consensus-based matching and tracking of keypoints for object tracking. In Applications of Computer Vision (WACV), 2014 IEEE Winter Conference on, pages 862-869. IEEE.
  25. Nebehay, G. and Pflugfelder, R. (2015). Clustering of Static-Adaptive correspondences for deformable object tracking. In Computer Vision and Pattern Recognition. IEEE.
  26. Olson, E. (2011). AprilTag: A robust and flexible visual fiducial system. In 2011 IEEE International Conference on Robotics and Automation (ICRA), pages 3400-3407. IEEE.
  27. Ortiz, R. (2012). Freak: Fast retina keypoint. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR 7812, pages 510-517, Washington, DC, USA. IEEE Computer Society.
  28. Park, F. C. (1995). Distance metrics on the rigid-body motions with applications to mechanism design. Journal of Mechanical Design, 117(1):48-54.
  29. Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011). Orb: An efficient alternative to sift or surf. In Proceedings of the 2011 International Conference on Computer Vision, ICCV 7811, pages 2564-2571, Washington, DC, USA. IEEE Computer Society.
  30. Schmalstieg, D., Fuhrmann, A., Hesina, G., Szalavári, Z., Encarnac¸ao, L. M., Gervautz, M., and Purgathofer, W. (2002). The Studierstube augmented reality project. Presence: Teleoperators and Virtual Environments, 11(1):33-54.
  31. Smeulders, A. W., Chu, D. M., Cucchiara, R., Calderara, S., Dehghan, A., and Shah, M. (2014). Visual tracking: An experimental survey. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 36(7):1442-1468.
  32. Tank, T. and Linnartz, J.-P. (1997). Vehicle-to-vehicle communications for avcs platooning. IEEE Transactions on Vehicular Technology, 46(2):528-536.
  33. Winkens, C., Fuchs, C., Neuhaus, F., and Paulus, D. (2015). Optical truck tracking for autonomous platooning. In Azzopardi, G. and Petkov, N., editors, Computer Analysis of Images and Patterns: 16th International Conference, CAIP 2015, Valletta, Malta, volume 9257 of LNCS, pages 38-48, Cham. Springer.
  34. Wu, Y., Lim, J., and Yang, M.-H. (2015). Object tracking benchmark. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 37(9):1834-1848.
  35. yves Bouguet, J. (2000). Pyramidal implementation of the lucas kanade feature tracker. Intel Corporation, Microprocessor Research Labs.
  36. Zhu, G., Porikli, F., and Li, H. (2015). Tracking randomly moving objects on edge box proposals. arXiv preprint arXiv:1507.08085.
Download


Paper Citation


in Harvard Style

Winkens C. and Paulus D. (2017). Long Range Optical Truck Tracking . In Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-220-2, pages 330-339. DOI: 10.5220/0006296003300339


in Bibtex Style

@conference{icaart17,
author={Christian Winkens and Dietrich Paulus},
title={Long Range Optical Truck Tracking},
booktitle={Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2017},
pages={330-339},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006296003300339},
isbn={978-989-758-220-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Long Range Optical Truck Tracking
SN - 978-989-758-220-2
AU - Winkens C.
AU - Paulus D.
PY - 2017
SP - 330
EP - 339
DO - 10.5220/0006296003300339