# SENSOR-ASSISTED ADAPTIVE MOTOR CONTROL UNDER CONTINUOUSLY VARYING CONTEXT

### Heiko Hoffmann, Georgios Petkos, Sebastian Bitzer, Sethu Vijayakumar

#### Abstract

Adaptive motor control under continuously varying context, like the inertia parameters of a manipulated object, is an active research area that lacks a satisfactory solution. Here, we present and compare three novel strategies for learning control under varying context and show how adding tactile sensors may ease this task. The first strategy uses only dynamics information to infer the unknown inertia parameters. It is based on a probabilistic generative model of the control torques, which are linear in the inertia parameters. We demonstrate this inference in the special case of a single continuous context variable – the mass of the manipulated object. In the second strategy, instead of torques, we use tactile forces to infer the mass in a similar way. Finally, the third strategy omits this inference – which may be infeasible if the latent space is multi-dimensional – and directly maps the state, state transitions, and tactile forces onto the control torques. The additional tactile input implicitly contains all control-torque relevant properties of the manipulated object. In simulation, we demonstrate that this direct mapping can provide accurate control torques under multiple varying context variables.

#### References

- Haruno, M., Wolpert, D. M., and Kawato, M. (2001). Mosaic model for sensorimotor learning and control. Neural Computation, 13:2201-2220.
- Kalman, R. E. (1960). A new approach to linear filtering and prediction problems. Transactions of the ASME - Journal of Basic Engineering, 82:35-45.
- Narendra, K. S. and Balakrishnan, J. (1997). Adaptive control using multiple models. IEEE Transactions on Automatic Control, 42(2):171-187.
- Narendra, K. S. and Xiang, C. (2000). Adaptive control of discrete-time systems using multiple models. IEEE Transactions on Automatic Control, 45(9):1669-1686.
- Petkos, G., Toussaint, M., and Vijayakumar, S. (2006). Learning multiple models of non-linear dynamics for control under varying contexts. In Proceedings of the International Conference on Artificial Neural Networks. Springer.
- Petkos, G. and Vijayakumar, S. (2007). Context estimation and learning control through latent variable extraction: From discrete to continuous contexts. In Proceedings of the International Conference on Robotics and Automation. IEEE.
- Rasmussen, C. E. and Williams, C. K. I. (2006). Gaussian Processes for Machine Learning. MIT Press.
- Sciavicco, L. and Siciliano, B. (2000). Modelling and Control of Robot Manipulators. Springer.
- Vijayakumar, S., D'Souza, A., and Schaal, S. (2005). Incremental online learning in high dimensions. Neural Computation, 17:2602-2634.
- Wolpert, D. M. and Kawato, M. (1998). Multiple paired forward and inverse models for motor control. Neural Networks, 11:1317-1329.

#### Paper Citation

#### in Harvard Style

Hoffmann H., Petkos G., Bitzer S. and Vijayakumar S. (2007). **SENSOR-ASSISTED ADAPTIVE MOTOR CONTROL UNDER CONTINUOUSLY VARYING CONTEXT** . In *Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,* ISBN 978-972-8865-82-5, pages 262-269. DOI: 10.5220/0001626602620269

#### in Bibtex Style

@conference{icinco07,

author={Heiko Hoffmann and Georgios Petkos and Sebastian Bitzer and Sethu Vijayakumar},

title={SENSOR-ASSISTED ADAPTIVE MOTOR CONTROL UNDER CONTINUOUSLY VARYING CONTEXT},

booktitle={Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},

year={2007},

pages={262-269},

publisher={SciTePress},

organization={INSTICC},

doi={10.5220/0001626602620269},

isbn={978-972-8865-82-5},

}

#### in EndNote Style

TY - CONF

JO - Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,

TI - SENSOR-ASSISTED ADAPTIVE MOTOR CONTROL UNDER CONTINUOUSLY VARYING CONTEXT

SN - 978-972-8865-82-5

AU - Hoffmann H.

AU - Petkos G.

AU - Bitzer S.

AU - Vijayakumar S.

PY - 2007

SP - 262

EP - 269

DO - 10.5220/0001626602620269