From Structured Task Instructions to Robot Task Plans

Jianmin Ji, Xiaoping Chen

2013

Abstract

For the purpose of allowing an autonomous robot to use task instructions for task planning, we present a formalization for specifying structured task instructions and provide an approach for integrating these instructions with robot’s built-in knowledge to compute plans for open-ended tasks. We have implemented a prototype of the system. We also report a case study of the effectiveness of the approach.

References

  1. Baral, C. (2003). Knowledge Representation, Reasoning and Declarative Problem Solving. Cambridge University Press, New York, NY, USA.
  2. Baral, C., Dzifcak, J., Gonzalez, M., and Zhou, J. (2011). Using inverse lambda and generalization to translate english to formal languages. Arxiv preprint arXiv:1108.3843.
  3. Beetz, M., Jain, D., Mösenlechner, L., and Tenorth, M. (2010). Towards performing everyday manipulation activities. Robotics and Autonomous Systems, 58(9):1085-1095.
  4. Brenner, M. and Nebel, B. (2009). Continual planning and acting in dynamic multiagent environments. Autonomous Agents and Multi-Agent Systems, 19(3):297-331.
  5. Burgard, W., Cremers, A., Fox, D., Hähnel, D., Lakemeyer, G., Schulz, D., Steiner, W., and Thrun, S. (1999). Experiences with an interactive museum tour-guide robot. Artificial Intelligence, 114(1-2):3-55.
  6. Chen, D. L. and Mooney, R. J. (2011). Learning to interpret natural language navigation instructions from observations. In Proceedings of the 25th National Conference on Artificial Intelligence (AAAI-11), pages 859- 865.
  7. Chen, X., Ji, J., Jiang, J., Jin, G., and Wang, F. (2010). Developing high-level cognitive functions for service robots. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS-10), pages 989-996.
  8. Chen, X., Xie, J., Ji, J., and Sui, Z. (2012). Toward open knowledge enabling for human-robot interaction. Journal of Human-Robot Interaction, 1(2):100- 117.
  9. Ferraris, P. (2007). A logic program characterization of causal theories. In Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI-07), pages 366-371.
  10. Galindo, C., Fernández-Madrigal, J., González, J., and Saffiotti, A. (2008). Robot task planning using semantic maps. Robotics and Autonomous Systems, 56(11):955-966.
  11. Gebser, M., Kaminski, R., Kaufmann, B., Ostrowski, M., Schaub, T., and Thiele, S. (2008). Engineering an Incremental ASP Solver. In Proceedings of the 24th International Conference on Logic Programming (ICLP-08), pages 190-205.
  12. Ghallab, M., Howe, A., Christianson, D., McDermott, D., Ram, A., Veloso, M., Weld, D., and Wilkins, D. (1998). Pddl-the planning domain definition language. AIPS98 planning committee, 78(4):1-27.
  13. Gupta, R. and Hennacy, K. (2005). Commonsense reasoning about task instructions. In Proceedings of the AAAI-05 Workshop on modular construction of human-like intelligence, pages 05-08.
  14. Johnston, B. and Williams, M.-A. (2008). Comirit: Commonsense reasoning by integrating simulation and logic. Frontiers in Artificial Intelligence and Applications, 171:200-211.
  15. Kress-Gazit, H., Fainekos, G. E., and Pappas, G. J. (2007). From structured english to robot motion. In Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-07), pages 2717-2722. IEEE.
  16. Levesque, H. J., Reiter, R., Lesperance, Y., Lin, F., and Scherl, R. B. (1997). Golog: A logic programming language for dynamic domains. The Journal of Logic Programming, 31(1):59-83.
  17. MacMahon, M., Stankiewicz, B., and Kuipers, B. (2006). Walk the talk: connecting language, knowledge, and action in route instructions. In Proceedings of the 21st national conference on Artificial intelligence (AAAI06), pages 1475-1482. AAAI Press.
  18. McCain, N. and Turner, H. (1997). Causal theories of action and change. In Proceedings of the 14th National Conference on Artificial Intelligence (AAAI-97), pages 460-465.
  19. McDermott, D. (1992). Robot planning. AI magazine, 13(2):55-79.
  20. Rybski, P., Yoon, K., Stolarz, J., and Veloso, M. (2007). Interactive robot task training through dialog and demonstration. In Proceedings of the 2nd ACM/IEEE international conference on Human-robot interaction (HRI-07), pages 49-56. ACM.
  21. Son, T. C., Baral, C., and McIlraith, S. A. (2001). Planning with different forms of domain-dependent control knowledge - an answer set programming approach. In Proceedings of the 6th International Conference on Logic Programming and Nonmonotonic Reasoning (LPNMR-01), pages 226-239.
  22. Tellex, S., Kollar, T., Dickerson, S., Walter, M., Banerjee, A. G., Teller, S., and Roy, N. (2011). Understanding natural language commands for robotic navigation and mobile manipulation. In Proceedings of the 25th National Conference on Artificial Intelligence (AAAI11).
  23. Tenbrink, T., Ross, R. J., Thomas, K. E., Dethlefs, N., and Andonova, E. (2010). Route instructions in mapbased human-human and human-computer dialogue: A comparative analysis. Journal of Visual Languages & Computing, 21(5):292-309.
  24. Tenorth, M., Nyga, D., and Beetz, M. (2010). Understanding and executing instructions for everyday manipulation tasks from the world wide web. In 2010 IEEE International Conference on Robotics and Automation (ICRA-10), pages 1486-1491. IEEE.
  25. Thielscher, M. (2005). Flux: A logic programming method for reasoning agents. Theory and Practice of Logic Programming, 5(4-5):533-565.
  26. Vogt, P. (2006). Language evolution and robotics: Issues on symbol grounding. Artificial cognition systems, pages 145-173.
  27. Xie, J., Chen, X., Ji, J., and Sui, Z. (2012). Multi-mode natural language processing for extracting open knowledge. In Proceedings of the 2012 IEEE/WIC/ACM International Conferences on Intelligent Agent Technology (IAT-12).
Download


Paper Citation


in Harvard Style

Ji J. and Chen X. (2013). From Structured Task Instructions to Robot Task Plans . In Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2013) ISBN 978-989-8565-81-5, pages 237-244. DOI: 10.5220/0004545402370244


in Bibtex Style

@conference{keod13,
author={Jianmin Ji and Xiaoping Chen},
title={From Structured Task Instructions to Robot Task Plans},
booktitle={Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2013)},
year={2013},
pages={237-244},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004545402370244},
isbn={978-989-8565-81-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2013)
TI - From Structured Task Instructions to Robot Task Plans
SN - 978-989-8565-81-5
AU - Ji J.
AU - Chen X.
PY - 2013
SP - 237
EP - 244
DO - 10.5220/0004545402370244