AUTOMATIC NAVIGATION AMONG MOBILE DTV SERVICES

Chengyuan Peng, Petri Vuorimaa

2004

Abstract

Limited number of input buttons on a mobile device, such as mobile phones and PDAs, restricts people’s access to digital broadcast services. In this paper, we present a reinforcement learning approach to automatically navigating among services in mobile digital television systems. Our approach uses standard Q-learning algorithm as a theory basis to predict next button for the user by learning usage patterns from interaction experiences. We did the experiment using a modified algorithm in test system. The experimental results demonstrate that the performance is good and the method is feasible and appropriate in practice.

References

  1. Dearden, R., Friedman N., and Russel, S., 1998. Bayesian Q-learning. American Association for Artificial Intelligence (AAAI), pp. 761-768.
  2. EyeTV 400, 2003. Digital video recorder: for digital terrestrial television (DVB-T), data sheet, available at http://www.elgato.com.
  3. Lieberman, H., Fry, C., and Weitzman, L., 2001. Exploring the Web with Reconnaissance Agents. Communications of the ACM, 44(8), pp. 70-75.
  4. Motivate, 2000. Using DVB-T standard to deliver broadcast Services to mobile receivers. Report TM2310, available at http://www.dvb.org/.
  5. Papudesi, V. N., and Huber, M., 2003. Learning from Reinforcement and Advice Using Composite Reward Functions. In Proceedings of the 16th International FLAIRS Conference, St. Augustine, FL, pp. 361-365.
  6. Peng, C., 2002. Digital Television Applications, Doctoral Dissertation, Helsinki University of Technology Press, Espoo.
  7. Pogrzeba, P., Burow, R., Faria, G., and Oliphant, A., 1999. Lab and field tests of mobile applications of DVB-T. Montreux Symposium 7899 Records, pp. 649-656.
  8. Sutton, R. S., and Barto, A.G., 1998. Reinforcement Learning: An Introduction. The MIT Press, Cambridge.
  9. Wiering, M., and Schmidhuber, J., 1998. Efficient Modelbased Exploration. In Proceedings of the 5th International Conference on Simulation of Adaptive Behavior: from Animals to Animats 5, Switzerland, pp. 223-228.
  10. EN 300 744, 2001. Digital Video Broadcasting (DVB); Framing structure, channel coding and modulation for digital terrestrial television. Specification, European Telecommunications Standards Institute.
  11. Reimers, U., 1998. Digital Video Broadcasting, IEEE communications Magazine, pp. 104-110.
Download


Paper Citation


in Harvard Style

Peng C. and Vuorimaa P. (2004). AUTOMATIC NAVIGATION AMONG MOBILE DTV SERVICES . In Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 5: ICEIS, ISBN 972-8865-00-7, pages 140-145. DOI: 10.5220/0002629501400145


in Bibtex Style

@conference{iceis04,
author={Chengyuan Peng and Petri Vuorimaa},
title={AUTOMATIC NAVIGATION AMONG MOBILE DTV SERVICES},
booktitle={Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 5: ICEIS,},
year={2004},
pages={140-145},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002629501400145},
isbn={972-8865-00-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 5: ICEIS,
TI - AUTOMATIC NAVIGATION AMONG MOBILE DTV SERVICES
SN - 972-8865-00-7
AU - Peng C.
AU - Vuorimaa P.
PY - 2004
SP - 140
EP - 145
DO - 10.5220/0002629501400145