Cloud Testing for Mobile Software Systems - Concept and Prototyping

Oleksii Starov, Sergiy Vilkomir, Vyacheslav Kharchenko


This paper describes an approach for increasing the effectiveness of mobile software system testing. A Cloud Testing of Mobile Systems (CTOMS) framework is presented in the form of a cloud service that provides the ability to run tests on a variety of remote mobile devices. This framework is based on a heterogeneous networked system that connects operational computers, mobile devices, and databases with software applications. Our research focuses on building a concept and a prototype of CTOMS that supports testing Android mobile applications in the cloud. CTOMS allows multidirectional testing, providing the opportunities to test an application on different devices and/or operating system (OS) versions and new device models for their compatibility with the newest OS versions and the most popular applications. Another new aspect is to embed the test model, specifically the appropriate testing techniques for mobile development, within the framework. For users, this model will provide suggestions from CTOMS about the test methods, criteria, coverage, and possible test cases. These suggestions are based on available configurations, statistics, and resource constraints.


  1. Android Developers, 2013. Dashboards. Available at:
  2. Android SDK, 2013. Available at: http://developer.
  3. AndroidViewClient, 2013. Extension to MonkeyRunner. Available at: ViewClient
  4. Bank of America, 2013. Mobile Banking. Available at: https:// mobile.go
  5. Carr, D. F. 2012. Hurricane Sandy: Mobile, Social Tools Help Emergency Management, Brainyardnews (Oct. 2012). Available at: http://www.informationweek. com/thebrainyard/news/social_media_monitoring/240 012463/hurricane-sandy-mobile-social-tools-helpemergency-management
  6. Chilenski, J. J., Miller, S., 1994. Applicability of Modified Condition/Decision Coverage to Software Testing, Software Engineering Journal, Sept. 1994, 193-200.
  7. Coulouris, G., Dollimore, J., Kindberg, T., Blair, G., 2011. Distributed Systems: Concepts and Design, Addison-Wesley. 5nd edition.
  8. Crittercism, 2013. Available at: https://www.
  9. Fidelman, M., 2012. The Latest Infographics: Mobile Business Statistics For 2012. Available at: http://
  10. Geron, T. 2012. Do iOS Apps Crash More Than Android Apps? A Data Dive. Available at: oes-ios-crash-more-than-android-a-data-dive/
  11. Google App Engine, 2013. Developers portal. Available at:
  12. Haselton, T., 2012. Android Has 56.1% Of Global OS Market Share, Gartner Says. Available at:
  13. Hu, C., Neamtiu, I., 2011. Automating GUI testing for Android applications. In Proceedings of the AST 7811, 6th International Workshop on Automation of Software Test. ACM New York, NY, USA, 77-83.
  14. Inçki, K., Ari, I., Sozer, H., 2012. A Survey of Software Testing in the Cloud. In Proceedings of 2012 IEEE Sixth International Conference on Software Security and Reliability Companion. 18-23.
  15. Jacobson, D., Brail, G., Woods, D., 2011. APIs: A Strategy Guide. O'Reilly Media, Inc., 60-70.
  16. Jenkins, W., Vilkomir, S., Sharma, P., Pirocanac, G., 2011. Framework for Testing Cloud Platforms and Infrastructures. In Proceedings of the CSC 2011, International Conference on Cloud and Service Computing, Hong Kong, China, Dec. 12-14, 2011, 134-140.
  17. Keynote DeviceAnywhere, 2013. The Mobile Testing Platform. Available at: http://www.keynotedevice
  18. Kharchenko, V., Siora, O., Sklyar, V., 2009. Design and testing technique of FPGA-based critical systems. In Proceedings of CADSM 2009, 10th International Conference - The Experience of Designing and Application of CAD Systems in Microelectronics (Polyana-Svalyava, Ukraine, Feb. 24-28, 2009, 305- 314.
  19. Konstantinidis, A., Costa, C., Larkou, G., ZeinalipourYazti, D., 2012. Demo: a programming cloud of smartphones. In Proceedings of the MobiSys 7812, 10th international conference on Mobile systems, applications, and services.. ACM New York, NY, USA, 465-466.
  20. Kuhn, R., Kacker, R., Lei, Y., Hunter, J., 2009. Combinatorial Software Testing, IEEE Computer. Volume 42, Number 8, Aug. 2009, 94-96.
  21. Kuhn, R., Kacker, R. N., Lei, Y., 2010. Practical Combinatorial Testing, NIST Special Publication, October, 2010.
  22. Lei, Y., Kacker, R., Kuhn, D. R., Okun, V., Lawrence, J., 2007. IPOG: A General Strategy for T-Way Software Testing. In Proceeding of ECBS 7807, IEEE Engineering of Computer Based Systems conference, March 2007, 549-556.
  23. Leijdekkers, Gay, V. 2006. Personal Heart Monitoring and Rehabilitation System using Smart Phones. In Proceedings of the International Conference on Mobile Business. Citeseer, 29.
  24. Mahmood, R., Esfahani, N., Kacem, T., Mirzaei, N., Malek, S., Stavrou, A., 2012. A whitebox approach for automated security testing of Android applications on the cloud. In Proceedings of AST 2012, Automation of Software Test, 7th International Workshop.
  25. Maji, K., 2010. Characterizing Failures in Mobile OSes: A Case Study with Android and Symbian. In Software Reliability Engineering (ISSRE) 21st International Symposium.
  26. MonkeyRunner, 2013, Android SDK tool. _concepts.html
  27. Moser K., 2012. Improving Work Processes for Nuclear Plants (Exelon Nuclear). In American Nuclear Society Utility Working Conference 2012.
  28. NIST, 2013. ACTS tool. Available at: groups/SNS/acts/download
  29. Perfecto Mobile, 2013. The MobileCloud Company. Available at:
  30. Priyanka, Chana, I., Rana, A., 2012. Empirical evaluation of cloud-based testing techniques: a systematic review, ACM SIGSOFT Software Engineering Notes archive. Volume 37, Issue 3, May 2012, ACM New York, NY, USA, 1-9.
  31. Rhoton, J., Haukioja, R., 2011. Cloud Computing Architected: Solution Design Handbook, Publisher: Recursive, Limited, ISBN: 0956355617.
  32. Ridene, Y., Barbier, F., 2011 A model-driven approach for automating mobile applications testing. In Proceedings of the 5th European Conference on Software Architecture: Companion Volume Article No. 9.
  33. Rowinski D., 2012. Mobile Carriers and OEMs Get Android App Testing Cloud from Apkudo, ReadWrite (February 7, 2012). Available at: http://
  34. Tilley, S., Parveen, T., 2012. Software Testing in the Cloud: Perspectives on an Emerging Discipline, Information Science Reference, Nov. 2012.
  35. Twitter, 2013. Application for Android. Available at:
  36. uTest, Inc., 2013. The Essential Guide to Mobile App Testing (free eBook) Available at: http://www.
  37. ViewServer, 2013. Available at: https://github. com/romainguy/ViewServer
  38. Vilkomir, S., 2012. Cloud Testing: A State-of-the-Art Review, Information & Security: An International Journal. Volume 28, Issue 2, Number 17, 2012, 213- 222.
  39. Vilkomir, S., Bowen, J. P., 2006. From MC/DC to RC/DC: formalization and analysis of control-flow testing criteria, Formal aspects of computing, Volume 18, Number 1, 2006, 42-62.
  40. White, J., Clarke, S., Dougherty, B., Thompson, C., and Schmidt, D. 2010. R&D Challenges and Solutions for Mobile Cyber-Physical Applications and Supporting Internet Services. Springer Journal of Internet Services and Applications. Volume 1, Number 1 (2010), 45-56.
  41. Windows Phone Dev Center, 2013. Testing Apps for Windows Phone. Available at: com/library/windowsphone/develop/jj247547(v=vs.10 5).aspx
  42. Work, D. B., Bayen, A. M., 2008. Impacts of the Mobile Internet on Transportation Cyberphysical Systems: Traffic Monitoring using Smartphones. In Proceedings of National Workshop for Research on High-Confidence Transportation Cyber-Physical Systems: Automotive, Aviation and Rail, Washington, DC, Nov. 18-20, 2008.

Paper Citation

in Harvard Style

Starov O., Vilkomir S. and Kharchenko V. (2013). Cloud Testing for Mobile Software Systems - Concept and Prototyping . In Proceedings of the 8th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2013) ISBN 978-989-8565-68-6, pages 124-131. DOI: 10.5220/0004416101240131

in Bibtex Style

author={Oleksii Starov and Sergiy Vilkomir and Vyacheslav Kharchenko},
title={Cloud Testing for Mobile Software Systems - Concept and Prototyping},
booktitle={Proceedings of the 8th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2013)},

in EndNote Style

JO - Proceedings of the 8th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2013)
TI - Cloud Testing for Mobile Software Systems - Concept and Prototyping
SN - 978-989-8565-68-6
AU - Starov O.
AU - Vilkomir S.
AU - Kharchenko V.
PY - 2013
SP - 124
EP - 131
DO - 10.5220/0004416101240131