Building the Monitoring Systems for Complex Distributed Systems: Problems and Solutions

Olga Korableva, Olga Kalimullina, Ekaterina Kurbanova

2017

Abstract

Complex distributed systems are of more significance nowadays, due to a broader range of its use and because of provision of better services to users. It is clear, that system health needs continuous monitoring, while running software apps that are ensuring the implementation of the business processes, working with Big Data, etc. In the course of this study a monitoring system has been developed. It meets all modern requirements, such as scalability, flexibility, comprehensiveness of necessary data and ease of use. In order to identify unified problems in development of monitoring systems for complex distributed systems and respectively - the solutions for their elimination, the data regarding IT-architecture most common types used in modern companies, related to fault-points of business apps has been gathered and analysed. All of identified problems and optimal solutions to eliminate them were aggregated in line with the three development stages of monitoring system, such as: development of servicing model for system-of-interest, implementing tools to detect objects of monitoring, generating a health map of system-of-interest. In order to develop monitoring systems for complex distributed systems taking into account the architecture of these systems, all of the gathered data was analysed, and we articulated all problems and optimal solutions for their elimination as well.

References

  1. Becker J., Kozyrev O., Babkin E., V. Taratoukhine, N. Aseeva. 2016. Emerging Trends in Information Systems: Recent Innovations, Results and Experiences. Springer Int. Publ., Switzerland, ISBN 978-3-319- 23929.
  2. Coulouris G., Dollimore J., Kindberg T., Blair G. 2013. Distributed Systems: Concepts and Design. Fifth edition. Addison-Wesley.
  3. Dourish P., Swinehart D., and Theimer M.. 2000. The Doctor Is In: Helping End Users Understand the Health of Distributed Systems. In Proc. of the IFIP/IEEE International Workshop on Distributed Systems: Operations and Management, December 2000.
  4. Ferdowsi M., Benigni A., Löwen A., McKeever P., Monti A., and Ponci F.. 2014. New Monitoring Approach for Distribution Systems. Proc. of 2014 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), 12-15 May 2014.
  5. Ferdowsi M., Zargar B., Ponci F. and Monti A.. 2014. Design Considerations for Artificial Neural Networkbased Estimators in Monitoring of Distribution Systems, 2014 IEEE International Workshop on Applied Measurements for Power Systems (AMPS 2014), (24-27 September 2014, Aachen, Germany).
  6. Guo, C.G., Zhu, J., Li, X.L. 2010. A Generic Software Monitoring Model and Features Analysis. Proc. of the 2010 Second International Conference on Networks Security, Wireless Communications and Trusted Computing, Washington DC, 2010, pp. 61-64.
  7. Joyce, J., Lomow, G., Slind, K., Unger, B. 1987. Monitoring Distributed System. ACM Transactions on Computer Systems, Vol. 5(2), pp. 121-150.
  8. Korableva, O., Guseva, M. 2015. Activation of innovation processes in banks as a result of the implementation of basic basel accord provisions. Ikonomicheski Izsledvania, Volume 24, No 3, pp. 108-128.
  9. Korableva O., Kalimullina O. 2014. The Formation of a single legal space as a prerequisite for overcoming systemic risk. Asian Social Science, Vol. 10 (21), 256- 260.
  10. Korableva, O., Kalimullina, O. 2016 a. An Innovative Approach to Strategic Risk Management in Banking: Russian Banks Case Study. WSEAS Transactions on Business and Economics, Volume 13, Art. #25, pp. 269-282.
  11. Korableva O., Kalimullina O. 2016 b. Strategic Approach to the Optimization of Organization Based on the BSC SWOT Matrix. Proceedings of the International Conference on Knowledge Engineering and Applications. ICKEA, 2016. Singapore, September 28-30, 2016. p. 212-215.
  12. Korableva O., Litun V. 2014. The potential of transitive economies' growth based on innovative strategy. WSEAS Transactions on Business and Economics. 11 (68), 725-736.
  13. Kshemkalyani, A.D., Singhal, M. 2008. Distributed Computing Principles, Algorithms, and Systems. Cambridge University Press.
  14. Latyshev, I. O., & Akhmetshin, E. M. 2015. Methodological approaches to analyzing the indicators of human capital management in the interests of innovation development of enterprise. International Business Management, 9(6), 1565-1570. doi:10.3923/ibm.2015.1565.1570.
  15. Yang, S.Y., Chang, Y.Y. 2011. An active and intelligent network management system with ontology based and multi agent techniques. Expert Systems with Applications, Vol. 38(8).
  16. Phuc, T.N.H., Son, L.V. 2012. Monitoring of large scale distributed systems based on SNMP development. The Journal of Science and Technology. Danang University, Vol. I(8), 2012, pp. 79-84.
  17. Phuc, T.N.H, Son, L.V. 2013. An Online Monitoring Solution for Complex Distributed Systems Based on Hierarchical Monitoring Agents. Springer Int. Publ. Proc. of the Fifth International Conference KSE 2013, Volume 1, pp. 187-198.
  18. Russom Ph.. 2013. Operational intelligence. Real-Time Business Analytics from Big Data. TDWI Che?klist Report. http://www.splunk.com/pdfs/white-papers/ real-time-business-analytics-from-big-data.pdf-3.
  19. Sambasivanm R., Fonseca, R., Shafer, I., and Ganger, G. 2014. So, you want to trace your distributed system? Key design insights from years of practical experience. CMU PDL Technical Report, CMU-PDL-14-102, April 2014.
  20. Sharma A., Chen H., Ding M., Yoshihira K., Jiang G.. 2013. Fault Detection and Localization in Distributed Systems using Invariant Relationships. 43rd Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 24-27 June 2013, pp. 1 - 8.
  21. Sigelman, B., Barroso, L., Burrows, M., Stephenson, P., Plakal, M., Beaver, D., Jaspan, S., and Shanbhag, C. 2010. Dapper, a large-scale distributed systems tracing infrastructure. Technical Report dapper-2010-1, Google, April.
  22. Sloman, M. 1994. Network and Distributed Systems Management. Addison Wesley.
  23. Son, L.V., Phuc, T.N.H. 2010. Researching on an online monitoring model for large-scale distributed systems. Proc. of the 13th National Conference in Information and Communication Technology, (Hungyen, Vietnam, 2010).
  24. Thakuriah, P., N. Tilahun and M. Zellner (2015). Big Data and Urban Informatics: Innovations and Challenges to Urban Planning and Knowledge Discovery. In Proc. of NSF Workshop on Big Data and Urban Informatics, pp. 4-32.
  25. Toporkov V., Toporkova A., Tselishchev A., Yemelyanov D., Potekhin P.. 2015. Metascheduling and heuristic co-allocation strategies in distributed computing. Computing and Informatics, Vol. 34 (1), pp. 45-76.
Download


Paper Citation


in Harvard Style

Korableva O., Kalimullina O. and Kurbanova E. (2017). Building the Monitoring Systems for Complex Distributed Systems: Problems and Solutions . In Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-248-6, pages 221-228. DOI: 10.5220/0006271002210228


in Bibtex Style

@conference{iceis17,
author={Olga Korableva and Olga Kalimullina and Ekaterina Kurbanova},
title={Building the Monitoring Systems for Complex Distributed Systems: Problems and Solutions},
booktitle={Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2017},
pages={221-228},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006271002210228},
isbn={978-989-758-248-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Building the Monitoring Systems for Complex Distributed Systems: Problems and Solutions
SN - 978-989-758-248-6
AU - Korableva O.
AU - Kalimullina O.
AU - Kurbanova E.
PY - 2017
SP - 221
EP - 228
DO - 10.5220/0006271002210228