NEMO - A Network Monitoring Framework for High-performance Computing

Elio Pérez Calle

2010

Abstract

The volume of data generated by the Large Hadron Collider (LHC), several PetaBytes (PB) per year, requires a distributed tier-organised structure of computing resources for mass storage and analysis. The complexity and diversity of the components of this structure (hardware, software and networks) require a control mechanism to guarantee high-throughput high-reliability computing services. NEMO is a monitoring framework that has been developed in one of the computing clusters that receive data from LHC and has been designed to measure and publish the state of a cluster resources, maximize performance and efficiency and guarantee the integrity of the cluster.

References

  1. Balabit (2010). The Syslog-ng Administration Guide. Balabit IT Security Ltd, 10th edition.
  2. Becker, J. (2008). Marching Penguins: Monitoring Your HPC Cluster. Linux Magazine.
  3. Berry, I. (2007). The Cacti Monitoring Tool. The Cacti Group, http://www.cacti.net.
  4. CERN (2008). Lemon: Large Hadron Collider Era Monitoring. http://lemon.web.cern.ch/lemon/index.shtml.
  5. CERN (2010). The Worldwide Large Hadron Collider Computing Grid project (WLCG). European Organisation for Nuclear Research, CERN. http://lcg.web.cern.ch/LCG/.
  6. Harrington, D. (2004). An Architecture for Describing Simple Network Management Protocol (SNMP) Management Frameworks. Internet Engineering Task Force Request for Comments 3411.
  7. Perez-Calle, E. (2004a). Using Nagios for Intrusion Detection. The International Conference on Computing in High Energy and Nuclear Physics, Interlaken, Switzerland.
  8. Perez-Calle, E. (2004b). Using Tripwire to Check Cluster System Integrity. The International Conference on Computing in High Energy and Nuclear Physics, Interlaken, Switzerland.
  9. Wartel, R. (2005). Security Monitoring. Second WLCG/ EGEE Grid Operations Workshop, Bologna, Italy.
Download


Paper Citation


in Harvard Style

Pérez Calle E. (2010). NEMO - A Network Monitoring Framework for High-performance Computing . In Proceedings of the International Conference on Data Communication Networking and Optical Communication Systems - Volume 1: DCNET, (ICETE 2010) ISBN 978-989-8425-25-6, pages 61-66. DOI: 10.5220/0002968700610066


in Bibtex Style

@conference{dcnet10,
author={Elio Pérez Calle},
title={NEMO - A Network Monitoring Framework for High-performance Computing},
booktitle={Proceedings of the International Conference on Data Communication Networking and Optical Communication Systems - Volume 1: DCNET, (ICETE 2010)},
year={2010},
pages={61-66},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002968700610066},
isbn={978-989-8425-25-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Data Communication Networking and Optical Communication Systems - Volume 1: DCNET, (ICETE 2010)
TI - NEMO - A Network Monitoring Framework for High-performance Computing
SN - 978-989-8425-25-6
AU - Pérez Calle E.
PY - 2010
SP - 61
EP - 66
DO - 10.5220/0002968700610066