INVESTIGATING MARKOV LOGIC NETWORKS FOR COLLECTIVE CLASSIFICATION

Robert Crane, Luke K. McDowell

2012

Abstract

Collective Classification (CC) is the process of simultaneously inferring the class labels of a set of inter-linked nodes, such as the topic of publications in a citation graph. Recently, Markov Logic Networks (MLNs) have attracted significant attention because of their ability to combine first order logic with probabilistic reasoning. A few authors have used this ability of MLNs in order to perform CC over linked data, but the relative advantages of MLNs vs. other CC techniques remains unknown. In response, this paper compares a wide range of MLN learning and inference algorithms to the best previously studied CC algorithms. We find that MLN accuracy is highly dependent on the type of learning and the input rules that are used, which is not unusual given MLNs’ flexibility. More surprisingly, we find that even the best MLN performance generally lags that of the best previously studied CC algorithms. However, MLNs do excel on the one dataset that exhibited the most complex linking patterns. Ultimately, we find that MLNs may be worthwhile for CC tasks involving data with complex relationships, but that MLN learning for such data remains a challenge.

References

  1. Chakrabarti, S., Dom, B., and Indyk, P. (1998). Enhanced hypertext categorization using hyperlinks. In Proc. of the ACM SIGMOD International Conference on Management of Data.
  2. Chechetka, A., Dash, D., and Philipose, M. (2010). Relational learning for collective classification of entities in images. In AAAI-10 Workshop on Statistical Relat. AI.
  3. Crane, R. and McDowell, L. K. (2011). Evaluating markov logic networks for collective classification. In Proc. of the 9th MLG Workshop at the 17th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.
  4. Dhurandhar, A. and Dobra, A. (2010). Collective vs independent classification in statistical relational learning. In Submitted for publication.
  5. Gallagher, B., Tong, H., Eliassi-Rad, T., and Faloutsos, C. (2008). Using ghost edges for classification in sparsely labeled networks. In Proceeding of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.
  6. Huynh, T. and Mooney, R. (2009). Max-margin weight learning for markov logic networks. In Proc. of the European Conf. on Machine Learning and Knowledge Discovery in Databases, ECML PKDD.
  7. Jensen, D., Neville, J., and Gallagher, B. (2004). Why collective inference improves relational classification. In Proc. of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.
  8. Kok, S. and Domingos, P. (2010). Learning markov logic networks using structural motifs. In Proc. of the 27th International Conference on Machine Learning.
  9. Kok, S., Sumner, M., Richardson, M., Singla, P., Poon, H., and Domingos, P. (2006). The Alchemy system for statistical relational AI (Technical Report). Department of Computer Science and Engineering, University of Washington, Seattle, WA.
  10. Lin, F. and Cohen, W. W. (2010). Semi-supervised classification of network data using very few labels. In Proc. of the Int. Conference on Advances in Social Network Analysis and Mining (ASONAM).
  11. Lowd, D. and Domingos, P. (2007). Efficient weight learning for markov logic networks. In In Proc. of the Eleventh European Conference on Principles and Practice of Knowledge Discovery in Databases.
  12. Macskassy, S. and Provost, F. (2007). Classification in networked data: A toolkit and a univariate case study. Journal of Machine Learning Research, 8:935-983.
  13. McDowell, L., Gupta, K., and Aha, D. (2009). Cautious collective classification. The Journal of Machine Learning Research, 10:2777-2836.
  14. McDowell, L. K., Gupta, K. M., and Aha, D. W. (2007). Cautious inference in collective classification. In Proc. of the 22nd AAAI Conference on Artificial Intelligence.
  15. Mihalkova, L. and Mooney, R. (2007). Bottom-up learning of Markov logic network structure. In Proc. of the 24th International Conference on Machine Learning.
  16. Mihalkova, L., Moustafa, W., and Getoor, L. (2011). Learning to predict web collaborations. In Workshop on User Modeling for Web Applications (UMWA-11).
  17. Neville, J. and Jensen, D. (2000). Iterative classification in relational data. In AAAI Workshop on Learning Statistical Models from Relational Data.
  18. Neville, J. and Jensen, D. (2007). Relational dependency networks. Journal of Machine Learning Research, 8:653-692.
  19. Poon, H. and Domingos, P. (2006). Sound and efficient inference with probabilistic and deterministic dependencies. In Proc. of the 21st AAAI Conference on Artificial Intelligence.
  20. Richardson, M. and Domingos, P. (2006). Markov logic networks. Machine Learning, 62(1-2):107-136.
  21. Riedel, S. and Meza-Ruiz, I. (2008). Collective semantic role labelling with markov logic. In Proc. of the Twelfth Conference on Computational Natural Language Learning, CoNLL 7808.
  22. Sen, P., Namata, G., Bilgic, M., Getoor, L., Gallagher, B., and Eliassi-Rad, T. (2008). Collective classification in network data. AI Magazine, Special Issue on AI and Networks, 29(3):93-106.
  23. Singla, P. and Domingos, P. (2005). Discriminative training of Markov logic networks. In Proc. of the National Conference on Artificial Intelligence.
Download


Paper Citation


in Harvard Style

Crane R. and K. McDowell L. (2012). INVESTIGATING MARKOV LOGIC NETWORKS FOR COLLECTIVE CLASSIFICATION . In Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-8425-95-9, pages 5-15. DOI: 10.5220/0003702600050015


in Bibtex Style

@conference{icaart12,
author={Robert Crane and Luke K. McDowell},
title={INVESTIGATING MARKOV LOGIC NETWORKS FOR COLLECTIVE CLASSIFICATION},
booktitle={Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2012},
pages={5-15},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003702600050015},
isbn={978-989-8425-95-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - INVESTIGATING MARKOV LOGIC NETWORKS FOR COLLECTIVE CLASSIFICATION
SN - 978-989-8425-95-9
AU - Crane R.
AU - K. McDowell L.
PY - 2012
SP - 5
EP - 15
DO - 10.5220/0003702600050015