D-RANK: A FRAMEWORK FOR SCORE AGGREGATION IN SPECIALIZED SEARCH

Martin Veselý, Martin Rajman, Jean-Yves Le Meur, Ludmila Marian, Jérôme Caffaro

Abstract

In this paper we present an approach to score aggregation for specialized search systems. In our work we focus on document ranking in scientific publication databases. We work with the collection of scientific publications of the CERN Document Server. This paper reports on work in progress and describes rank aggregation framework with score normalization. We present results that we obtained with aggregations based on logistic regression using both ranks and scores. In our experiment we concluded that score-based aggregation favored performance in terms of Average Precision and Mean Reciprocal Rank, while rank-based aggregation favored document discovery.

References

  1. Craswell, N., Hawking, D., and Thistlewaite, P. B. (1999). Merging results from isolated search engines. In Australasian Database Conference, pages 189-200.
  2. Garcin, F., Faltings, B., and Jurca, R. (2009). Aggregating reputation feedback. In Paolucci, M., editor, 1st International Conference on Reputation (ICORE), pages 62-74, http://www.reputation09.net.
  3. Gentil-Beccot, A., Mele, S., Holtkamp, A., O'Connell, H. B., and Brooks, T. C. (2008). Information resources in high-energy physics: Surveying the present landscape and charting the future course. J. Am. Soc. Inf. Sci. Technol., 60(arXiv:0804.2701.):150-160. 27 p.
  4. Jacques Savoy, A. L. C. and Vrajitoru., D. (1996). Report on the trec-5 experiment: Data fusion and collection fusion.
  5. Le Calvé, A. and Savoy, J. (2000). Database merging strategy based on logistic regression. Inf. Process. Manage., 36(3):341-359.
  6. Vesely, M. and Rajman, M. (2009). Rank Aggregation in Scientific Publication Databases Based on Logistic Regression. Technical report.
  7. Voorhees, E. (2002). The philosophy of information retrieval evaluation. In In Proceedings of the The Second Workshop of the Cross-Language Evaluation Forum on Evaluation of Cross-Language Information Retrieval Systems, pages 355-370. Springer-Verlag.
  8. Yilmaz, E., Aslam, J. A., and Robertson, S. (2008). A new rank correlation coefficient for information retrieval. In SIGIR, pages 587-594.
Download


Paper Citation


in Harvard Style

Veselý M., Rajman M., Le Meur J., Marian L. and Caffaro J. (2011). D-RANK: A FRAMEWORK FOR SCORE AGGREGATION IN SPECIALIZED SEARCH . In Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-8425-40-9, pages 482-485. DOI: 10.5220/0003293404820485


in Bibtex Style

@conference{icaart11,
author={Martin Veselý and Martin Rajman and Jean-Yves Le Meur and Ludmila Marian and Jérôme Caffaro},
title={D-RANK: A FRAMEWORK FOR SCORE AGGREGATION IN SPECIALIZED SEARCH},
booktitle={Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2011},
pages={482-485},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003293404820485},
isbn={978-989-8425-40-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - D-RANK: A FRAMEWORK FOR SCORE AGGREGATION IN SPECIALIZED SEARCH
SN - 978-989-8425-40-9
AU - Veselý M.
AU - Rajman M.
AU - Le Meur J.
AU - Marian L.
AU - Caffaro J.
PY - 2011
SP - 482
EP - 485
DO - 10.5220/0003293404820485