Publications

Lukas Gienapp, Maik Fröbe, Matthias Hagen, and Martin Potthast. The Impact of Negative Relevance Judgments on NDCG. Proceedings of the 29th ACM International Conference on Information & Knowledge Management, 2037–2040, Association for Computing Machinery, New York, NY, USA, 2020. [PUMA: cumulated discounted evaluation, gain, information judgements, normalized relevance reliability, retrieval, stability] URL

Lukas Gienapp, Benno Stein, Matthias Hagen, and Martin Potthast. Estimating Topic Difficulty Using Normalized Discounted Cumulated Gain. Proceedings of the 29th ACM International Conference on Information & Knowledge Management, 2033–2036, Association for Computing Machinery, New York, NY, USA, 2020. [PUMA: cumulative difficulty discounted evaluation, gain, information normalized retrieval, topic] URL