{"id":206,"date":"2016-12-12T21:43:30","date_gmt":"2016-12-12T20:43:30","guid":{"rendered":"http:\/\/liacs.leidenuniv.nl\/~kraaijw\/?p=206"},"modified":"2017-01-17T20:46:03","modified_gmt":"2017-01-17T19:46:03","slug":"evaluation-context-aware-recommendation-systems-information-re-finding","status":"publish","type":"post","link":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/2016\/12\/12\/evaluation-context-aware-recommendation-systems-information-re-finding\/","title":{"rendered":"Evaluation of context-aware recommendation systems for information re-finding"},"content":{"rendered":"<h6 class=\"article-header__title\">Maya Sappelli, Suzan Verberne and Wessel Kraaij<\/h6>\n<div class=\"article-header__meta-info-container\">\n<ul id=\"header-meta-info-container\" class=\"article-header__meta-info-list\">\n<li class=\"article-header__meta-info-item\"><span class=\"article-header__meta-info-label\">First published: <\/span><time id=\"first-published-date\" class=\"article-header__meta-info-data\" datetime=\"2016-07\">July 2016<\/time><a class=\"article-header__meta-info-2nd-data js-publication-history\" href=\"http:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/asi.23717\/full#publication-history\"><u><span style=\"color: #0066cc;\">Full publication history<\/span><\/u><\/a><\/li>\n<li class=\"article-header__meta-info-item\"><span id=\"header-section-doi\" class=\"article-header__meta-info-label\">DOI: <\/span><span class=\"article-header__meta-info-data\">10.1002\/asi.23717<\/span><a class=\"article-header__meta-info-2nd-data analytics-view-citation js-module\" href=\"http:\/\/onlinelibrary.wiley.com\/enhanced\/exportCitation\/doi\/10.1002\/asi.23717\" data-module=\"fragment\"><u><span style=\"color: #0066cc;\">View\/save citation<\/span><\/u><\/a><\/li>\n<\/ul>\n<\/div>\n<hr \/>\n<section id=\"abstract\" class=\"article-section article-section--abstract\">\n<div class=\"article-section__content mainAbstract\">\n<h2 class=\"article-section__header\">Abstract<\/h2>\n<p>In this article we evaluate context-aware recommendation systems for information re-finding by knowledge workers. We identify 4 criteria that are relevant for evaluating the quality of knowledge worker support: context relevance, document relevance, prediction of user action, and diversity of the suggestions. We compare 3 different context-aware recommendation methods for information re-finding in a writing support task. The first method uses contextual prefiltering and content-based recommendation (CBR), the second uses the just-in-time information retrieval paradigm (JITIR), and the third is a novel network-based recommendation system where context is part of the recommendation model (CIA). We found that each method has its own strengths: CBR is strong at context relevance, JITIR captures document relevance well, and CIA achieves the best result at predicting user action. Weaknesses include that CBR depends on a manual source to determine the context and in JITIR the context query can fail when the textual content is not sufficient. We conclude that to truly support a knowledge worker, all 4 evaluation criteria are important. In light of that conclusion, we argue that the network-based approach the CIA offers has the highest robustness and flexibility for context-aware information recommendation.<\/p>\n<\/div>\n<\/section>\n","protected":false},"excerpt":{"rendered":"<p>Maya Sappelli, Suzan Verberne and Wessel Kraaij First published: July 2016Full publication history DOI: 10.1002\/asi.23717View\/save citation Abstract In this article we evaluate context-aware recommendation systems for information re-finding by knowledge workers. We identify 4 criteria that are relevant for evaluating the quality of knowledge worker support: context relevance, document relevance, prediction of user action, and [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-206","post","type-post","status-publish","format-standard","hentry","category-publication"],"_links":{"self":[{"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/posts\/206","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/comments?post=206"}],"version-history":[{"count":3,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/posts\/206\/revisions"}],"predecessor-version":[{"id":237,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/posts\/206\/revisions\/237"}],"wp:attachment":[{"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/media?parent=206"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/categories?post=206"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/tags?post=206"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}