{"id":197,"date":"2016-12-12T21:34:09","date_gmt":"2016-12-12T20:34:09","guid":{"rendered":"http:\/\/liacs.leidenuniv.nl\/~kraaijw\/?p=197"},"modified":"2016-12-12T21:35:15","modified_gmt":"2016-12-12T20:35:15","slug":"knowledge-based-query-expansion-complex-multimedia-event-detection","status":"publish","type":"post","link":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/2016\/12\/12\/knowledge-based-query-expansion-complex-multimedia-event-detection\/","title":{"rendered":"Knowledge based query expansion in complex multimedia event detection"},"content":{"rendered":"<div class=\"article-enumeration full-width\">\n<p><a title=\"Multimedia Tools and Applications\" href=\"http:\/\/link.springer.com\/journal\/11042\"><span class=\"JournalTitle\"><u><span style=\"color: #0066cc;\">Multimedia Tools and Applications<\/span><\/u><\/span><\/a><\/p>\n<p class=\"icon--meta-keyline-before\"><span class=\"ArticleCitation_Year\"><time>August 2016<\/time>, <\/span><span class=\"ArticleCitation_Volume\">Volume 75, <\/span><a class=\"ArticleCitation_Issue\" title=\"Issue 15\" href=\"http:\/\/link.springer.com\/journal\/11042\/75\/15\/page\/1\"><u><span style=\"color: #0066cc;\">Issue\u00a015<\/span><\/u><\/a>, <span class=\"ArticleCitation_Pages\"> pp 9025\u20139043<\/span><\/p>\n<\/div>\n<div class=\"MainTitleSection\">\n<h1 class=\"ArticleTitle\" lang=\"en\">Knowledge based query expansion in complex multimedia event detection<\/h1>\n<\/div>\n<div class=\"authors u-clearfix authors--enhanced\" data-component=\"SpringerLink-Authors\">\n<div id=\"authors\" class=\"authors__list\" data-role=\"AuthorsList\">\n<ul>\n<li><span class=\"authors__name\">Maaike\u00a0de\u00a0Boer<\/span><\/li>\n<li><span class=\"authors__name\">Klamer\u00a0Schutte<\/span><\/li>\n<li><span class=\"affiliation__item\"><span class=\"affiliation__country\">Wessel Kraaij<\/span><\/span><\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"article-context__container\" data-component=\"SpringerLink-ArticleMetrics\">\n<div class=\"article-context__primary\">\n<p><span id=\"open-choice-icon\" class=\"open-access\"><abbr title=\"This content is freely available to anyone, anywhere, at any time\">Open Access<\/abbr><\/span>Article<\/p>\n<div class=\"article-dates article-dates--enhanced\" data-component=\"SpringerLink-ArticleDates\">\n<dl>\n<dt>First Online:<\/dt>\n<dd class=\"article-dates__first-online\"><a class=\"gtm-first-online\" href=\"http:\/\/link.springer.com\/article\/10.1007\/s11042-015-2757-4#article-dates-history\"><u><span style=\"color: #0066cc;\">12 July 2015<\/span><\/u><\/a><\/dd>\n<\/dl>\n<div id=\"article-dates-history\">\n<dl class=\"article-dates__history\">\n<dt>Received:<\/dt>\n<dd><time datetime=\"2014-11-28\">28 November 2014<\/time><\/dd>\n<dt>Revised:<\/dt>\n<dd><time datetime=\"2015-04-28\">28 April 2015<\/time><\/dd>\n<dt>Accepted:<\/dt>\n<dd><time datetime=\"2015-06-16\">16 June 2015<\/time><\/dd>\n<\/dl>\n<\/div>\n<\/div>\n<p class=\"article-doi\"><abbr title=\"Digital Object Identifier\">DOI<\/abbr>: 10.1007\/s11042-015-2757-4<\/p>\n<\/div>\n<dl class=\"article-cite\">\n<dt>Cite this article as:<\/dt>\n<dd id=\"citethis-text\">de Boer, M., Schutte, K. &amp; Kraaij, W. Multimed Tools Appl (2016) 75: 9025. doi:10.1007\/s11042-015-2757-4<\/dd>\n<\/dl>\n<\/div>\n<p align=\"LEFT\">A common approach in content based video information retrieval is to perform automatic shot annotation with semantic labels using pre-trained classifiers. The visual vocabulary of state-of-the-art automatic annotation systems is limited to a few thousand concepts, which creates a semantic gap between the semantic labels and the natural language query. One of the methods to bridge this semantic gap is to expand the original user query using knowledge bases. Both common knowledge bases such as Wikipedia and expert knowledge bases such as a manually created ontology can be used to bridge the semantic gap. Expert knowledge bases have highest performance, but are only available in closed domains. Only in closed domains all necessary information, including structure and disambiguation, can be made available in a knowledge base. Common knowledge bases are often used in open domain, because it covers a lot of general information. In this research, query expansion using common knowledge bases ConceptNet and Wikipedia is compared to an expert description of the topic applied to content-based information retrieval of complex events. We run experiments on the Test Set of TRECVID MED 2014. Results show that 1) Query Expansion can improve performance compared to using no query expansion in the case that the main noun of the query could not be matched to a concept detector; 2) Query expansion using expert knowledge is not necessarily better than query expansion using common knowledge; 3) ConceptNet performs slightly better than Wikipedia; 4) Late fusion can slightly improve performance. To conclude, query expansion has potential in complex event detection.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Multimedia Tools and Applications August 2016, Volume 75, Issue\u00a015, pp 9025\u20139043 Knowledge based query expansion in complex multimedia event detection Maaike\u00a0de\u00a0Boer Klamer\u00a0Schutte Wessel Kraaij Open AccessArticle First Online: 12 July 2015 Received: 28 November 2014 Revised: 28 April 2015 Accepted: 16 June 2015 DOI: 10.1007\/s11042-015-2757-4 Cite this article as: de Boer, M., Schutte, K. &amp; [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[15,14,13],"class_list":["post-197","post","type-post","status-publish","format-standard","hentry","category-publication","tag-query-expansion","tag-trecvid","tag-video"],"_links":{"self":[{"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/posts\/197","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/comments?post=197"}],"version-history":[{"count":2,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/posts\/197\/revisions"}],"predecessor-version":[{"id":199,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/posts\/197\/revisions\/199"}],"wp:attachment":[{"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/media?parent=197"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/categories?post=197"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/liacs.leidenuniv.nl\/~kraaijw\/index.php\/wp-json\/wp\/v2\/tags?post=197"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}