Learning to rank images for complex queries in concept-based search

Cui, Chaoran, Shen, Jialie, Chen, Zhumin, Wang, Shuaiqiang and Ma, Jun (2018) Learning to rank images for complex queries in concept-based search. Neurocomputing, 274. pp. 19-28. ISSN 0925-2312

Full text not available from this repository.

Abstract

Concept-based image search is an emerging search paradigm that utilizes a set of concepts as intermediate semantic descriptors of images to bridge the semantic gap. Typically, a user query is rather complex and cannot be well described using a single concept. However, it is less effective to tackle such complex queries by simply aggregating the individual search results for the constituent concepts. In this paper, we propose to introduce the learning to rank techniques to concept-based image search for complex queries. With freely available social tagged images, we first build concept detectors by jointly leveraging the heterogeneous visual features. Then, to formulate the image relevance, we explicitly model the individual weight of each constituent concept in a complex query. The dependence among constituent concepts, as well as the relatedness between query and non-query concepts, are also considered through modeling the pairwise concept correlations in a factorization way. Finally, we train our model to directly optimize the image ranking performance for complex queries under a pairwise learning to rank framework. Extensive experiments on two benchmark datasets well verified the promise of our approach.

Item Type:	Article
Uncontrolled Keywords:	Concept-based image search, Complex query, Learning to rank, Factorization machine
Subjects:	G400 Computer Science
Department:	Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User:	Becky Skoyles
Date Deposited:	13 Aug 2018 10:54
Last Modified:	11 Oct 2019 19:45
URI:	http://nrl.northumbria.ac.uk/id/eprint/35284

Downloads