Supervised Matrix Factorization Hashing for Cross-Modal Retrieval

Tang, Jun, Wang, Ke and Shao, Ling (2016) Supervised Matrix Factorization Hashing for Cross-Modal Retrieval. IEEE Transactions on Image Processing, 25 (7). pp. 3157-3166. ISSN 1057-7149

Full text not available from this repository. (Request a copy)

Abstract

The target of cross-modal hashing is to embed heterogeneous multimedia data into a common low-dimensional Hamming space, which plays a pivotal part in multimedia retrieval due to the emergence of big multimodal data. Recently, matrix factorization has achieved great success in cross-modal hashing. However, how to effectively use label information and local geometric structure is still a challenging problem for these approaches. To address this issue, we propose a cross-modal hashing method based on collective matrix factorization, which considers both the label consistency across different modalities and the local geometric consistency in each modality. These two elements are formulated as a graph Laplacian term in the objective function, leading to a substantial improvement on the discriminative power of latent semantic features obtained by collective matrix factorization. Moreover, the proposed method learns unified hash codes for different modalities of an instance to facilitate cross-modal search, and the objective function is solved using an iterative strategy. The experimental results on two benchmark data sets show the effectiveness of the proposed method and its superiority over state-of-the-art cross-modal hashing methods.

Item Type:	Article
Uncontrolled Keywords:	Cross-modal hashing, collective matrix factorization, label consistency, local geometric consistency, multimedia retrieval
Subjects:	G400 Computer Science
Department:	Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User:	Becky Skoyles
Date Deposited:	17 Jun 2016 09:32
Last Modified:	12 Oct 2019 22:52
URI:	http://nrl.northumbria.ac.uk/id/eprint/27130

Downloads