Unsupervised t-Distributed Video Hashing and Its Deep Hashing Extension

Hao, Yanbin, Mu, Tingting, Goulermas, John Y, Jiang, Jianguo, Hong, Richang and Wang, Meng (2017) Unsupervised t-Distributed Video Hashing and Its Deep Hashing Extension. IEEE TRANSACTIONS ON IMAGE PROCESSING, 26 (11). pp. 5531-5544.

Text manuscript.pdf - Author Accepted Manuscript Download (2MB)

Abstract

In this paper, a novel unsupervised hashing algorithm, referred to as t-USMVH, and its extension to unsupervised deep hashing, referred to as t-UDH, are proposed to support large-scale video-to-video retrieval. To improve robustness of the unsupervised learning, the t-USMVH combines multiple types of feature representations and effectively fuses them by examining a continuous relevance score based on a Gaussian estimation over pairwise distances, and also a discrete neighbor score based on the cardinality of reciprocal neighbors. To reduce sensitivity to scale changes for mapping objects that are far apart from each other, Student t-distribution is used to estimate the similarity between the relaxed hash code vectors for keyframes. This results in more accurate preservation of the desired unsupervised similarity structure in the hash code space. By adapting the corresponding optimization objective and constructing the hash mapping function via a deep neural network, we develop a robust unsupervised training strategy for a deep hashing network. The efficiency and effectiveness of the proposed methods are evaluated on two public video collections via comparisons against multiple classical and the state-of-the-art methods.

Item Type:	Article
Uncontrolled Keywords:	Video retrieval, hashing, deep neural network, multi-view learning, unsupervised learning, Student t-distribution
Depositing User:	Symplectic Admin
Date Deposited:	30 Aug 2017 09:05
Last Modified:	19 Jan 2023 06:56
DOI:	10.1109/TIP.2017.2737329
Related URLs:	Author Publisher
URI:	https://livrepository.liverpool.ac.uk/id/eprint/3009162