• Complex
  • Title
  • Author
  • Keyword
  • Abstract
  • Scholars
Search

Author:

Cheng, De (Cheng, De.) | Jiang, Lu (Jiang, Lu.) | Gong, Yihong (Gong, Yihong.) | Zheng, Nanning (Zheng, Nanning.) | Hauptmann, Alexander G. (Hauptmann, Alexander G..)

Indexed by:

CPCI-S EI Scopus

Abstract:

This paper addresses the challenge of video search with only a handful query exemplars by proposing a triplet ranking network-based method. Based on the typical scenario for video search system, a user begins the query process by first utilizing the metadata-based text-to-video search module to find an initial set of videos of interest in the video repository. As bridging the semantic gap between text and video is very challenging, usually only a handful relevant videos appear in the initial retrieved results. The user now can use the video-to-video search module to train a new classifier to search more relevant videos. However, since we found that statistically only fewer than 5 videos are initially relevant, training a complex event classifier with a handful of examples is extremely challenging. Therefore, it is necessary to improve video retrieval method that works for a handful of positive training example videos. The proposed triplet ranking network is mainly designed for this situation and has the following properties: (1) This ranking network can learn an off-line similarity matching projection, which is event independent, from other previous video search tasks or datasets. Such that even with only one query video, we can search its relative videos. Then this method can transfer previous knowledge to the specific video retrieval tasks as more and more relative videos being retrieved, to further improve the retrieval performance; (2) It casts the video search task as a ranking problem, and can exploit partial ordering information in the dataset; (3) Based on the above two merits, this method is suitable for the case where only a handful of positive examples exploit. Experimental results show the effectiveness of our proposed method on video retrieval with only a handful of positive exemplars.

Keyword:

Few positives Knowledge adaptation Partially ordered Ranking network Video search

Author Community:

  • [ 1 ] [Cheng, De; Gong, Yihong; Zheng, Nanning] Xi An Jiao Tong Univ, Xian, Shaanxi, Peoples R China
  • [ 2 ] [Cheng, De; Jiang, Lu; Hauptmann, Alexander G.] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
  • [ 3 ] [Cheng, De]Xi An Jiao Tong Univ, Xian, Shaanxi, Peoples R China
  • [ 4 ] [Gong, Yihong]Xi An Jiao Tong Univ, Xian, Shaanxi, Peoples R China
  • [ 5 ] [Zheng, Nanning]Xi An Jiao Tong Univ, Xian, Shaanxi, Peoples R China
  • [ 6 ] [Cheng, De]Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
  • [ 7 ] [Jiang, Lu]Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
  • [ 8 ] [Hauptmann, Alexander G.]Carnegie Mellon Univ, Pittsburgh, PA 15213 USA

Reprint Author's Address:

  • Xi An Jiao Tong Univ, Xian, Shaanxi, Peoples R China.; Cheng, D (reprint author), Carnegie Mellon Univ, Pittsburgh, PA 15213 USA.

Show more details

Related Keywords:

Related Article:

Source :

MULTIMEDIA MODELING, MMM 2017, PT II

ISSN: 0302-9743

Year: 2017

Volume: 10133

Page: 419-430

Language: English

0 . 4 0 2

JCR@2005

JCR Journal Grade:2

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Affiliated Colleges:

FAQ| About| Online/Total:288/168409223
Address:XI'AN JIAOTONG UNIVERSITY LIBRARY(No.28, Xianning West Road, Xi'an, Shaanxi Post Code:710049) Contact Us:029-82667865
Copyright:XI'AN JIAOTONG UNIVERSITY LIBRARY Technical Support:Beijing Aegean Software Co., Ltd.