• Complex
  • Title
  • Author
  • Keyword
  • Abstract
  • Scholars
Search

Author:

Gao, Zhanning (Gao, Zhanning.) | Wang, Le (Wang, Le.) | Jojic, Nebojsa (Jojic, Nebojsa.) | Niu, Zhenxing (Niu, Zhenxing.) | Zheng, Nanning (Zheng, Nanning.) | Hua, Gang (Hua, Gang.)

Indexed by:

Scopus SCIE EI SCOPUS

Abstract:

IEEEA new unified video analytics framework (ER3) is proposed for complex event retrieval, recognition and recounting, based on the proposed video imprint representation, which exploits temporal correlations among image features across video frames. With the video imprint representation, it is convenient to reverse map back to both temporal and spatial locations in video frames, allowing for both key frame identification and key areas localization within each frame. In the proposed framework, a dedicated feature alignment module is incorporated for redundancy removal across frames to produce the tensor representation, i.e., the video imprint. Subsequently, the video imprint is individually fed into both a reasoning network and a feature aggregation module, for event recognition/recounting and event retrieval tasks, respectively. Thanks to its attention mechanism inspired by the memory networks used in language modeling, the proposed reasoning network is capable of simultaneous event category recognition and localization of the key pieces of evidence for event recounting. In addition, the latent structure in our reasoning network highlights the areas of the video imprint, which can be directly used for event recounting. With the event retrieval task, the compact video representation aggregated from the video imprint contributes to better retrieval results than existing state-of-the-art methods.

Keyword:

Event videos Feature aggregation Feature alignment Reasoning network

Author Community:

  • [ 1 ] [Gao, Zhanning; Wang, Le; Zheng, Nanning] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Shaanxi, Peoples R China
  • [ 2 ] [Jojic, Nebojsa; Hua, Gang] Microsoft Res, Redmond, WA 98052 USA
  • [ 3 ] [Niu, Zhenxing] Alibaba Grp, Hangzhou 311121, Zhejiang, Peoples R China
  • [ 4 ] [Gao, Zhanning]Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Shaanxi, Peoples R China
  • [ 5 ] [Wang, Le]Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Shaanxi, Peoples R China
  • [ 6 ] [Zheng, Nanning]Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Shaanxi, Peoples R China
  • [ 7 ] [Jojic, Nebojsa]Microsoft Res, Redmond, WA 98052 USA
  • [ 8 ] [Hua, Gang]Microsoft Res, Redmond, WA 98052 USA
  • [ 9 ] [Niu, Zhenxing]Alibaba Grp, Hangzhou 311121, Zhejiang, Peoples R China

Reprint Author's Address:

  • [Wang, Le]Xi'an Jiaotong University, Xi'an, Shaanxi; 710049, China;;

Email:

Show more details

Related Keywords:

Related Article:

Source :

IEEE Transactions on Pattern Analysis and Machine Intelligence

ISSN: 0162-8828

Year: 2019

Issue: 12

Volume: 41

Page: 3086-3099

1 7 . 8 6 1

JCR@2019

1 6 . 3 8 9

JCR@2020

ESI Discipline: ENGINEERING;

ESI HC Threshold:83

JCR Journal Grade:1

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

FAQ| About| Online/Total:472/168636213
Address:XI'AN JIAOTONG UNIVERSITY LIBRARY(No.28, Xianning West Road, Xi'an, Shaanxi Post Code:710049) Contact Us:029-82667865
Copyright:XI'AN JIAOTONG UNIVERSITY LIBRARY Technical Support:Beijing Aegean Software Co., Ltd.