• Complex
  • Title
  • Author
  • Keyword
  • Abstract
  • Scholars
Search

Author:

Li, Weijian (Li, Weijian.) | Huang, Di (Huang, Di.) | Li, Huibin (Li, Huibin.) | Wang, Yunhong (Wang, Yunhong.)

Indexed by:

EI Scopus CPCI-S Download Full text

Abstract:

In this paper, we propose a novel Dynamic Geometrical Image Network (DGIN) for automatic 4D Facial Expression Recognition (FER). Given a 3D video represented as a sequence of face scans, we first estimate their differential geometry quantities and generate geometrical images, including Depth Images (DPI), three Normal Component Images (NCI) and Shape Index Images (SII). These geometrical images are then fed into DGIN for end-to-end training and prediction. DGIN consists of a short-term temporal pooling layer for dynamic geometric image generation, several repetitions of convolution+ReLU+pooling layers for facial spatial feature extraction, and a long-term temporal pooling layer for dynamic feature map fusion, followed by fully connected layers and a joint loss layer. During the training phase, the two-stage longterm and short-term sliding window scheme is introduced for data augmentation and temporal pooling. Meanwhile, a joint loss integrating both the cross-entropy loss and the triplet loss is used to achieve more discriminative expression features. In the testing phase, only the short-term sliding window scheme is applied to the whole video sequence of certain geometric images, whose outputs further go through the deep net for expression similarity measurement. The final result is achieved by fusing the predicted expression scores of different types of geometrical images. Experimental results reported on the BU- 4DFE database demonstrate the effectiveness of the proposed approach. © 2018 IEEE.

Keyword:

3-D facial expression recognition Data augmentation Differential geometry Facial expression recognition Fully-connected layers Loss functions Similarity measurements Sliding window schemes

Author Community:

  • [ 1 ] [Li, Weijian;Huang, Di]State Key Laboratory of Software Development Environment, Beihang University, Beijing; 100191, China
  • [ 2 ] [Li, Huibin]School of Mathematics and Statistics, Xi'An Jiaotong University, Xi'an; 710049, China
  • [ 3 ] [Wang, Yunhong]IRIP Lab, School of Computer Science and Engineering, Beihang University, Beijing; 100191, China
  • [ 4 ] [Li, Weijian; Huang, Di] Beihang Univ, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
  • [ 5 ] [Li, Huibin] Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Shaanxi, Peoples R China
  • [ 6 ] [Wang, Yunhong] Beihang Univ, Sch Comp Sci & Engn, IRIP Lab, Beijing 100191, Peoples R China
  • [ 7 ] [Li, Weijian]Beihang Univ, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
  • [ 8 ] [Huang, Di]Beihang Univ, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
  • [ 9 ] [Li, Huibin]Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Shaanxi, Peoples R China
  • [ 10 ] [Wang, Yunhong]Beihang Univ, Sch Comp Sci & Engn, IRIP Lab, Beijing 100191, Peoples R China

Reprint Author's Address:

  • Beihang Univ, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China.

Show more details

Related Keywords:

Related Article:

Source :

Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018

ISSN: 9781538623350

Year: 2018

Publish Date: June 5, 2018

Page: 24-30

Language: English

Cited Count:

WoS CC Cited Count: 15

SCOPUS Cited Count: 21

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 4

FAQ| About| Online/Total:158/168330785
Address:XI'AN JIAOTONG UNIVERSITY LIBRARY(No.28, Xianning West Road, Xi'an, Shaanxi Post Code:710049) Contact Us:029-82667865
Copyright:XI'AN JIAOTONG UNIVERSITY LIBRARY Technical Support:Beijing Aegean Software Co., Ltd.