中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
热门
Skeleton Based Action Recognition with Convolutional Neural Network

文献类型:会议论文

作者Du, Yong1,3; Fu, Yun4; Wang, Liang1,2,3
出版日期2015
会议日期2015-11
会议地点Kuala Lumpur, Malaysia
关键词Skeleton Based Action Recognition Convolutional Neural Network
英文摘要Temporal dynamics of postures over time is crucial for sequence-based action recognition. Human actions can be represented by the corresponding motions of articulated skeleton. Most of the existing approaches for skeleton based action recognition model the spatial-temporal evolution of actions based on hand-crafted features. As a kind of hierarchically adaptive filter banks, Convolutional Neural Network (CNN) performs well in representation learning. In this paper, we propose an end-to-end hierarchical architecture for skeleton based action recognition with CNN. Firstly, we represent a skeleton sequence as a matrix by concatenating the joint coordinates in each instant and arranging those vector representations in a chronological order. Then the matrix is quantified into an image and normalized to handle the variable-length problem. The final image is fed into a CNN model for feature extraction and recognition. For the specific structure of such images, the simple max-pooling plays an important role on spatial feature selection as well as temporal frequency adjustment, which can obtain more discriminative joint information for different actions and meanwhile address the variable-frequency problem. Experimental results demonstrate that our method achieves the state-of-art performance with high computational efficiency, especially surpassing the existing result by more than 15 percentage on the challenging ChaLearn gesture recognition dataset.
会议录Asian Conference on Pattern Recognition
源URL[http://ir.ia.ac.cn/handle/173211/11696]  
专题自动化研究所_智能感知与计算研究中心
通讯作者Wang, Liang
作者单位1.Center for Research on Intelligent Perception and Computing, CRIPAC
2.Center for Excellence in Brain Science and Intelligence Technology, CEBSIT
3.Nat’l Lab of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences
4.College of Engineering, College of Computer and Information Science, Northeastern University, USA
推荐引用方式
GB/T 7714
Du, Yong,Fu, Yun,Wang, Liang. Skeleton Based Action Recognition with Convolutional Neural Network[C]. 见:. Kuala Lumpur, Malaysia. 2015-11.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。