中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
Decoupling GCN with DropGraph Module for Skeleton-Based Action Recognition

文献类型:会议论文

作者Ke Cheng3,4; Yifan Zhang3,4; Congqi Cao1; Lei Shi3,4; Jian Cheng2,3,4; Hanqing Lu3,4
出版日期2020-08
会议日期2020-8
会议地点线上
关键词skeleton-based action recognition, decoupling GCN, DropGraph
英文摘要

In skeleton-based action recognition, graph convolutional networks (GCNs) have achieved remarkable success. Nevertheless, how to efficiently model the spatial-temporal skeleton graph without introducing extra computation burden is a challenging problem for industrial deployment. In this paper, we rethink the spatial aggregation in existing GCN-based skeleton action recognition methods and discover that they are limited by coupling aggregation mechanism. Inspired by the decoupling aggregation mechanism in CNNs, we propose decoupling GCN to boost the graph modeling ability with no extra computation, no extra latency, no extra GPU memory cost, and less than 10\% extra parameters. Another prevalent problem of GCNs is over-fitting. Although dropout is a widely used regularization technique, it is not effective for GCNs, due to the fact that activation units are correlated between neighbor nodes. We propose DropGraph to discard features in correlated nodes, which is particularly effective on GCNs. Moreover, we introduce an attention-guided drop mechanism to enhance the regularization effect. All our contributions introduce zero extra computation burden at deployment. We conduct experiments on three datasets (NTU-RGBD, NTU-RGBD-120, and Northwestern-UCLA) and exceed the state-of-the-art performance with less computation cost. 

源URL[http://ir.ia.ac.cn/handle/173211/48924]  
专题自动化研究所_模式识别国家重点实验室_图像与视频分析团队
通讯作者Yifan Zhang
作者单位1.School of Computer Science, Northwestern Polytechnical University
2.CAS Center for Excellence in Brain Science and Intelligence Technology
3.School of Artificial Intelligence, University of Chinese Academy of Sciences
4.NLPR & AIRIA, Institute of Automation, Chinese Academy of Sciences
推荐引用方式
GB/T 7714
Ke Cheng,Yifan Zhang,Congqi Cao,et al. Decoupling GCN with DropGraph Module for Skeleton-Based Action Recognition[C]. 见:. 线上. 2020-8.

入库方式: OAI收割

来源:自动化研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。