Concrete Defects Inspection and 3D Mapping Using CityFlyer Quadrotor Robot
文献类型：期刊论文
| 作者 | Liang Yang; Bing Li ; Wei Li; Howard Brand; Biao Jiang; Jizhong Xiao
|
| 刊名 | IEEE/CAA Journal of Automatica Sinica
 |
| 出版日期 | 2020 |
| 卷号 | 7期号:4页码:991-1002 |
| 关键词 | 3D reconstruction concrete inspection deep neural network quadrotor flying robot visual-inertial fusion |
| ISSN号 | 2329-9266 |
| DOI | 10.1109/JAS.2020.1003234 |
| 英文摘要 | The concrete aging problem has gained more attention in recent years as more bridges and tunnels in the United States lack proper maintenance. Though the Federal Highway Administration requires these public concrete structures to be inspected regularly, on-site manual inspection by human operators is time-consuming and labor-intensive. Conventional inspection approaches for concrete inspection, using RGB image-based thresholding methods, are not able to determine metric information as well as accurate location information for assessed defects for conditions. To address this challenge, we propose a deep neural network (DNN) based concrete inspection system using a quadrotor flying robot (referred to as CityFlyer) mounted with an RGB-D camera. The inspection system introduces several novel modules. Firstly, a visual-inertial fusion approach is introduced to perform camera and robot positioning and structure 3D metric reconstruction. The reconstructed map is used to retrieve the location and metric information of the defects. Secondly, we introduce a DNN model, namely AdaNet, to detect concrete spalling and cracking, with the capability of maintaining robustness under various distances between the camera and concrete surface. In order to train the model, we craft a new dataset, i.e., the concrete structure spalling and cracking (CSSC) dataset, which is released publicly to the research community. Finally, we introduce a 3D semantic mapping method using the annotated framework to reconstruct the concrete structure for visualization. We performed comparative studies and demonstrated that our AdaNet can achieve 8.41% higher detection accuracy than ResNets and VGGs. Moreover, we conducted five field tests, of which three are manual hand-held tests and two are drone-based field tests. These results indicate that our system is capable of performing metric field inspection, and can serve as an effective tool for civil engineers. |
| 源URL | [http://ir.ia.ac.cn/handle/173211/43007]  |
| 专题 | 自动化研究所_学术期刊_IEEE/CAA Journal of Automatica Sinica |
| 推荐引用方式 GB/T 7714 | Liang Yang,Bing Li,Wei Li,et al. Concrete Defects Inspection and 3D Mapping Using CityFlyer Quadrotor Robot[J]. IEEE/CAA Journal of Automatica Sinica,2020,7(4):991-1002. |
| APA | Liang Yang,Bing Li,Wei Li,Howard Brand,Biao Jiang,&Jizhong Xiao.(2020).Concrete Defects Inspection and 3D Mapping Using CityFlyer Quadrotor Robot.IEEE/CAA Journal of Automatica Sinica,7(4),991-1002. |
| MLA | Liang Yang,et al."Concrete Defects Inspection and 3D Mapping Using CityFlyer Quadrotor Robot".IEEE/CAA Journal of Automatica Sinica 7.4(2020):991-1002. |
入库方式： OAI收割
来源：自动化研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。