A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea
文献类型:期刊论文
作者 | Yu, Yang3; Zhou, Yusheng2,3; Qin, Rufu3; Xu, Huiping1,3; Sadiq, Shazia2 |
刊名 | SENSORS |
出版日期 | 2018-08-01 |
卷号 | 18期号:8页码:1 |
ISSN号 | 1424-8220 |
关键词 | Seafloor Observatory Data Quality Control Arima Outlier Detection Data Interpolation |
DOI | 10.3390/s18082628 |
文献子类 | Article |
英文摘要 | With the construction and deployment of seafloor observatories around the world, massive amounts of oceanographic measurement data were gathered and transmitted to data centers. The increase in the amount of observed data not only provides support for marine scientific research but also raises the requirements for data quality control, as scientists must ensure that their research outcomes come from high-quality data. In this paper, we first analyzed and defined data quality problems occurring in the East China Sea Seafloor Observatory System (ECSSOS). We then proposed a method to detect and repair the data quality problems of seafloor observatories. Incorporating data statistics and expert knowledge from domain specialists, the proposed method consists of three parts: a general pretest to preprocess data and provide a router for further processing, data outlier detection methods to label suspect data points, and a data interpolation method to fill up missing and suspect data. The autoregressive integrated moving average (ARIMA) model was improved and applied to seafloor observatory data quality control by using a sliding window and cleaning the input modeling data. Furthermore, a quality control flag system was also proposed and applied to describe data quality control results and processing procedure information. The real observed data in ECSSOS were used to implement and test the proposed method. The results demonstrated that the proposed method performed effectively at detecting and repairing data quality problems for seafloor observatory data. |
WOS关键词 | Sensor Data ; Benefits ; Canada |
WOS研究方向 | Chemistry ; Electrochemistry ; Instruments & Instrumentation |
语种 | 英语 |
出版者 | MDPI |
WOS记录号 | WOS:000445712400228 |
资助机构 | Science and Technology Commission of Shanghai(15DZ1207104 ; Shanghai Oceanic Administration(Huhaike 2016-07) ; 15DZ1203100) |
版本 | 出版稿 |
源URL | [http://ir.idsse.ac.cn/handle/183446/6313] |
专题 | 深海工程技术部_深海视频技术研究室 |
通讯作者 | Qin, Rufu |
作者单位 | 1.Chinese Acad Sci, Inst Deep Sea Sci & Engn, Sanya 572000, Peoples R China 2.Univ Queensland, Sch Informat Technol & Elect Engn, St Lucia, Qld 4072, Australia 3.Tongji Univ, State Key Lab Marine Geol, Shanghai 200092, Peoples R China |
推荐引用方式 GB/T 7714 | Yu, Yang,Zhou, Yusheng,Qin, Rufu,et al. A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea[J]. SENSORS,2018,18(8):1. |
APA | Yu, Yang,Zhou, Yusheng,Qin, Rufu,Xu, Huiping,&Sadiq, Shazia.(2018).A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea.SENSORS,18(8),1. |
MLA | Yu, Yang,et al."A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea".SENSORS 18.8(2018):1. |
入库方式: OAI收割
来源:深海科学与工程研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。