中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea

文献类型:期刊论文

作者Yu, Yang3; Zhou, Yusheng2,3; Qin, Rufu3; Xu, Huiping1,3; Sadiq, Shazia2
刊名SENSORS
出版日期2018-08-01
卷号18期号:8页码:1
ISSN号1424-8220
关键词Seafloor Observatory Data Quality Control Arima Outlier Detection Data Interpolation
DOI10.3390/s18082628
文献子类Article
英文摘要

With the construction and deployment of seafloor observatories around the world, massive amounts of oceanographic measurement data were gathered and transmitted to data centers. The increase in the amount of observed data not only provides support for marine scientific research but also raises the requirements for data quality control, as scientists must ensure that their research outcomes come from high-quality data. In this paper, we first analyzed and defined data quality problems occurring in the East China Sea Seafloor Observatory System (ECSSOS). We then proposed a method to detect and repair the data quality problems of seafloor observatories. Incorporating data statistics and expert knowledge from domain specialists, the proposed method consists of three parts: a general pretest to preprocess data and provide a router for further processing, data outlier detection methods to label suspect data points, and a data interpolation method to fill up missing and suspect data. The autoregressive integrated moving average (ARIMA) model was improved and applied to seafloor observatory data quality control by using a sliding window and cleaning the input modeling data. Furthermore, a quality control flag system was also proposed and applied to describe data quality control results and processing procedure information. The real observed data in ECSSOS were used to implement and test the proposed method. The results demonstrated that the proposed method performed effectively at detecting and repairing data quality problems for seafloor observatory data.

WOS关键词Sensor Data ; Benefits ; Canada
WOS研究方向Chemistry ; Electrochemistry ; Instruments & Instrumentation
语种英语
出版者MDPI
WOS记录号WOS:000445712400228
资助机构Science and Technology Commission of Shanghai(15DZ1207104 ; Shanghai Oceanic Administration(Huhaike 2016-07) ; 15DZ1203100)
版本出版稿
源URL[http://ir.idsse.ac.cn/handle/183446/6313]  
专题深海工程技术部_深海视频技术研究室
通讯作者Qin, Rufu
作者单位1.Chinese Acad Sci, Inst Deep Sea Sci & Engn, Sanya 572000, Peoples R China
2.Univ Queensland, Sch Informat Technol & Elect Engn, St Lucia, Qld 4072, Australia
3.Tongji Univ, State Key Lab Marine Geol, Shanghai 200092, Peoples R China
推荐引用方式
GB/T 7714
Yu, Yang,Zhou, Yusheng,Qin, Rufu,et al. A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea[J]. SENSORS,2018,18(8):1.
APA Yu, Yang,Zhou, Yusheng,Qin, Rufu,Xu, Huiping,&Sadiq, Shazia.(2018).A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea.SENSORS,18(8),1.
MLA Yu, Yang,et al."A Data Quality Control Method for Seafloor Observatories: The Application of Observed Time Series Data in the East China Sea".SENSORS 18.8(2018):1.

入库方式: OAI收割

来源:深海科学与工程研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。