中国科学院机构知识库网格
Chinese Academy of Sciences Institutional Repositories Grid
A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data

文献类型:期刊论文

作者Zhu, HJ (Zhu, Hui-Juan); Zhu, ZW (Zhu, Zheng-Wei); Jiang, TH (Jiang, Tong-Hai); Cheng, L (Cheng, Li); Shi, WL (Shi, Wei-Lei); Zhou, X (Zhou, Xi); Zhao, F (Zhao, Fan); Ma, B (Ma, Bo)
刊名JOURNAL OF SENSORS
出版日期2018
卷号2018期号:1页码:1-12
ISSN号1687-725X
DOI10.1155/2018/2094696
英文摘要

In data integration, entity resolution is an important technique to improve data quality. Existing researches typically assume that the target dataset only contain string-type data and use single similarity metric. For larger high-dimensional dataset, redundant information needs to be verified using traditional blocking or windowing techniques. In this work, we propose a novel ER-resolving method using a hybrid approach, including type-based multiblocks, varying window size, and more flexible similarity metrics. In our new ER workflow, we reduce the searching space for entity pairs by the constraint of redundant attributes and matching likelihood. We develop a reference implementation of our proposed approach and validate its performance using real-life dataset from one Internet of Things project. We evaluate the data processing system using five standard metrics including effectiveness, efficiency, accuracy, recall, and precision. Experimental results indicate that the proposed approach could be a promising alternative for entity resolution and could be feasibly applied in real-world data cleaning for large datasets.

WOS记录号WOS:000424828300001
源URL[http://ir.xjipc.cas.cn/handle/365002/5221]  
专题新疆理化技术研究所_多语种信息技术研究室
通讯作者Jiang, TH (Jiang, Tong-Hai)
作者单位1.Changzhou Univ, Sch Informat Sci & Engn, Changzhou 213164, Peoples R China
2.Chinese Acad Sci, Xinjiang Tech Inst Phys & Chem, Urumqi 830011, Peoples R China
3.Xinjiang Lab Minor Speech & Language Informat Pro, Urumqi 830011, Peoples R China
推荐引用方式
GB/T 7714
Zhu, HJ ,Zhu, ZW ,Jiang, TH ,et al. A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data[J]. JOURNAL OF SENSORS,2018,2018(1):1-12.
APA Zhu, HJ .,Zhu, ZW .,Jiang, TH .,Cheng, L .,Shi, WL .,...&Ma, B .(2018).A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data.JOURNAL OF SENSORS,2018(1),1-12.
MLA Zhu, HJ ,et al."A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data".JOURNAL OF SENSORS 2018.1(2018):1-12.

入库方式: OAI收割

来源:新疆理化技术研究所

浏览0
下载0
收藏0
其他版本

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。