A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data
文献类型:期刊论文
作者 | Zhu, HJ (Zhu, Hui-Juan); Zhu, ZW (Zhu, Zheng-Wei); Jiang, TH (Jiang, Tong-Hai)![]() ![]() ![]() ![]() |
刊名 | JOURNAL OF SENSORS
![]() |
出版日期 | 2018 |
卷号 | 2018期号:1页码:1-12 |
ISSN号 | 1687-725X |
DOI | 10.1155/2018/2094696 |
英文摘要 | In data integration, entity resolution is an important technique to improve data quality. Existing researches typically assume that the target dataset only contain string-type data and use single similarity metric. For larger high-dimensional dataset, redundant information needs to be verified using traditional blocking or windowing techniques. In this work, we propose a novel ER-resolving method using a hybrid approach, including type-based multiblocks, varying window size, and more flexible similarity metrics. In our new ER workflow, we reduce the searching space for entity pairs by the constraint of redundant attributes and matching likelihood. We develop a reference implementation of our proposed approach and validate its performance using real-life dataset from one Internet of Things project. We evaluate the data processing system using five standard metrics including effectiveness, efficiency, accuracy, recall, and precision. Experimental results indicate that the proposed approach could be a promising alternative for entity resolution and could be feasibly applied in real-world data cleaning for large datasets. |
WOS记录号 | WOS:000424828300001 |
源URL | [http://ir.xjipc.cas.cn/handle/365002/5221] ![]() |
专题 | 新疆理化技术研究所_多语种信息技术研究室 |
通讯作者 | Jiang, TH (Jiang, Tong-Hai) |
作者单位 | 1.Changzhou Univ, Sch Informat Sci & Engn, Changzhou 213164, Peoples R China 2.Chinese Acad Sci, Xinjiang Tech Inst Phys & Chem, Urumqi 830011, Peoples R China 3.Xinjiang Lab Minor Speech & Language Informat Pro, Urumqi 830011, Peoples R China |
推荐引用方式 GB/T 7714 | Zhu, HJ ,Zhu, ZW ,Jiang, TH ,et al. A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data[J]. JOURNAL OF SENSORS,2018,2018(1):1-12. |
APA | Zhu, HJ .,Zhu, ZW .,Jiang, TH .,Cheng, L .,Shi, WL .,...&Ma, B .(2018).A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data.JOURNAL OF SENSORS,2018(1),1-12. |
MLA | Zhu, HJ ,et al."A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data".JOURNAL OF SENSORS 2018.1(2018):1-12. |
入库方式: OAI收割
来源:新疆理化技术研究所
其他版本
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。