Database enrichment environment to identify duplicate tuples

Abstract

One of the significant problems and inherent to current large databases is the incidence of duplicate tuples. This problem refers to the repetition of records that, in most cases, are represented differently in databases but refer to the same real world entity, which makes the task of identifying those tuples a hard work. Considering that each language has its peculiarities, it is believed that the use of text operations techniques from the area of Information Retrieval can enrich the content of the records for a specific language and thus maximize the amount of identified duplicate tuples and/or improve the confidence level of their classification in relation to current tools. The main contribution of this paper is to provide a language independent environment able to approximate the spelling of the records in a database and thus identify duplicate tuples more efficiently than the isolated application of traditional methods. In addition to only improve database quality this tool can also improve the process of Knowledge Discovery in Databases (KDD).

Contributors

Juliano Augusto Carreira

Carlos Roberto Valêncio

Rogéria C. Gratão de Souza

Conference

Publication date: August 2011

Publication date (Print): August 2011

Pages: 18-19

Affiliations

DCCE – IBILCE – UNESP

São José do Rio Preto – SP

DOI: 10.14236/ewic/FDIA2011.4

Copyright statement: © Juliano Augusto Carreira. Published by BCS Learning and Development Ltd. Fourth BCS-IRSG Symposium on Future Directions in Information Access (FDIA 2011), Koblenz, Germany

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Fourth BCS-IRSG Symposium on Future Directions in Information Access (FDIA 2011)

Conference acronym: FDIA

Conference number: 4

Conference location: Koblenz, Germany

Conference date: 31 August 2011

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Future Directions in Information Access (FDIA 2011)

Product

Product Information: 1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/FDIA2011.4

Self URI (journal page): https://ewic.bcs.org/

Categories

Series title: Electronic Workshops in Computing