A Framework for XML Similarity Joins

  • A prime motivation for using XML to directly represent pieces of information is the ability of supporting ad-hoc or 'schema-later' settings. In such scenarios, modeling data under loose data constraints is essential. Of course, the flexibility of XML comes at a price: the absence of a rigid, regular, and homogeneous structure makes many aspects of data management more challenging. Such malleable data formats can also lead to severe information quality problems, because the risk of storing inconsistent and incorrect data is greatly increased. A prominent example of such problems is the appearance of the so-called fuzzy duplicates, i.e., multiple and non-identical representations of a real-world entity. Similarity joins correlating XML document fragments that are similar can be used as core operators to support the identification of fuzzy duplicates. However, similarity assessment is especially difficult on XML datasets because structure, besides textual information, may exhibit variations in document fragments representing the same real-world entity. Moreover, similarity computation is substantially more expensive for tree-structured objects and, thus, is a serious performance concern. This thesis describes the design and implementation of an effective, flexible, and high-performance XML-based similarity join framework. As main contributions, we present novel structure-conscious similarity functions for XML trees - either considering XML structure in isolation or combined with textual information -, mechanisms to support the selection of relevant information from XML trees and organization of this information into a suitable format for similarity calculation, and efficient algorithms for large-scale identification of similar, set-represented objects. Finally, we validate the applicability of our techniques by integrating our framework into a native XML database management system; in this context we address several issues around the integration of similarity operations into traditional database architectures.
  • Ein Framework für XML Similarity Joins

Export metadata

  • Export Bibtex
  • Export RIS

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:Leonardo Andrade Ribeiro
URN (permanent link):urn:nbn:de:hbz:386-kluedo-25429
Advisor:Theo Härder
Document Type:Doctoral Thesis
Language of publication:English
Year of Completion:2010
Year of Publication:2010
Publishing Institute:Technische Universität Kaiserslautern
Granting Institute:Technische Universität Kaiserslautern
Acceptance Date of the Thesis:2010/07/15
Tag:Duplikaterkennung; Similarity Join; XDBMS
Duplicate Identification; Similarity Joins; XDBMS
GND-Keyword:Algorithmus ; Datenbank ; Leistungsmessung; XML ; Ähnlichkeit
Faculties / Organisational entities:Fachbereich Informatik
CCS-Classification (computer science):H.2 DATABASE MANAGEMENT (E.5)
H.3.3 Information Search and Retrieval
DDC-Cassification:004 Datenverarbeitung; Informatik

$Rev: 12793 $