Processing recursive XQuery over XML streams: The raindrop approach

Mingzhu Wei, Ming Li, Elke A. Rundensteiner, Murali Mani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

XML stream applications bring the challenge of efficiently processing queries on sequentially accessible tokenbased data. For efficient processing of queries, we need to ensure that memory usage stays low. This in turn requires that we avoid holding data in the query buffer, by outputting it at the earliest possible time. In this paper, we propose a new class of stream algebra operators for efficient recursive XQuery stream processing. In particular we propose two strategies for implementing structural joins: (a) the just-in-Time structural join strategy efficiently processes joins as long as the input XML substreams are non-recursive and (b) the recursive structural join strategy supports structural joins over recursive XML substreams, however at an added cost of tuple-level ID-comparisons. Both structural join strategies are complemented by an automatadriven invocation mechanism that triggers the execution of the join at the first possible moment upon recognizing the end of the targeted input stream subelement. Further, we design this structural join operator itself to be context-Aware. The operator is capable of at run-Time switching from the efficient just-intime join strategy for elements that are recognized to be nonrecursive to the more powerful id-based structural join strategy for elements that are identified to be recursive. In addition, depending on whether the query is recursive, we will generate the plan with cheaper operators whenever possible. We incorporate the proposed techniques into the Raindrop stream engine. We also report on experimental studies we conducted using ToXgene that show that our techniques brings significant performance improvement.

Original languageEnglish (US)
Title of host publicationICDEW 2006 - Proceedings of the 22nd International Conference on Data Engineering Workshops
EditorsXiaofang Zhou, Roger S. Barga
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)0769525717, 9780769525716
DOIs
StatePublished - 2006
Externally publishedYes
Event22nd International Conference on Data Engineering Workshops, ICDEW 2006 - Atlanta, United States
Duration: Apr 3 2006Apr 7 2006

Publication series

NameICDEW 2006 - Proceedings of the 22nd International Conference on Data Engineering Workshops

Other

Other22nd International Conference on Data Engineering Workshops, ICDEW 2006
Country/TerritoryUnited States
CityAtlanta
Period4/3/064/7/06

ASJC Scopus subject areas

  • Information Systems
  • Computer Networks and Communications
  • Information Systems and Management

Fingerprint

Dive into the research topics of 'Processing recursive XQuery over XML streams: The raindrop approach'. Together they form a unique fingerprint.

Cite this