XWRAPComposer: A multi-page data extraction service

Ling Liu, Jianjun Zhang, Wei Han, Calton Pu, James Caverlee, Sungkeun Park, Terence Critchlow, David Buttler, Matthew A Coleman

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

We present a service-oriented architecture and a set of techniques for developing wrapper code generators, including the methodology of designing an effective wrapper program construction facility and a concrete implementation, called XWRAP-Composer. Our wrapper generation framework has two unique design goals. First, we explicitly separate tasks of building wrappers that are specific to a Web service from the tasks that are repetitive for any service, thus the code can be generated as a wrapper library component and reused automatically by the wrapper generator system. Second, we use inductive learning algorithms that derive information flow and data extraction patterns by reasoning about sample pages or sample specifications. More importantly, we design a declarative rule-based script language for multi-page information extraction, encouraging a clean separation of the information extraction semantics from the information flow control and execution logic of wrapper programs. We implement these design principles with the development of the XWRAPComposer toolkit, which can semi-automatically generate WSDL-enabled wrapper programs. We illustrate the problems and challenges of multi-page data extraction in the context of bioinformatics applications and evaluate the design and development of XWRAPComposer through our experiences of integrating various BLAST services.

Original languageEnglish (US)
Title of host publicationWeb Services Research and Practices
PublisherIGI Global
Pages189-223
Number of pages35
ISBN (Print)9781599049045
DOIs
StatePublished - 2008
Externally publishedYes

    Fingerprint

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Liu, L., Zhang, J., Han, W., Pu, C., Caverlee, J., Park, S., Critchlow, T., Buttler, D., & Coleman, M. A. (2008). XWRAPComposer: A multi-page data extraction service. In Web Services Research and Practices (pp. 189-223). IGI Global. https://doi.org/10.4018/978-1-59904-904-5.ch007