XWRAPComposer: A multi-page data extraction service

Ling Liu, Jianjun Zhang, Wei Han, Calton Pu, James Caverlee, Sungkeun Park, Terence Critchlow, David Buttler, Matthew A Coleman

Research output: Contribution to journalArticlepeer-review


We present a service-oriented architecture and a set of techniques for developing wrapper code generators, including the methodology of designing an effective wrapper program construction facility and a concrete implementation, called XWRAPComposer. Our wrapper generation framework has two unique design goals. First, we explicitly separate tasks of building wrappers that are specific to a Web service from the tasks that are repetitive for any service, thus the code can be generated as a wrapper library component and reused automatically by the wrapper generator system. Second, we use inductive learning algorithms that derive information flow and data extraction patterns by reasoning about sample pages or sample specifications. More importantly, we design a declarative rule-based script language for multi-page information extraction, encouraging a clean separation of the information extraction semantics from the information flow control and execution logic of wrapper programs. We implement these design principles with the development of the XWRAPComposer toolkit, which can semi-automatically generate WSDL-enabled wrapper programs. We illustrate the problems and challenges of multipage data extraction in the context ofbioinformatics applications and evaluate the design and development of XWRAPComposer through our experiences of integrating various BLAST services.

Original languageEnglish (US)
Pages (from-to)33-60
Number of pages28
JournalInternational Journal of Web Services Research
Issue number2
StatePublished - 2006
Externally publishedYes


  • Code generator
  • Data extraction
  • Service oriented architecture
  • Web services

ASJC Scopus subject areas

  • Computer Networks and Communications


Dive into the research topics of 'XWRAPComposer: A multi-page data extraction service'. Together they form a unique fingerprint.

Cite this