XWRAPComposer

A multi-page data extraction service

Ling Liu, Jianjun Zhang, Wei Han, Calton Pu, James Caverlee, Sungkeun Park, Terence Critchlow, David Buttler, Matthew A Coleman

Research output: Contribution to journalArticle

Abstract

We present a service-oriented architecture and a set of techniques for developing wrapper code generators, including the methodology of designing an effective wrapper program construction facility and a concrete implementation, called XWRAPComposer. Our wrapper generation framework has two unique design goals. First, we explicitly separate tasks of building wrappers that are specific to a Web service from the tasks that are repetitive for any service, thus the code can be generated as a wrapper library component and reused automatically by the wrapper generator system. Second, we use inductive learning algorithms that derive information flow and data extraction patterns by reasoning about sample pages or sample specifications. More importantly, we design a declarative rule-based script language for multi-page information extraction, encouraging a clean separation of the information extraction semantics from the information flow control and execution logic of wrapper programs. We implement these design principles with the development of the XWRAPComposer toolkit, which can semi-automatically generate WSDL-enabled wrapper programs. We illustrate the problems and challenges of multipage data extraction in the context ofbioinformatics applications and evaluate the design and development of XWRAPComposer through our experiences of integrating various BLAST services.

Original languageEnglish (US)
Pages (from-to)33-60
Number of pages28
JournalInternational Journal of Web Services Research
Volume3
Issue number2
StatePublished - 2006
Externally publishedYes

Fingerprint

WSDL
Service oriented architecture (SOA)
Flow control
Web services
Learning algorithms
Semantics
Concretes
Specifications

Keywords

  • Code generator
  • Data extraction
  • Service oriented architecture
  • Web services

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Liu, L., Zhang, J., Han, W., Pu, C., Caverlee, J., Park, S., ... Coleman, M. A. (2006). XWRAPComposer: A multi-page data extraction service. International Journal of Web Services Research, 3(2), 33-60.

XWRAPComposer : A multi-page data extraction service. / Liu, Ling; Zhang, Jianjun; Han, Wei; Pu, Calton; Caverlee, James; Park, Sungkeun; Critchlow, Terence; Buttler, David; Coleman, Matthew A.

In: International Journal of Web Services Research, Vol. 3, No. 2, 2006, p. 33-60.

Research output: Contribution to journalArticle

Liu, L, Zhang, J, Han, W, Pu, C, Caverlee, J, Park, S, Critchlow, T, Buttler, D & Coleman, MA 2006, 'XWRAPComposer: A multi-page data extraction service', International Journal of Web Services Research, vol. 3, no. 2, pp. 33-60.
Liu L, Zhang J, Han W, Pu C, Caverlee J, Park S et al. XWRAPComposer: A multi-page data extraction service. International Journal of Web Services Research. 2006;3(2):33-60.
Liu, Ling ; Zhang, Jianjun ; Han, Wei ; Pu, Calton ; Caverlee, James ; Park, Sungkeun ; Critchlow, Terence ; Buttler, David ; Coleman, Matthew A. / XWRAPComposer : A multi-page data extraction service. In: International Journal of Web Services Research. 2006 ; Vol. 3, No. 2. pp. 33-60.
@article{09836d92ff174f218d86500e32ef2a9a,
title = "XWRAPComposer: A multi-page data extraction service",
abstract = "We present a service-oriented architecture and a set of techniques for developing wrapper code generators, including the methodology of designing an effective wrapper program construction facility and a concrete implementation, called XWRAPComposer. Our wrapper generation framework has two unique design goals. First, we explicitly separate tasks of building wrappers that are specific to a Web service from the tasks that are repetitive for any service, thus the code can be generated as a wrapper library component and reused automatically by the wrapper generator system. Second, we use inductive learning algorithms that derive information flow and data extraction patterns by reasoning about sample pages or sample specifications. More importantly, we design a declarative rule-based script language for multi-page information extraction, encouraging a clean separation of the information extraction semantics from the information flow control and execution logic of wrapper programs. We implement these design principles with the development of the XWRAPComposer toolkit, which can semi-automatically generate WSDL-enabled wrapper programs. We illustrate the problems and challenges of multipage data extraction in the context ofbioinformatics applications and evaluate the design and development of XWRAPComposer through our experiences of integrating various BLAST services.",
keywords = "Code generator, Data extraction, Service oriented architecture, Web services",
author = "Ling Liu and Jianjun Zhang and Wei Han and Calton Pu and James Caverlee and Sungkeun Park and Terence Critchlow and David Buttler and Coleman, {Matthew A}",
year = "2006",
language = "English (US)",
volume = "3",
pages = "33--60",
journal = "International Journal of Web Services Research",
issn = "1545-7362",
publisher = "IGI Publishing",
number = "2",

}

TY - JOUR

T1 - XWRAPComposer

T2 - A multi-page data extraction service

AU - Liu, Ling

AU - Zhang, Jianjun

AU - Han, Wei

AU - Pu, Calton

AU - Caverlee, James

AU - Park, Sungkeun

AU - Critchlow, Terence

AU - Buttler, David

AU - Coleman, Matthew A

PY - 2006

Y1 - 2006

N2 - We present a service-oriented architecture and a set of techniques for developing wrapper code generators, including the methodology of designing an effective wrapper program construction facility and a concrete implementation, called XWRAPComposer. Our wrapper generation framework has two unique design goals. First, we explicitly separate tasks of building wrappers that are specific to a Web service from the tasks that are repetitive for any service, thus the code can be generated as a wrapper library component and reused automatically by the wrapper generator system. Second, we use inductive learning algorithms that derive information flow and data extraction patterns by reasoning about sample pages or sample specifications. More importantly, we design a declarative rule-based script language for multi-page information extraction, encouraging a clean separation of the information extraction semantics from the information flow control and execution logic of wrapper programs. We implement these design principles with the development of the XWRAPComposer toolkit, which can semi-automatically generate WSDL-enabled wrapper programs. We illustrate the problems and challenges of multipage data extraction in the context ofbioinformatics applications and evaluate the design and development of XWRAPComposer through our experiences of integrating various BLAST services.

AB - We present a service-oriented architecture and a set of techniques for developing wrapper code generators, including the methodology of designing an effective wrapper program construction facility and a concrete implementation, called XWRAPComposer. Our wrapper generation framework has two unique design goals. First, we explicitly separate tasks of building wrappers that are specific to a Web service from the tasks that are repetitive for any service, thus the code can be generated as a wrapper library component and reused automatically by the wrapper generator system. Second, we use inductive learning algorithms that derive information flow and data extraction patterns by reasoning about sample pages or sample specifications. More importantly, we design a declarative rule-based script language for multi-page information extraction, encouraging a clean separation of the information extraction semantics from the information flow control and execution logic of wrapper programs. We implement these design principles with the development of the XWRAPComposer toolkit, which can semi-automatically generate WSDL-enabled wrapper programs. We illustrate the problems and challenges of multipage data extraction in the context ofbioinformatics applications and evaluate the design and development of XWRAPComposer through our experiences of integrating various BLAST services.

KW - Code generator

KW - Data extraction

KW - Service oriented architecture

KW - Web services

UR - http://www.scopus.com/inward/record.url?scp=33745606052&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745606052&partnerID=8YFLogxK

M3 - Article

VL - 3

SP - 33

EP - 60

JO - International Journal of Web Services Research

JF - International Journal of Web Services Research

SN - 1545-7362

IS - 2

ER -