XWRAPComposer: A multi-page data extraction service

Ling Liu, Jianjun Zhang, Wei Han, Calton Pu, James Caverlee, Sungkeun Park, Terence Critchlow, David Buttler, Matthew A Coleman

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

We present a service-oriented architecture and a set of techniques for developing wrapper code generators, including the methodology of designing an effective wrapper program construction facility and a concrete implementation, called XWRAP-Composer. Our wrapper generation framework has two unique design goals. First, we explicitly separate tasks of building wrappers that are specific to a Web service from the tasks that are repetitive for any service, thus the code can be generated as a wrapper library component and reused automatically by the wrapper generator system. Second, we use inductive learning algorithms that derive information flow and data extraction patterns by reasoning about sample pages or sample specifications. More importantly, we design a declarative rule-based script language for multi-page information extraction, encouraging a clean separation of the information extraction semantics from the information flow control and execution logic of wrapper programs. We implement these design principles with the development of the XWRAPComposer toolkit, which can semi-automatically generate WSDL-enabled wrapper programs. We illustrate the problems and challenges of multi-page data extraction in the context of bioinformatics applications and evaluate the design and development of XWRAPComposer through our experiences of integrating various BLAST services.

Original languageEnglish (US)
Title of host publicationWeb Services Research and Practices
PublisherIGI Global
Pages189-223
Number of pages35
ISBN (Print)9781599049045
DOIs
StatePublished - 2008
Externally publishedYes

Fingerprint

WSDL
Bioinformatics
Service oriented architecture (SOA)
Flow control
Web services
Learning algorithms
Semantics
Concretes
Specifications

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Liu, L., Zhang, J., Han, W., Pu, C., Caverlee, J., Park, S., ... Coleman, M. A. (2008). XWRAPComposer: A multi-page data extraction service. In Web Services Research and Practices (pp. 189-223). IGI Global. https://doi.org/10.4018/978-1-59904-904-5.ch007

XWRAPComposer : A multi-page data extraction service. / Liu, Ling; Zhang, Jianjun; Han, Wei; Pu, Calton; Caverlee, James; Park, Sungkeun; Critchlow, Terence; Buttler, David; Coleman, Matthew A.

Web Services Research and Practices. IGI Global, 2008. p. 189-223.

Research output: Chapter in Book/Report/Conference proceedingChapter

Liu, L, Zhang, J, Han, W, Pu, C, Caverlee, J, Park, S, Critchlow, T, Buttler, D & Coleman, MA 2008, XWRAPComposer: A multi-page data extraction service. in Web Services Research and Practices. IGI Global, pp. 189-223. https://doi.org/10.4018/978-1-59904-904-5.ch007
Liu L, Zhang J, Han W, Pu C, Caverlee J, Park S et al. XWRAPComposer: A multi-page data extraction service. In Web Services Research and Practices. IGI Global. 2008. p. 189-223 https://doi.org/10.4018/978-1-59904-904-5.ch007
Liu, Ling ; Zhang, Jianjun ; Han, Wei ; Pu, Calton ; Caverlee, James ; Park, Sungkeun ; Critchlow, Terence ; Buttler, David ; Coleman, Matthew A. / XWRAPComposer : A multi-page data extraction service. Web Services Research and Practices. IGI Global, 2008. pp. 189-223
@inbook{a6d335b6f5504f5397bce6df183001e4,
title = "XWRAPComposer: A multi-page data extraction service",
abstract = "We present a service-oriented architecture and a set of techniques for developing wrapper code generators, including the methodology of designing an effective wrapper program construction facility and a concrete implementation, called XWRAP-Composer. Our wrapper generation framework has two unique design goals. First, we explicitly separate tasks of building wrappers that are specific to a Web service from the tasks that are repetitive for any service, thus the code can be generated as a wrapper library component and reused automatically by the wrapper generator system. Second, we use inductive learning algorithms that derive information flow and data extraction patterns by reasoning about sample pages or sample specifications. More importantly, we design a declarative rule-based script language for multi-page information extraction, encouraging a clean separation of the information extraction semantics from the information flow control and execution logic of wrapper programs. We implement these design principles with the development of the XWRAPComposer toolkit, which can semi-automatically generate WSDL-enabled wrapper programs. We illustrate the problems and challenges of multi-page data extraction in the context of bioinformatics applications and evaluate the design and development of XWRAPComposer through our experiences of integrating various BLAST services.",
author = "Ling Liu and Jianjun Zhang and Wei Han and Calton Pu and James Caverlee and Sungkeun Park and Terence Critchlow and David Buttler and Coleman, {Matthew A}",
year = "2008",
doi = "10.4018/978-1-59904-904-5.ch007",
language = "English (US)",
isbn = "9781599049045",
pages = "189--223",
booktitle = "Web Services Research and Practices",
publisher = "IGI Global",

}

TY - CHAP

T1 - XWRAPComposer

T2 - A multi-page data extraction service

AU - Liu, Ling

AU - Zhang, Jianjun

AU - Han, Wei

AU - Pu, Calton

AU - Caverlee, James

AU - Park, Sungkeun

AU - Critchlow, Terence

AU - Buttler, David

AU - Coleman, Matthew A

PY - 2008

Y1 - 2008

N2 - We present a service-oriented architecture and a set of techniques for developing wrapper code generators, including the methodology of designing an effective wrapper program construction facility and a concrete implementation, called XWRAP-Composer. Our wrapper generation framework has two unique design goals. First, we explicitly separate tasks of building wrappers that are specific to a Web service from the tasks that are repetitive for any service, thus the code can be generated as a wrapper library component and reused automatically by the wrapper generator system. Second, we use inductive learning algorithms that derive information flow and data extraction patterns by reasoning about sample pages or sample specifications. More importantly, we design a declarative rule-based script language for multi-page information extraction, encouraging a clean separation of the information extraction semantics from the information flow control and execution logic of wrapper programs. We implement these design principles with the development of the XWRAPComposer toolkit, which can semi-automatically generate WSDL-enabled wrapper programs. We illustrate the problems and challenges of multi-page data extraction in the context of bioinformatics applications and evaluate the design and development of XWRAPComposer through our experiences of integrating various BLAST services.

AB - We present a service-oriented architecture and a set of techniques for developing wrapper code generators, including the methodology of designing an effective wrapper program construction facility and a concrete implementation, called XWRAP-Composer. Our wrapper generation framework has two unique design goals. First, we explicitly separate tasks of building wrappers that are specific to a Web service from the tasks that are repetitive for any service, thus the code can be generated as a wrapper library component and reused automatically by the wrapper generator system. Second, we use inductive learning algorithms that derive information flow and data extraction patterns by reasoning about sample pages or sample specifications. More importantly, we design a declarative rule-based script language for multi-page information extraction, encouraging a clean separation of the information extraction semantics from the information flow control and execution logic of wrapper programs. We implement these design principles with the development of the XWRAPComposer toolkit, which can semi-automatically generate WSDL-enabled wrapper programs. We illustrate the problems and challenges of multi-page data extraction in the context of bioinformatics applications and evaluate the design and development of XWRAPComposer through our experiences of integrating various BLAST services.

UR - http://www.scopus.com/inward/record.url?scp=84899247482&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84899247482&partnerID=8YFLogxK

U2 - 10.4018/978-1-59904-904-5.ch007

DO - 10.4018/978-1-59904-904-5.ch007

M3 - Chapter

AN - SCOPUS:84899247482

SN - 9781599049045

SP - 189

EP - 223

BT - Web Services Research and Practices

PB - IGI Global

ER -