Development and evaluation of a study design typology for human research.

Simona Carini, Brad H. Pollock, Harold P. Lehmann, Suzanne Bakken, Edward M. Barbour, Davera Gabriel, Herbert K. Hagler, Caryn R. Harper, Shamim A. Mollah, Meredith Nahm, Hien H. Nguyen, Richard H. Scheuermann, Ida Sim

    Research output: Contribution to journalArticle

    9 Citations (Scopus)

    Abstract

    A systematic classification of study designs would be useful for researchers, systematic reviewers, readers, and research administrators, among others. As part of the Human Studies Database Project, we developed the Study Design Typology to standardize the classification of study designs in human research. We then performed a multiple observer masked evaluation of active research protocols in four institutions according to a standardized protocol. Thirty-five protocols were classified by three reviewers each into one of nine high-level study designs for interventional and observational research (e.g., N-of-1, Parallel Group, Case Crossover). Rater classification agreement was moderately high for the 35 protocols (Fleiss' kappa = 0.442) and higher still for the 23 quantitative studies (Fleiss' kappa = 0.463). We conclude that our typology shows initial promise for reliably distinguishing study design types for quantitative human research.

    Original languageEnglish (US)
    Pages (from-to)81-85
    Number of pages5
    JournalAMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium
    Volume2009
    StatePublished - 2009

    Fingerprint

    Research
    Administrative Personnel
    Research Personnel
    Databases

    ASJC Scopus subject areas

    • Medicine(all)

    Cite this

    Development and evaluation of a study design typology for human research. / Carini, Simona; Pollock, Brad H.; Lehmann, Harold P.; Bakken, Suzanne; Barbour, Edward M.; Gabriel, Davera; Hagler, Herbert K.; Harper, Caryn R.; Mollah, Shamim A.; Nahm, Meredith; Nguyen, Hien H.; Scheuermann, Richard H.; Sim, Ida.

    In: AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium, Vol. 2009, 2009, p. 81-85.

    Research output: Contribution to journalArticle

    Carini, S, Pollock, BH, Lehmann, HP, Bakken, S, Barbour, EM, Gabriel, D, Hagler, HK, Harper, CR, Mollah, SA, Nahm, M, Nguyen, HH, Scheuermann, RH & Sim, I 2009, 'Development and evaluation of a study design typology for human research.', AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium, vol. 2009, pp. 81-85.
    Carini, Simona ; Pollock, Brad H. ; Lehmann, Harold P. ; Bakken, Suzanne ; Barbour, Edward M. ; Gabriel, Davera ; Hagler, Herbert K. ; Harper, Caryn R. ; Mollah, Shamim A. ; Nahm, Meredith ; Nguyen, Hien H. ; Scheuermann, Richard H. ; Sim, Ida. / Development and evaluation of a study design typology for human research. In: AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium. 2009 ; Vol. 2009. pp. 81-85.
    @article{f6b8c63e47ce4279a3f9c2a5094cb771,
    title = "Development and evaluation of a study design typology for human research.",
    abstract = "A systematic classification of study designs would be useful for researchers, systematic reviewers, readers, and research administrators, among others. As part of the Human Studies Database Project, we developed the Study Design Typology to standardize the classification of study designs in human research. We then performed a multiple observer masked evaluation of active research protocols in four institutions according to a standardized protocol. Thirty-five protocols were classified by three reviewers each into one of nine high-level study designs for interventional and observational research (e.g., N-of-1, Parallel Group, Case Crossover). Rater classification agreement was moderately high for the 35 protocols (Fleiss' kappa = 0.442) and higher still for the 23 quantitative studies (Fleiss' kappa = 0.463). We conclude that our typology shows initial promise for reliably distinguishing study design types for quantitative human research.",
    author = "Simona Carini and Pollock, {Brad H.} and Lehmann, {Harold P.} and Suzanne Bakken and Barbour, {Edward M.} and Davera Gabriel and Hagler, {Herbert K.} and Harper, {Caryn R.} and Mollah, {Shamim A.} and Meredith Nahm and Nguyen, {Hien H.} and Scheuermann, {Richard H.} and Ida Sim",
    year = "2009",
    language = "English (US)",
    volume = "2009",
    pages = "81--85",
    journal = "AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium",
    issn = "1559-4076",
    publisher = "American Medical Informatics Association",

    }

    TY - JOUR

    T1 - Development and evaluation of a study design typology for human research.

    AU - Carini, Simona

    AU - Pollock, Brad H.

    AU - Lehmann, Harold P.

    AU - Bakken, Suzanne

    AU - Barbour, Edward M.

    AU - Gabriel, Davera

    AU - Hagler, Herbert K.

    AU - Harper, Caryn R.

    AU - Mollah, Shamim A.

    AU - Nahm, Meredith

    AU - Nguyen, Hien H.

    AU - Scheuermann, Richard H.

    AU - Sim, Ida

    PY - 2009

    Y1 - 2009

    N2 - A systematic classification of study designs would be useful for researchers, systematic reviewers, readers, and research administrators, among others. As part of the Human Studies Database Project, we developed the Study Design Typology to standardize the classification of study designs in human research. We then performed a multiple observer masked evaluation of active research protocols in four institutions according to a standardized protocol. Thirty-five protocols were classified by three reviewers each into one of nine high-level study designs for interventional and observational research (e.g., N-of-1, Parallel Group, Case Crossover). Rater classification agreement was moderately high for the 35 protocols (Fleiss' kappa = 0.442) and higher still for the 23 quantitative studies (Fleiss' kappa = 0.463). We conclude that our typology shows initial promise for reliably distinguishing study design types for quantitative human research.

    AB - A systematic classification of study designs would be useful for researchers, systematic reviewers, readers, and research administrators, among others. As part of the Human Studies Database Project, we developed the Study Design Typology to standardize the classification of study designs in human research. We then performed a multiple observer masked evaluation of active research protocols in four institutions according to a standardized protocol. Thirty-five protocols were classified by three reviewers each into one of nine high-level study designs for interventional and observational research (e.g., N-of-1, Parallel Group, Case Crossover). Rater classification agreement was moderately high for the 35 protocols (Fleiss' kappa = 0.442) and higher still for the 23 quantitative studies (Fleiss' kappa = 0.463). We conclude that our typology shows initial promise for reliably distinguishing study design types for quantitative human research.

    UR - http://www.scopus.com/inward/record.url?scp=77957827214&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=77957827214&partnerID=8YFLogxK

    M3 - Article

    C2 - 20351827

    AN - SCOPUS:77957827214

    VL - 2009

    SP - 81

    EP - 85

    JO - AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium

    JF - AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium

    SN - 1559-4076

    ER -