Journal article
Inside the black box: starting to uncover the underlying decision rules used in a one-by-one expert assessment of occupational exposure in case-control studies
Occupational and environmental medicine (London, England), v 70(3), pp 203-210
Mar 2013
PMID: 23155187
Featured in Collection : UN Sustainable Development Goals @ Drexel
Abstract
Objectives Evaluating occupational exposures in population-based case-control studies often requires exposure assessors to review each study participant's reported occupational information job-by-job to derive exposure estimates. Although such assessments likely have underlying decision rules, they usually lack transparency, are time consuming and have uncertain reliability and validity. We aimed to identify the underlying rules to enable documentation, review and future use of these expert-based exposure decisions. Methods Classification and regression trees (CART, predictions from a single tree) and random forests (predictions from many trees) were used to identify the underlying rules from the questionnaire responses, and an expert's exposure assignments for occupational diesel exhaust exposure for several metrics: binary exposure probability and ordinal exposure probability, intensity and frequency. Data were split into training (n=10 488 jobs), testing (n=2247) and validation (n=2248) datasets. Results The CART and random forest models’ predictions agreed with 92–94% of the expert's binary probability assignments. For ordinal probability, intensity and frequency metrics, the two models extracted decision rules more successfully for unexposed and highly exposed jobs (86–90% and 57–85%, respectively) than for low or medium exposed jobs (7–71%). Conclusions CART and random forest models extracted decision rules and accurately predicted an expert's exposure decisions for the majority of jobs, and identified questionnaire response patterns that would require further expert review if the rules were applied to other jobs in the same or different study. This approach makes the exposure assessment process in case-control studies more transparent, and creates a mechanism to efficiently replicate exposure decisions in future studies.
Metrics
Details
- Title
- Inside the black box: starting to uncover the underlying decision rules used in a one-by-one expert assessment of occupational exposure in case-control studies
- Creators
- David C Wheeler - Department of Biostatistics, Virginia Commonwealth University, Richmond, Virginia, USAIgor Burstyn - Department of Environmental and Occupational Health, Drexel University, Philadelphia, Pennsylvania, USARoel Vermeulen - Environmental and Occupational Health Division, Institute for Risk Assessment Sciences, Utrecht University, Utrecht, The NetherlandsKai Yu - Biostatistics Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, USASusan M Shortreed - Biostatistics Unit, Group Health Research Institute, Seattle, Washington, USAAnjoeka Pronk - TNO, Zeist, NetherlandsPatricia A Stewart - Stewart Exposure Assessments, LLC, Arlington, Virginia, USAJoanne S Colt - Occupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, USADalsu Baris - Occupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, USAMargaret R Karagas - Department of Community and Family Medicine, Dartmouth Medical School, Hanover, New Hampshire, USAMolly Schwenn - Maine Cancer Registry, Augusta, Maine, USAAlison Johnson - Vermont Cancer Registry, Burlington, Vermont, USADebra T Silverman - Occupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, USAMelissa C Friesen - Occupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, USA
- Publication Details
- Occupational and environmental medicine (London, England), v 70(3), pp 203-210
- Publisher
- British Medical Journal (BMJ)
- Resource Type
- Journal article
- Language
- English
- Academic Unit
- Environmental and Occupational Health
- Web of Science ID
- WOS:000314824000009
- Scopus ID
- 2-s2.0-84874664264
- Other Identifier
- 991014878241604721
UN Sustainable Development Goals (SDGs)
This publication has contributed to the advancement of the following goals:
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Web of Science research areas
- Public, Environmental & Occupational Health