Logo image
Inappropriate survey design analysis of the Korean National Health and Nutrition Examination Survey may produce biased results
Journal article   Open access   Peer reviewed

Inappropriate survey design analysis of the Korean National Health and Nutrition Examination Survey may produce biased results

Yangho Kim, Sunmin Park, Nam-Soo Kim and Byung-Kook Lee
Journal of preventive medicine and public health, v 46(2), pp 96-104
Mar 2013
PMID: 23573374
url
https://doi.org/10.3961/jpmph.2013.46.2.96View
Published, Version of Record (VoR)CC BY-NC V4.0 Open

Abstract

Adult Aged Blood Pressure Bone Density Cadmium - blood Creatinine - blood Female Hemoglobins - analysis Humans Lead - blood Male Mercury - blood Middle Aged Nutrition Surveys PubMed Republic of Korea Research Design
The inherent nature of the Korean National Health and Nutrition Examination Survey (KNHANES) design requires special analysis by incorporating sample weights, stratification, and clustering not used in ordinary statistical procedures. This study investigated the proportion of research papers that have used an appropriate statistical methodology out of the research papers analyzing the KNHANES cited in the PubMed online system from 2007 to 2012. We also compared differences in mean and regression estimates between the ordinary statistical data analyses without sampling weight and design-based data analyses using the KNHANES 2008 to 2010. Of the 247 research articles cited in PubMed, only 19.8% of all articles used survey design analysis, compared with 80.2% of articles that used ordinary statistical analysis, treating KNHANES data as if it were collected using a simple random sampling method. Means and standard errors differed between the ordinary statistical data analyses and design-based analyses, and the standard errors in the design-based analyses tended to be larger than those in the ordinary statistical data analyses. Ignoring complex survey design can result in biased estimates and overstated significance levels. Sample weights, stratification, and clustering of the design must be incorporated into analyses to ensure the development of appropriate estimates and standard errors of these estimates.

Metrics

17 Record Views
89 citations in Scopus

Details

Logo image