Skip Navigation
Skip to contents

JPMPH : Journal of Preventive Medicine and Public Health

OPEN ACCESS
SEARCH
Search

Articles

Page Path
HOME > J Prev Med Public Health > Volume 46(2); 2013 > Article
Original Article
Inappropriate Survey Design Analysis of the Korean National Health and Nutrition Examination Survey May Produce Biased Results
Yangho Kim1, Sunmin Park2, Nam-Soo Kim3, Byung-Kook Lee4
Journal of Preventive Medicine and Public Health 2013;46(2):96-104.
DOI: https://doi.org/10.3961/jpmph.2013.46.2.96
Published online: March 28, 2013
  • 14,165 Views
  • 149 Download
  • 84 Crossref
  • 83 Scopus

1Department of Occupational and Environmental Medicine, Ulsan University Hospital, University of Ulsan College of Medicine, Ulsan, Korea.

2Department of Food and Nutrition, Hoseo University, Asan, Korea.

3Institue of Environmental & Occupational Medicine, Soonchunhyang University, Asan, Korea.

4Korea Industrial Health Association, Seoul, Korea.

Corresponding author: Byung-Kook Lee, MD. 179 Hyoryeong-ro, Seocho-gu, Seoul 137-870, Korea. Tel: +82-2-585-1584, Fax: +82-2-585-1584, bklee@kiha21.or.kr
• Received: November 13, 2012   • Accepted: March 15, 2013

Copyright © 2013 The Korean Society for Preventive Medicine

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

  • Objectives
    The inherent nature of the Korean National Health and Nutrition Examination Survey (KNHANES) design requires special analysis by incorporating sample weights, stratification, and clustering not used in ordinary statistical procedures.
  • Methods
    This study investigated the proportion of research papers that have used an appropriate statistical methodology out of the research papers analyzing the KNHANES cited in the PubMed online system from 2007 to 2012. We also compared differences in mean and regression estimates between the ordinary statistical data analyses without sampling weight and design-based data analyses using the KNHANES 2008 to 2010.
  • Results
    Of the 247 research articles cited in PubMed, only 19.8% of all articles used survey design analysis, compared with 80.2% of articles that used ordinary statistical analysis, treating KNHANES data as if it were collected using a simple random sampling method. Means and standard errors differed between the ordinary statistical data analyses and design-based analyses, and the standard errors in the design-based analyses tended to be larger than those in the ordinary statistical data analyses.
  • Conclusions
    Ignoring complex survey design can result in biased estimates and overstated significance levels. Sample weights, stratification, and clustering of the design must be incorporated into analyses to ensure the development of appropriate estimates and standard errors of these estimates.
The Korean National Health and Nutrition Examination Survey (KNHANES) is one of a series of health-related programs sponsored by the Korean Centers for Disease Control and Prevention [1]. The KNHANES has been used to assess the health and nutritional status of the non-institutionalized civilian population in Korea since 1998. Since the survey data became available for official public use in Korea, research papers using KNHANES data have become more common and have increased in numbers year by year [1]. Public access to the survey data has generated new momentum for research organizations, universities, and healthcare providers, including clinical medical researchers who had experienced difficulties in obtaining the raw data [2-4].
The KNHANES is a complex, stratified, multistage, probability-cluster survey of a representative sample of the non-institutionalized civilian population in Korea. The stratified multistage cluster sampling design creates non-independence among units, along with disproportionate sampling where some groups may be oversampled or a probability proportional to size has been applied [5,6]. This creates two primary challenges that must be addressed when analyzing complex survey data: 1) homogeneity that results from the non-simple random sample (i.e., non-independence) and 2) disproportionate sampling that results in unequal selection probabilities (e.g., oversampling or adjustment for non-response) [7,8]. Failure to address these issues results in incorrect estimation of standard errors, which often results in underestimation and an increased probability of a type I error [6,9].
Given the inherent nature of multiple complex survey designs, the KNHANES and the US NHANES provide specific guidelines for analysis and reporting of sample weights, so the stratification and clustering of the design must be incorporated into analyses to ensure appropriate estimates and standard errors. These guidelines warn that ignoring the complex design leads to biased estimates and overstated significance levels [10,11]. Regrettably, most of the published research articles using KNHANES data do not incorporate survey design analysis into their statistical analysis. Instead, most use regular standard statistical analysis, treating KNHANES data as if they were collected using a simple random sampling method. The objectives of this study were to: 1) explore the serious problem of misuse of statistical analyses using KNHANES data, 2) provide several examples of differing results when KNHANES data are analyzed using ordinary statistics and survey design statistics, and 3) recommend survey design statistics to calculate non-biased estimates for descriptive or analytical data analysis.
Experimental Design and Data Collection
The entire KNHANES program was designed to assess the health and nutritional status of adults and children in Korea. The KNHANES program began in 1998 and was conducted as a series of regular surveys in 2001 and 2005. In 2007, the survey became a continuous program that has focused on a variety of health and nutritional measurements to meet public need. The survey is conducted annually, using a rolling sampling design involving a complex, stratified, multistage, probability-cluster survey of a representative sample of the non-institutionalized civilian population in Korea.
Data analysis using the KNHANES requires special statistical analysis to handle the multistage complex sampling survey design, which yields data that differ from survey data collected using simple random sampling. Because of the inherent nature of the complex sampling survey design, the KNHANES provides specific guidelines for data analysis that should be incorporated into any survey design statistics developed using SAS or SPSS survey design programs, SUDAAN, and other relevant programs. This study analyzed the proportion of research papers that have used an appropriate statistical methodology since the KNHANES survey data became available for official public use. This study was restricted to the research papers cited in the PubMed online system from 2007 to 2012 (http://www.ncbi.nlm.nih.gov/PubMed). First, the research papers were classified into two groups: ordinary statistical data analysis papers treating the survey data as simple random sampling data; and design-based analysis papers that incorporated survey design into their analyses. Model-based analyses using multilevel or hierarchical data analysis were classified as special cases of sampling weighted data analysis papers incorporating survey design characteristics. To calculate the proportion of ordinary statistical data analyses and design-based analyses of the KNHANES, we searched the PubMed website for all available articles using the search terms "KNHANES or Korean National Health and Nutrition Examination Survey." Once collected, all the available articles were reviewed and classified into two groups (ordinary statistical data analysis without sampling weight and design-based analysis with sampling weight).
We also compared differences in mean and regression estimates between the ordinary statistical data analyses and design-based data analyses using KNHANES 2008 to 2010, which represented the second and third years of KNHANES IV (2007 to 2009) and the first year of KNHANES V (2010 to 2012). Detailed information on the design of the survey has been provided elsewhere [12,13]. Briefly, the survey consists of three components: a health interview survey, a health examination survey, and a nutrition survey. We used two different populations to compare differences in estimates based on ordinary statistical data analyses and design-based analyses. The first study population was restricted to female KNHANES 2008 to 2009 participants who completed the health examination survey, who had a bone mineral density measurement, and who were menopausal (including surgically-induced menopause) (n=567). The second study population was restricted to KNHANES 2008 to 2010 participants ≥20 years of age who had completed the health examination survey, including having their blood levels of lead, cadmium, and mercury measured (n=5919).
Information on age, education, smoking history, and alcohol intake was collected during the health interview. Height and weight were measured with the participants wearing light clothing and no shoes. The body mass index was calculated as weight in kilograms divided by the square of the height in meters. Residence area was categorized into urban areas (administrative divisions of a city) and rural areas (areas not classified as administrative divisions of a city). Detailed information on classification variables has been provided elsewhere [12,13].
Measurement of Blood Pressure
Blood pressure was measured while subjects were in a sitting position following a 5-minute rest period. The blood pressure was measured on three occasions with a mercury sphygmomanometer on the right arm and averaged for a final blood pressure reading. Hypertension was defined as diastolic blood pressure ≥90 mmHg or systolic blood pressure ≥140 mmHg. Prehypertension was defined as a diastolic pressure >80 mmHg or systolic blood pressure >120 mmHg.
Serum Creatinine and Hemoglobin Measurements
Serum creatinine was measured by the kinetic Jaffe method using an autoanalyzer (model 7600; Hitachi, Tokyo, Japan). Blood hemoglobin was measured with an XE-2100D (Sysmex, Tokyo, Japan).
Measurement of Bone Mineral Density
Bone mineral density was measured in the femur and lumbar spine by dual-energy X-ray absorptiometry at the health examination site using a QDR Discovery (formerly QDR 4500A) fan beam densitometer (Hologic, Inc., Bedford, MA, USA) [14]. Considering the available KNHANES data, we used the total femur T-score for the analysis.
Determination of Lead, Cadmium, and Mercury Levels in Whole Blood
To assess the levels of heavy metals in whole blood, 3-mL blood samples were drawn into standard commercial evacuated tubes containing sodium heparin (Vacutainer). Blood lead and cadmium were measured using graphite-furnace atomic absorption spectrometry with Zeeman background correction (Perkin Elmer AAnalyst 600; Perkin Elmer, Turku, Finland). Levels of blood mercury were measured using a gold-amalgam collection method with a DMA 80 (Milestone, Bergamo, Italy). The details of blood metal analyses have been provided elsewhere [12].
Statistical Analysis
Statistical analyses were performed using SAS version 9.3 (SAS Institute, Cary, NC, USA) and SUDAAN release 10.1 (Research Triangle Institute, Research Triangle Park, NC, USA), a software package that incorporates sample weights and adjusts analyses for the complex sample design of the survey. Survey sample weights were used in all analyses to produce estimates that were representative of the non-institutionalized civilian Korean population.
The levels of lead, cadmium, and mercury in the blood were log-transformed because their distributions were positively skewed, and the un-weighted and weighted geometric means (GM) with 95% confidence intervals (CI) were calculated by gender using the Proc Descript function in SUDAAN.
Odds ratios (ORs) and 95% CI for hypertension and prehypertension were calculated for log-transformed blood lead, cadmium, and mercury (base 2) levels as a continuous variable after covariate adjustment using Proc Rlogist with un-weighted and weighted statistical procedures. Covariates were gender, age, residence area, education level, smoking and drinking status, hemoglobin, body mass index, and serum creatinine.
Finally, the ORs and 95% CI values for osteoporosis were calculated for log-transformed blood lead, cadmium, and mercury (base 2) levels as continuous variables and quartiles of blood mercury in postmenopausal women after covariate adjustment using Proc Rlogist with un-weighted ordinary statistical data analyses and design-based weighted statistical procedures.
During the period between 2007 and June 2012, a total of 256 relevant research papers were cited in PubMed. Table 1 lists the proportions that used ordinary statistical data analyses and design-based weighted statistical analyses. The number of relevant articles published increased steadily by year, and increased more rapidly in recent years. Throughout the 5.5 year time period, 19.8% of the articles used design-based data analyses.
Table 2 lists the differences in point estimates and standard errors of means between the un-weighted and weighted analyses by gender and age group. Not only did the means differ between the two analyses, but the standard errors in the weighted analyses also tended to be larger compared to those in the un-weighted analyses.
ORs and 95% CIs for hypertension and prehypertension were calculated for log-transformed blood metal levels after adjusting for covariates (Table 3). The covariates for models 1 and 2 were gender, age, residence area, education level, smoking and drinking status, hemoglobin, and serum creatinine. In a logistic regression analysis using log-transformed blood cadmium as a continuous independent variable after covariate adjustment, the ORs and 95% CIs for hypertension with a doubling of blood cadmium were 1.240 (1.123 to 1.367) and 1.249 (1.117 to 1.398) in the ordinary statistical data analyses and design-based data analyses, respectively. However, a logistic regression analysis using log-transformed blood cadmium as a continuous independent variable after covariate adjustment revealed that the ORs and 95% CIs for pre-hypertension with a doubling of blood cadmium were 1.295 (1.178 to1.423) and 1.279 (1.147 to 1.426) in ordinary statistical data analyses and design-based analyses, respectively. While log-transformed blood lead did not exhibit any significant association with hypertension or prehypertension in logistic regression analyses regardless of type of analysis, log-transformed blood mercury exhibited a significant protective effect on prehypertension in un-weighted ordinary logistic regression analyses, while weighted design-based analyses did not reveal any significant associations between blood mercury and prehypertension.
Finally, Table 4 lists logistic regression analyses of blood metals on osteoporosis in menopausal women by ordinary statistical data analyses and design-based analyses. In the logistic regression analyses using log-transformed metals as a continuous independent variable after covariate adjustment, the ORs for osteoporosis with doubled blood lead were statistically significant between two types of analyses. The doubled blood mercury had a statistically significant OR (0.488: 0.320 to 0.743) in ordinary statistical data analyses, but no association was observed between blood mercury and osteoporosis in the design-based analysis. Similar findings were observed in logistic regression analyses using quartiles of blood mercury as an independent variable for osteoporosis. The OR (95% CI) of the highest quartile of blood mercury in ordinary statistical data analyses was 0.450 (0.251 to 0.808) with statistical significance; in design-based analyses, it was 0.575 (0.281 to 1.181) with no statistical significance.
Large-scale health surveys including the KNHANES and the US NHANES are increasingly being used to investigate associations between risk factors of diseases, nutritional status, and health-related outcomes [15-17]. Because these surveys record many variables for a large number of individuals, they enable many hypotheses to be addressed, some of which may not even be formulated until years after the surveys have been completed. Additionally, these surveys are frequently population-based, thereby avoiding the potential biases of hospital-based studies [3].
Generally, these large-scale health surveys use complex probability procedures, such as stratification, multiple stages of cluster selection, and oversampling to obtain a representative sample of the target population [5,18,19]. Because of these sampling procedures, analyses of these data using traditional statistical software (such as SPSS or SAS) that use ordinary and generalized least squares estimation techniques tend to result in an underestimated standard error, inappropriate confidence intervals, and misleading tests of significance [20]. Until a decade ago, many analysts of data collected in sample surveys felt comfortable using standard procedures in statistical software packages to analyze the data. These standard procedures were based on the assumption that the data being analyzed emerged from a simple random sample of the population of interest, where all sample respondents were randomly selected without replacement from the population, and all respondents had equal probability of being included in the sample [21]. During the last several decades, many survey data analysts have expressed their concerns that survey data were being analyzed using standard statistical procedures instead of specific procedures based on survey design [6,8].
In Korea, many research articles using KNHANES data have been published in peer-reviewed journals since the Korea Centers for Disease Control and Prevention released the KNHANES dataset to the research community in 2007, and the number of research articles using KNHANES data has increased remarkably over the last six years. The KNHANES provides a good source of data for studying the relationship between nutritional status, food habits, environmental factors, and health-related outcomes. Even though the proportion of weighted research articles has increased from 7.7% in 2007 to 26.9% in 2012, the majority of peer-reviewed research articles using KNHANES data cited in PubMed did not use appropriate analyses. Standard statistical analyses that do not use weighted multiple complex survey data generally 1) yield biased point estimates of population parameters, 2) underestimate the standard error for point estimates, 3) produce overly-narrow confidence intervals on population parameters, and 4) yield tests of significance that are overly likely to reject the null hypothesis because standard error or variability of statistics is generally underestimated, resulting in more frequent type I errors [3,6,20,22].
This study compared ordinary statistical data analyses without sampling weight and design-based (data analyzed using special survey design statistical procedures) GMs and their standard errors by gender and age group (Table 2). As anticipated, the GMs differed between the two groups, and standard errors of data based on weighted analyses were larger than those based on un-weighted data analyses. Clearly, ordinary statistical un-weighted GMs and standard errors are not the same as design-based GMs and standard errors, and ordinary un-weighted GMs and standard errors cannot be used as an alternative to weighted GMs in analyses of survey data [23].
The failure of data analysts to use appropriate statistical software procedures for unbiased analyses of survey data essentially negates the considerable money and effort needed to collect the data, and can result in scientific publications that present skewed pictures of populations of research interest [21]. Un-weighted analyses of complex multi-stage cluster sampling data tend to have a narrow confidence interval, which creates biased and skewed results and generates a type I error. This study illustrated that un-weighted data analyses generated incorrect conclusions, for example that blood mercury is associated with a protective effect on prehypertension (Table 3, model 2) in an adult population and is associated with having osteoporosis among menopausal women (Table 4); these results were due to the narrow confidence intervals.
The cross-sectional nature of most survey designs like KNHANES makes it difficult to draw causal associations between health-related outcomes and certain independent variables, including heavy metals such as blood mercury. The survey data can only provide statistical associations through conservative and appropriate statistical analysis and plausible scientific justification. In this study, blood mercury was a significant predictor for the prevention of osteoporosis among menopausal women using an un-weighted analysis. This finding reconfirmed a recent publication regarding this topic, which claimed that high blood mercury has a protective effect for osteoporosis among Korean menopausal women [24]. The authors analyzed 481 postmenopausal women who participated in KNHANES 2008 and underwent bone mineral density measurement. We reanalyzed the data on these subjects using the same analysis format, but were unable to recreate the results due to the total number of menopausal women who were eligible for their inclusion criteria (menopausal and measurement of bone mineral density). In 2008, KNHANES only measured the bone mineral density of the participants who were enrolled in the later part of the survey (about 50% of all participants). Therefore, we analyzed two years of data (2008 to 2009) including 567 postmenopausal women and obtained the same results of protective effect of mercury for osteoporosis using an ordinary statistical data analysis without sampling weight, but failed to obtain statistical significance in design-based statistical analysis. The KNHANES measured total blood mercury, which included mainly organic mercury with a small portion of inorganic mercury. Because most organic mercury comes from foods including various fishes, high levels of fish consumption may be beneficial from a nutritional standpoint, but may also increase blood mercury levels. Therefore, it is unclear whether high blood mercury has a protective effect on osteoporosis. It is possible that the blood mercury level is simply another unknown index of fish consumption.
Table 3, model 1, reveals no differences between the ordinary statistical data analysis and design-based analysis. This is the most desirable outcome for an un-weighted analysis of survey data. In the past, it was common to use ordinary statistical procedures due to the lack of availability of statistical software capable of more complex analyses. However, during the last two decades, suitable software has become available and is easily incorporated into ordinary statistical packages such as SAS, SPSS, and STATA. Therefore, analysts cannot claim the scarcity of software tools as a justification for using ordinary statistical packages, which treat the sample design as simple random sampling [6,8].
Two basic approaches are generally available for the analysis of survey design data: design- and model-based approaches [6,25]. Design-based analysis incorporates all the characteristics of multiple complex sampling designs (weighting, stratification, clustering, and post-stratification) and is the standard analysis method in the majority of national survey designs [26-28]. In contrast, model-based analysis does not use sample weighting, but instead uses a standard statistical method that considers weighting, stratification, and clustering in the modeling. As long as the model describes every possible observation to explain relationships accurately, model-based analysis can ignore the complexity of survey design, even for weighted correlated data. Unfortunately, theoretically derived models known to hold for all observations often do not exist for survey situations, unlike those derived from the physical sciences [6,8].
Over the past 10 years, many researchers in the health sciences have become interested in conducting secondary analyses using data from complex sample surveys. These analyses are descriptive, analytical, hypothesis-generating, or model-building. Sample survey statisticians are aware that specialized software should be used to analyze complex sample survey data, particularly when analyses are descriptive or analytical and the survey design includes clustering [20]. Until recently, some analysts in Korea thought that un-weighted ordinary statistical data analysis was the same as model-based analysis, and did not require sample weighting [29-31]. The lack of awareness about the necessity of using weighted analysis in survey design analysis resulted in biased estimates, generating model misspecification and type I errors in the majority of published articles using the KNHANES in Korea.
Given the inherent nature of multiple complex survey design, the NHANES and KNHANES provide specific guidelines for analysis and reporting of sample weights, and state that the stratification and clustering of the design must be incorporated into the analysis to obtain accurate estimates and standard errors. The guidelines warn that ignoring the complex design will lead to biased estimates and overstated significance levels [10,11]. Hahs-Vaughn et al. [32] reviewed methodological considerations in using complex survey data from the Head Start Family and Child Experiences Survey. They warned that failing to address survey design issues resulted in underestimated standard errors and biased parameters. To avoid methodological problems in survey design data analyses, they recommended reporting practices for authors, editorial board members, and editors to assist in ensuring transparency and greater ease in replication when using complex sample data. Their recommendations for authors were as follows: 1) specify the survey weight applied during the analyses to correct for disproportionate sampling; 2) if a design-based approach is followed, specify how variances have been estimated; 3) if the complex sample design is not addressed in the analyses, provide information to help the reader understand why that choice was appropriate and how it affects interpretation of the results.
The recommendations for authors should be implemented as part of the journal's manuscript submission guidelines. Their recommendations for journal editors were as follows: 1) require authors to report the survey weights and variance estimation method when their manuscript includes analyses of complex sample data; 2) providing resources to the editorial board, such as a manuscript or other primer [15] that provides information about complex survey data and can be a helpful tool when reviewing manuscripts that have analyzed this type of data. The analysis guidelines of data providers such as NHANES and KNHANES that incorporate a multiple complex sampling design must be followed; if not, any use of other analysis methods must be justified scientifically, as with model-based analysis, which uses standard statistical methods that consider survey design complexity, such as stratification, clustering, and non-response.
Although two basic approaches are generally available, it should be noted that there may be three possible statistical methods for handling the data of a multistage complex sampling survey design : the first is the un-weighted ordinary statistical method that takes into account neither complex sample survey design nor sample weights; the second is the weighted ordinary statistical method without consideration of the complex sample survey design; the last is incorporating sample weights and properly taking into consideration complex sample survey design. However, we were not able to identify the second method due to the lack of information on statistical methods provided by the reviewed studies. Instead, we classified both the first and second methods as ordinary statistical analysis, and the last one as design-based analysis. This is a limitation of the present study.
The emerging new era of data analysis using the KNHANES promises a bright future for health and nutrition-related scientific research in Korea, which will eventually increase our knowledge and contribute to a better understanding of human health. As the survey data accumulate annually, the richness of the data for more in-depth analysis becomes increasingly apparent. The demand for taking fuller advantage of such a rich data source is increasing, but it is vital to ensure sound scientific justification and awareness of the limitations of the survey design data. Thus, appropriate statistical analysis that incorporates the sample survey design needs to be mandatory.

The authors have no conflicts of interest with the material presented in this paper.

  • 1. Korea Centers for Disease Control and Prevention. Second workshop for the data analysis of the Korea National Health & Nutrition Examination Survey and online survey of adolescent health behavior. 2012. Cheongwon: Korea Centers for Disease Control and Prevention; p. 1-60 (Korean)
  • 2. Jacobson AF, Hamilton P, Galloway J. Obtaining and evaluating data sets for secondary analysis in nursing research. West J Nurs Res 1993;15(4):483-494. 8356839ArticlePubMed
  • 3. Korn EL, Graubard BI. Analysis of large health surveys: accounting for the sampling design. J R Stat Soc Ser A Stat Soc 1995;158(2):263-295Article
  • 4. Magee T, Lee SM, Giuliano KK, Munro B. Generating new knowledge from existing data: the use of large data sets for nursing research. Nurs Res 2006;55(2 Suppl):S50-S56. 16601635ArticlePubMed
  • 5. Levy PS, Lemeshow S. Sampling of populations: methods and applications. 1999. 3rd ed. New York: Wiley-Interscience Publication; p. 333-363
  • 6. Lee ES, Forthofer RN. Analyzing complex survey data. 2006. 2nd ed. London: SAGA Publications; p. 11-20
  • 7. Wheeler DC, VanHorn JE, Paskett ED. A comparison of design-based and model based analysis of sample survey in geography. 2007. Atlanta: Rollings School of Public Health, Emory University; p. 1-34
  • 8. Lohr SL. Sampling: design and analysis. 2010. 2nd ed. Boston: Brooks/Cole, Cengage Learning; p. 281-320
  • 9. Korn EL, Graubard BI. Analysis of health surveys. 1999. New York: Wiley-Interscience Publication; p. 8-50
  • 10. National Center for Health Statistics. The National Health and Nutrition Examination Survey (NHANES): analytic and reporting guidelines. 2012. Atlanta: Centers for Disease Control and Prevention; p. 1-14
  • 11. Korea Centers for Disease Control and Prevention. Guideline for the evaluation of the fourth Korea National Health and Nutrition Examination Survey. 2009. Cheonwon: Korea Centers for Disease Control Prevention; p. 19-34 (Korean)
  • 12. Lee BK, Kim Y. Iron deficiency is associated with increased levels of blood cadmium in the Korean general population: analysis of 2008-2009 Korean National Health and Nutrition Examination Survey data. Environ Res 2012;112: 155-163. 22079861ArticlePubMed
  • 13. Park S, Lee BK. Vitamin D deficiency is an independent risk factor for cardiovascular disease in Koreans aged ≥50 years: results from the Korean National Health and Nutrition Examination Survey. Nutr Res Pract 2012;6(2):162-168. 22586506ArticlePubMedPMC
  • 14. Hong S, Oh HJ, Choi H, Kim JG, Lim SK, Kim EK, et al. Characteristics of body fat, body fat percentage and other body composition for Koreans from KNHANES IV. J Korean Med Sci 2011;26(12):1599-1605. 22147997ArticlePubMedPMC
  • 15. Hahs-Vaughn DL. A primer for using and understanding weights with national datasets. J Exp Educ 2005;73(3):221-248Article
  • 16. National Research Council. National Research Council. Methods for analysis of complex surveys. Understanding American agriculture: challenges for the agricultural resource management survey. 2007. Washington, DC: National Academies Press; p. 127-148
  • 17. Burden S, Probst Y, Steel DG, Tapsell LC. The impact of complex survey design on prevalence estimates of intakes of food groups in the Australian National Children's Nutrition and Physical Activity Survey. 2010. New South Wales: Centre for Statistical and Survey Methodology, University of Wollongong; p. 1-21
  • 18. Kalton G. Models in the practice of survey sampling (revisited). J Off Stat 2002;18(2):129-154
  • 19. Rodgers-Farmer AY, Davis D. Analyzing complex survey data. Soc Work Res 2001;25(3):185-192Article
  • 20. Brogan D. In: Armitage P, Colton T, editors. Software for sample survey data, misuse of standard packages. Encyclopedia of biostatistics. 2005. 2nd ed. Estados Unidos: John Wiley & Sons; p. 5057-5064Article
  • 21. West BT. Statistical and methodological issues in the analysis of complex sample survey data: practical guidance for trauma researchers. J Trauma Stress 2008;21(5):440-447. 18956450ArticlePubMed
  • 22. Lemeshow S, Letenneur L, Dartigues JF, Lafont S, Orgogozo JM, Commenges D. Illustration of analysis taking into account complex survey considerations: the association between wine consumption and dementia in the PAQUID study. Am J Epidemiol 1998;148(3):298-306. 9690368ArticlePubMed
  • 23. Korn EL, Graubard BI. Examples of differing weighted and unweighted estimates from a sample survey. Am Stat 1995;49(3):291-295Article
  • 24. Cho GJ, Park HT, Shin JH, Hur JY, Kim SH, Lee KW, et al. The relationship between blood mercury level and osteoporosis in postmenopausal women. Menopause 2012;19(5):576-581. 22205147ArticlePubMed
  • 25. Heeringa SG, West BT, Berglund PA. Applied survey data analysis. 2005. London: CRC Press; p. 13-50
  • 26. Park I, Lee H. Design effects for the weighted mean and total estimators under complex survey sampling. Surv Methodol 2004;30(2):183-193
  • 27. Centers for Disease Control and Prevention. Specifying weighting parameters. 2011. cited 2013 Mar 1. Available from: http://www.cdc.gov/nchs/tutorials/nhanes/SurveyDesign/Weighting/intro.htm
  • 28. Centers for Disease Control and Prevention. National Health and Nutrition Examination Survey, 2007-2008. 2012. cited 2013 Mar 1. Available from: http://www.cdc.gov/nchs/data/nhanes/nhanes_07_08/overviewbrochure_0708.pdf
  • 29. Lee BK, Kim Y. Proper sample-weighted data analysis is required to confirm the association between blood cadmium concentration and lipid profile in Korean adults: re: Kim K. Blood cadmium concentration and lipid profile in Korean adults. Environ. Res. 2011. doi:10.1016/j.envres.2011.12.008. Environ Res 2012;115: 66-67. 22459296ArticlePubMed
  • 30. Lee BK. Without the application of appropriate statistical methods, it is difficult to reach the proper conclusion. Menopause 2012;19(6):710. 22568996ArticlePubMed
  • 31. Platt RW, Harper SB. Survey data with sampling weights: is there a "best" approach? Environ Res 2013;120: 143-144. 22995642ArticlePubMed
  • 32. Hahs-Vaughn DL, McWayne CM, Bulotsky-Shearer RJ, Wen X, Faria AM. Methodological considerations in using complex survey data: an applied example with the Head Start Family and Child Experiences Survey. Eval Rev 2011;35(3):269-303. 21917712ArticlePubMed
Table 1.
Number (%) of research articles published in peerreviewed journals cited in PubMed using Korean National Health and Nutrition Examination Survey data during 2007 to 20121
Published year No. of research articles (%)
Ordinary statistical analysis Design-based analysis Total
2007 12 (92.3) 1 (7.7) 13
2008 15 (88.2) 2 (11.8) 17
2009 24 (88.8) 3 (11.2) 27
2010 40 (87.0) 6 (13.0) 46
2011 58 (76.3) 18 (23.7) 76
20121 57 (73.1) 21 (26.9) 78
Total 206 (80.2) 51 (19.8) 257

1 Until the end of June.

Table 2.
Comparison of geometric mean±standard error of blood metals between ordinary statistical data analysis and designbased analysis by gender, age groups in Korean adult population
Classification n Blood lead (μg/dL)
Blood cadmium (μg/L)
Blood mercury (μg/L)
Ordinary statistical analysis Design-based analysis Ordinary statistical analysis Design-based analysis Ordinary statistical analysis Design-based analysis
Total 5919 2.310±0.012 2.288±0.015 0.969±0.007 0.967±0.010 4.352±0.033 4.303±0.052
Gender Male 2957 2.735±0.019 2.700±0.021 0.888±0.010 0.886±0.012 5.205±0.056 5.173±0.080
Female 2962 1.951±0.014 1.943±0.018 1.057±0.011 1.055±0.014 3.639±0.034 3.587±0.047
Age (y) 20-29 1142 1.820±0.020 1.816±0.024 0.596±0.011 0.597±0.014 3.614±0.053 3.652±0.067
30-39 1186 2.129±0.024 2.152±0.025 0.874±0.014 0.876±0.018 4.313±0.068 4.287±0.076
40-49 1196 2.402±0.029 2.421±0.034 1.084±0.016 1.078±0.017 4.846±0.081 4.859±0.093
50-59 1191 2.690±0.030 2.672±0.030 1.218±0.019 1.209±0.022 5.022±0.085 5.033±0.100
>60 1204 2.595±0.032 2.502±0.037 1.212±0.017 1.243±0.022 4.084±0.074 3.832±0.106
Table 3.
Comparison of logistic regression analysis1 of blood metals on hypertensive status in adults between ordinary statistical data analysis and design-based analysis during 2008 to 2010
Independent variable Ordinary statistical analysis Design-based analysis

Odds ratio (95% confidence interval)2
Model 1. Dependent variable: hypertension
 Log blood lead (μg/dL) 0.983 (0.859, 1.124) 0.999 (0.854, 1.170)
 Log blood cadmium (μg/L) 1.240 (1.123, 1.369) 1.249 (1.117, 1.398)
 Log blood mercury (μg/L) 0.963 (0.882, 1.051) 0.968 (0.878, 1.068)
Model 2. Dependent variable: pre-hypertension
 Log blood lead (μg/dL) 1.137 (0.995, 1.298) 1.173 (1.001, 1.375)
 Log blood cadmium (μg/L) 1.295 (1.178, 1.423) 1.279 (1.147, 1.426)
 Log blood mercury (μg/L) 0.902 (0.827, 0.984) 0.924 (0.833, 1.023)

1 Adjusted for sex, age, education, body mass index, smoking and drinking status, hemoglobin and serum creatinine.

2 For doubling of blood metals.

Table 4.
Comparison of logistic regression analysis1 of blood metals on osteoporosis in menopausal women between ordinary statistical data analysis and design-based analysis
Independent variable Ordinary statistical analysis Design-based analysis

Odds ratio (95% confidence interval)
Model 1. Continuous blood metals
 Log blood lead (μg/dL) 1.771 2.371
(1.029, 3.047)2 (1.307, 4.301)2
 Log blood cadmium (μg/L) 0.899 0.952
(0.575, 1.406)2 (0.584, 1.552)2
 Log blood mercury (μg/L) 0.488 0.628
(0.320, 0.743)2 (0.376, 1.048)2
Model 2. Categorized blood mercury
≤2.504 1 (reference) 1 (reference)
Blood mercury quartiles (μg/L) >2.504 to 3.487 0.863 1.122
(0.475, 1.569) (0.537, 2.345)
>3.487 to 5.001 0.611 0.944
(0.342, 1.093) (0.475, 1.877)
>5.001 0.450 0.575
(0.251, 0.808) (0.280, 1.181)

1 Adjusted for age, education, body mass index, smoking and drinking status, hemoglobin, and serum creatinine.

2 For doubling of blood metals.

Figure & Data

References

    Citations

    Citations to this article as recorded by  
    • Association Between High Blood Folate Levels and Glaucoma in a Representative Korean Population
      Ji Young Lee, Jin A. Choi, Sung Pyo Park, Donghyun Jee
      Investigative Opthalmology & Visual Science.2024; 65(1): 6.     CrossRef
    • Receipt of core antenatal care components and associated factors in Ethiopia: a multilevel analysis
      Anagaw Derseh Mebratie
      Frontiers in Global Women's Health.2024;[Epub]     CrossRef
    • The Chinese version of informant AD8 for mild cognitive impairment and dementia screening in community‐dwelling older adults
      Yangyang Wang, Tingting Liu, Yan Cai, Yue Wu, Yunbo Nie, Weihong Kuang, Peiyuan Qiu, Yang Wan
      Public Health Nursing.2023; 40(2): 258.     CrossRef
    • Air Pollution as a Risk Indicator for Periodontitis
      Crystal Marruganti, Hye-Sun Shin, Seon-Ju Sim, Simone Grandini, Andreina Laforí, Mario Romandini
      Biomedicines.2023; 11(2): 443.     CrossRef
    • The co-occurrence of the two main oral diseases: periodontitis and dental caries
      Giacomo Baima, Hye-Sun Shin, Mariantonietta Arrica, Andreina Laforí, Massimo Cordaro, Mario Romandini
      Clinical Oral Investigations.2023; 27(11): 6483.     CrossRef
    • Association of temporomandibular disorders and tinnitus with health‐related quality of life: A cross‐sectional study using the Fifth Korea National Health and Nutrition Examination Survey
      Geon‐Sik Kong, Sook‐Hyun Lee, Kyoung Sun Park, Jae‐Heung Cho, Koh‐Woon Kim, In‐Hyuk Ha
      Journal of Oral Rehabilitation.2022; 49(3): 283.     CrossRef
    • Discordance in Bone Mineral Density between the Lumbar Spine and Femoral Neck Is Associated with Renal Dysfunction
      Seung Eun Lee, Ju-Hyun Park, Kyoung-Ah Kim, Han Seok Choi
      Yonsei Medical Journal.2022; 63(2): 133.     CrossRef
    • How to Write Statistical Analysis Section in Medical Research
      Alok Kumar Dwivedi
      Journal of Investigative Medicine.2022; 70(8): 1759.     CrossRef
    • Analysis of secondary data: Considerations revisited
      Pederson Linda L, Koval John J, Vingilis Evelyn
      Journal of Addiction Medicine and Therapeutic Science.2022; 8(1): 010.     CrossRef
    • Prevalence and risk factors of epiretinal membrane: Data from the Korea National Health and Nutrition Examination Survey VII (2017–2018)
      Jun Sik Kim, Min Kim, Sun Woong Kim
      Clinical & Experimental Ophthalmology.2022; 50(9): 1047.     CrossRef
    • Reliability of Portable Spirometry Performed in the Korea National Health and Nutrition Examination Survey Compared to Conventional Spirometry
      Hye Jung Park, Chin Kook Rhee, Kwang Ha Yoo, Yong Bum Park
      Tuberculosis and Respiratory Diseases.2021; 84(4): 274.     CrossRef
    • Association between blood cadmium levels and the risk of osteopenia and osteoporosis in Korean post-menopausal women
      Eun-San Kim, Sangah Shin, Yoon Jae Lee, In-Hyuk Ha
      Archives of Osteoporosis.2021;[Epub]     CrossRef
    • Association between dual use of e-cigarette and cigarette and chronic obstructive pulmonary disease: an analysis of a nationwide representative sample from 2013 to 2018
      Taeyun Kim, Jihun Kang
      BMC Pulmonary Medicine.2021;[Epub]     CrossRef
    • Effects of education, income, and occupation on prevalence and symptoms of knee osteoarthritis
      Ji Yeon Lee, Kyungdo Han, Yong Gyu Park, Sung-Hwan Park
      Scientific Reports.2021;[Epub]     CrossRef
    • Association of Participation in Disease Management Programs and Health-Related Quality of Life in Korean Population: Results from the Korea National Health and Nutrition Examination Survey IV and V (2007-2012)
      Wonkyung Lee, Euna Han, Junjeong Choi
      Journal of Primary Care & Community Health.2021; 12: 215013272110121.     CrossRef
    • Hypertension and diabetes mellitus as risk factors for asthma in Korean adults: the Sixth Korea National Health and Nutrition Examination Survey
      Kyung Hee Lee, Hea Shoon Lee
      International Health.2020; 12(4): 246.     CrossRef
    • Positive Effects of the National Cigarette Price Increase Policy on Smoking Cessation in South Korea
      Do Sun Kwon, Tae Hee Kim, Min Kwang Byun, Hyung Jung Kim, Hye Sun Lee, Hye Jung Park
      Tuberculosis and Respiratory Diseases.2020; 83(1): 71.     CrossRef
    • Association Between Dietary Nutrient Intake and Chronic Obstructive Pulmonary Disease Severity: A Nationwide Population-Based Representative Sample
      Taeyun Kim, Hyunji Choi, Jehun Kim
      COPD: Journal of Chronic Obstructive Pulmonary Disease.2020; 17(1): 49.     CrossRef
    • Sleep duration and health-related quality of life in Korean adults: 2007-2015 Korea National Health and Nutrition Examination Survey
      Jaeyoung Cho, Nakwon Kwak, Sun Mi Choi, Jinwoo Lee, Young Sik Park, Chang-Hoon Lee, Sang-Min Lee, Chul-Gyu Yoo, Young Whan Kim, Sung Koo Han
      Sleep and Breathing.2020; 24(2): 725.     CrossRef
    • Association between serum 25-hydroxyvitamin D levels and myopia in general Korean adults
      ByungJ Jung, Donghyun Jee
      Indian Journal of Ophthalmology.2020; 68(1): 15.     CrossRef
    • Hormone‐related events and periodontitis in women
      Mario Romandini, Hye‐Sun Shin, Pierluigi Romandini, Andreina Laforí, Massimo Cordaro
      Journal of Clinical Periodontology.2020; 47(4): 429.     CrossRef
    • Age- and sex-based evaluation of the association between refractive error and age-related macular degeneration in the Korean population
      Kook Lee, Jin-Woo Kwon, Wan Jin Jahng, Young-Hoon Park, Donghyun Jee, Shree K. Kurup
      PLOS ONE.2020; 15(1): e0228468.     CrossRef
    • Trend in the Prevalence of Non-Daily Smoking and Their Relationship with Mental Health Using the Korea Health and Nutrition Examination Survey
      Yunna Kwan, Hye Sim Kim, Dae Ryong Kang, Tae Hui Kim
      International Journal of Environmental Research and Public Health.2020; 17(10): 3396.     CrossRef
    • Increased Overall Heart Rate Irregularity Risk by Hyperuricemia in the General Population: Results from the Korean National Health and Nutrition Examination Survey
      Yeonghee Eun, Kyung-Do Han, Da Hye Kim, In Young Kim, Eun-Jung Park, Seulkee Lee, Hoon-Suk Cha, Eun-Mi Koh, Jaejoon Lee, Hyungjin Kim
      Medicina.2020; 56(10): 501.     CrossRef
    • Association between Relative Handgrip Strength and Osteoporosis in Older Women: The Korea National Health and Nutrition Examination Survey 2014–2018
      Kwang-Ho Ahn, Yunhwan Lee, Tae-yong Sohn, Dong Yun Kim, Mikyung Ryu, Ho Gym, Sol Lee
      Annals of Geriatric Medicine and Research.2020; 24(4): 243.     CrossRef
    • Lack of Association Between Vitamin D and Hand Grip Strength in Asians: A Nationwide Population-Based Study
      Beom-Jun Kim, Mi Kyung Kwak, Seung Hun Lee, Jung-Min Koh
      Calcified Tissue International.2019; 104(2): 152.     CrossRef
    • The Relationship Between Housing Types and Metabolic and Weight Phenotypes: A Nationwide Survey
      Kayoung Lee
      Metabolic Syndrome and Related Disorders.2019; 17(3): 129.     CrossRef
    • Income and Education are Independently Associated with Visual Impairment: The Korean National Health and Nutrition Examination Survey 2010-2012
      Chang Rae Rho, HyunSeung Kim, Man Soo Kim, Eun Chul Kim
      Seminars in Ophthalmology.2019; 34(3): 131.     CrossRef
    • Is There a Relation Between Lateral Epicondylitis and Total Cholesterol Levels?
      Seung Hoo Lee, Hyun Sik Gong, Sehun Kim, Jihyeung Kim, Goo Hyun Baek
      Arthroscopy: The Journal of Arthroscopic & Related Surgery.2019; 35(5): 1379.     CrossRef
    • The Association between Sleep Duration and Dizziness in Korean Women: The Korea National Health and Nutrition Examination Survey
      Se-Hwan Hwang, Jun-Myung Kang, Jae-Hyun Seo, Kyung-do Han, Young-Hoon Joo
      Journal of Korean Medical Science.2019;[Epub]     CrossRef
    • How to use replicate weights in health survey analysis using the National Nutrition and Physical Activity Survey as an example
      Carole L Birrell, David G Steel, Marijka J Batterham, Ankur Arya
      Public Health Nutrition.2019; 22(18): 3315.     CrossRef
    • Associations between Retinal Nerve Fiber Layer Defect and Systemic Indices According to the KNHNES 2010–2012
      Suk Hoon Jung, Sooji Jeon, Chan Kee Park, Hae-Young Lopilly Park
      Journal of the Korean Ophthalmological Society.2019; 60(11): 1089.     CrossRef
    • Lower hand grip strength in older adults with non-alcoholic fatty liver disease: a nationwide population-based study
      Beom-Jun Kim, Seong Hee Ahn, Seung Hun Lee, Seongbin Hong, Mark W. Hamrick, Carlos M. Isales, Jung-Min Koh
      Aging.2019; 11(13): 4547.     CrossRef
    • Lower leg muscle mass relates to knee pain in patients with knee osteoarthritis
      Ji Yeon Lee, Kyungdo Han, Timothy E. McAlindon, Yong Gyu Park, Sung‐Hwan Park
      International Journal of Rheumatic Diseases.2018; 21(1): 126.     CrossRef
    • The association of non‐alcoholic fatty liver disease with lung function: A survey design analysis using propensity score
      Min‐Sun Kwak, Eunyoung Kim, Eun Jin Jang, Chang‐Hoon Lee
      Respirology.2018; 23(1): 82.     CrossRef
    • The effects of protein intake on albuminuria in different estimated glomerular filtration rate: A population-based study
      Yan Liu, Rong-shao Tan, Dao-yuan Zhou, Xiao Xiao, Jian-min Ran, Dan-ping Qin, Xiao-shi Zhong, Jian-guang Hu, Yun Liu, Yuan-yuan Zheng
      European Journal of Internal Medicine.2018; 48: 80.     CrossRef
    • Korean survey data reveals an association of chronic laryngitis with tinnitus in men
      Myung Jin Ban, Won Shik Kim, Ki Nam Park, Jae Wook Kim, Seung Won Lee, Kyungdo Han, Jae Won Chang, Hyung Kwon Byeon, Yoon Woo Koh, Jae Hong Park, Sanjay B Jadhao
      PLOS ONE.2018; 13(1): e0191148.     CrossRef
    • The positive association of total protein intake with femoral neck strength (KNHANES IV)
      B.-J. Kim, S. H. Lee, C. M. Isales, J.-M. Koh, M. W. Hamrick
      Osteoporosis International.2018; 29(6): 1397.     CrossRef
    • Determinants of the utilization of postpartum family visits: Evidence from rural areas of Eastern China
      Hai Gu, Hua You, Zhiwen Yan, Nichao Yang, Yun Kou, Jun Sun, Ting Yu, Ning Zhang, Ganesh Dangal
      PLOS ONE.2018; 13(3): e0194061.     CrossRef
    • Prevalence and risk factors of elevated alanine aminotransferase among Korean adolescents: 2001-2014
      Ju Whi Kim, Kyung Jae Lee, Hye Ran Yang, Ju Young Chang, Jin Soo Moon, Young-Ho Khang, Jae Sung Ko
      BMC Public Health.2018;[Epub]     CrossRef
    • Comparison of the Marginal Utility and Disease Burden of Hearing Loss and Other Chronic Diseases
      Oh Deog Kwon, Se Young Jung, Hwa Yeon Park, Sue Kyoung Peak, Su Hwan Cho, Sang Jin Cho
      Korean Journal of Family Medicine.2018; 39(6): 364.     CrossRef
    • Association of Serum TSH With Handgrip Strength in Community-Dwelling Euthyroid Elderly
      Beom-Jun Kim, Seung Hun Lee, Carlos M Isales, Mark W Hamrick, Mi Kyung Kwak, Jung-Min Koh
      The Journal of Clinical Endocrinology & Metabolism.2018; 103(11): 3986.     CrossRef
    • Association between body mass index and health-related quality of life among Chinese elderly—evidence from a community-based study
      Hua You, Xiao-lu Li, Kang-zhen Jing, Zhi-guang Li, Hong-mei Cao, Jin Wang, Lan Bai, Jing-hong Gu, Xiaoman Fan, Hai Gu
      BMC Public Health.2018;[Epub]     CrossRef
    • Periodontitis and platelet count: A new potential link with cardiovascular and other systemic inflammatory diseases
      Mario Romandini, Andreina Laforí, Pierluigi Romandini, Giacomo Baima, Massimo Cordaro
      Journal of Clinical Periodontology.2018; 45(11): 1299.     CrossRef
    • Impact of Physical Activity and Sleep Duration on Depressive Symptoms in Hypertensive Patients: Results from a Nationally Representative Korean Sample
      Youn-Jung Son, Chanhee Park, Mi Won
      International Journal of Environmental Research and Public Health.2018; 15(12): 2611.     CrossRef
    • Inverse relationship between serum hsCRP concentration and hand grip strength in older adults: a nationwide population-based study
      Beom-Jun Kim, Seung Hun Lee, Mi Kyung Kwak, Carlos M. Isales, Jung-Min Koh, Mark W. Hamrick
      Aging.2018; 10(8): 2051.     CrossRef
    • High carbohydrate diets are positively associated with the risk of metabolic syndrome irrespective to fatty acid composition in women: the KNHANES 2007–2014
      Sunmin Park, Jaeouk Ahn, Nam-Soo Kim, Byung-Kook Lee
      International Journal of Food Sciences and Nutrition.2017; 68(4): 479.     CrossRef
    • Relationship between total fruit and vegetable intake and self-reported knee pain in older adults
      H.S. Han, C.B. Chang, D.-C. Lee, Jee-Yon Lee
      The Journal of nutrition, health and aging.2017; 21(7): 750.     CrossRef
    • Predictors of cardiorespiratory fitness in female and male adults with different body mass index: National Health and Nutrition Examination Survey 1999–2004 dataset
      Liang Chen, Jian Kuang, Jian-Hao Pei, Hong-Mei Chen, Zhong Chen, Zhong-Wen Li, Hua-Zhang Yang, Xiao-Ying Fu, Long Wang, Zhi-Jiang Chen, Shui-Qing Lai, Shu-Ting Zhang
      Annals of Medicine.2017; 49(1): 83.     CrossRef
    • The impact of parity and age at first and last childbirth on the prevalence of delayed-onset asthma in women: The Korean National Health and Nutrition Examination Survey
      Ji Ho Choi, Bora Lee, Kyung Do Han, Se Hwan Hwang, Jae Hoon Cho
      Maturitas.2017; 97: 22.     CrossRef
    • Sleep and diabetic retinopathy
      Donghyun Jee, Nana Keum, Seungbum Kang, Jorge G. Arroyo
      Acta Ophthalmologica.2017; 95(1): 41.     CrossRef
    • The association between periodontitis and sleep duration
      Mario Romandini, Gioele Gioco, Giorgio Perfetti, Giorgio Deli, Edoardo Staderini, Andreina Laforì
      Journal of Clinical Periodontology.2017; 44(5): 490.     CrossRef
    • Associations between Intraocular Pressure and Systemic Parameters according to the KNHNES 2008-2011
      Ji Young Lee, Hye Bin Yim, Kwi Young Kang, Na Young Lee
      Journal of the Korean Ophthalmological Society.2017; 58(4): 430.     CrossRef
    • Chronic obstructive pulmonary disease is independently associated with hypertension in men
      Seon-Hye Kim, Ju-Hee Park, Jung-Kyu Lee, Eun Young Heo, Deog Kyeom Kim, Hee Soon Chung
      Medicine.2017; 96(19): e6826.     CrossRef
    • Prevalence of Self-reported Allergic Diseases and IgE Levels: A 2010 KNHANES Analysis
      Hye Jung Park, Eun-Jin Kim, Dankyu Yoon, Jeom Kyu Lee, Woo-Sung Chang, Yoen-Mi Lim, Jung-Won Park, Joo-Shil Lee
      Allergy, Asthma & Immunology Research.2017; 9(4): 329.     CrossRef
    • The Prevalence of “Drinking and Biking” and Associated Risk Factors: The Korea National Health and Nutrition Examination Survey
      Se Hwan Hwang, Ma Rhip Ahn, Kyung Do Han, Jung Ho Lee
      Journal of Korean Medical Science.2017; 32(9): 1396.     CrossRef
    • Prevalences and Management of Diabetes and Pre-diabetes among Korean Teenagers and Young Adults: Results from the Korea National Health and Nutrition Examination Survey 2005–2014
      Eun-Hee Cho, Dayeon Shin, Keun-Hyok Cho, Junguk Hur
      Journal of Korean Medical Science.2017; 32(12): 1984.     CrossRef
    • Epidemiological association of olfactory dysfunction with hearing loss and dysphonia in the Korean population
      Jae Hong Park, Hyung Kwon Byeon, Ki Nam Park, Jae Wook Kim, Seung Won Lee, Kyung-do Han, Jae Won Chang, Won Shik Kim, Yoon Woo Koh, Myung Jin Ban
      Medicine.2017; 96(47): e8890.     CrossRef
    • Patient Awareness of Cataract and Age-related Macular Degeneration among the Korean Elderly: A Population-based Study
      Hankil Lee, Yong-Jung Jang, Hyung Keun Lee, Hye-Young Kang
      Korean Journal of Ophthalmology.2017; 31(6): 557.     CrossRef
    • Epiretinal Membrane: Prevalence and Risk Factors from the Korea National Health and Nutrition Examination Survey, 2008 through 2012
      Jong Min Kim, Hoyoung Lee, Jae Pil Shin, Jeeyun Ahn, Je Moon Yoo, Su Jeong Song, Sang Jin Kim, Se Woong Kang
      Korean Journal of Ophthalmology.2017; 31(6): 514.     CrossRef
    • Association Between Periodontitis and Low-Grade Albuminuria in Non-Diabetic Adults
      Seok Hui Kang, Jong Won Park, Kyu Hyang Cho, Jun-Young Do
      Kidney and Blood Pressure Research.2017; 42(2): 338.     CrossRef
    • Inverse relationship between sleep duration and myopia
      Donghyun Jee, Ian G. Morgan, Eun chul Kim
      Acta Ophthalmologica.2016;[Epub]     CrossRef
    • Prevalence, Awareness, and Risk Factors of Primary Open-Angle Glaucoma
      Ko Eun Kim, Moon Jung Kim, Ki Ho Park, Jin Wook Jeoung, Seok Hwan Kim, Chan Yun Kim, Se Woong Kang
      Ophthalmology.2016; 123(3): 532.     CrossRef
    • Association between Grapes Intake and Diabetic Retinopathy: Inhibitory Effect of Resveratol on Diabetic Retinopathy
      Bo Young Lee, Donghyun Jee
      Journal of the Korean Ophthalmological Society.2016; 57(2): 276.     CrossRef
    • The Association Between Smoking Tobacco After a Diagnosis of Diabetes and the Prevalence of Diabetic Nephropathy in the Korean Male Population
      Hyungseon Yeom, Jung Hyun Lee, Hyeon Chang Kim, Il Suh
      Journal of Preventive Medicine and Public Health.2016; 49(2): 108.     CrossRef
    • Relationship between tinnitus and suicidal behaviour in Korean men and women: a cross‐sectional study
      J.H. Seo, J.M. Kang, S.H. Hwang, K.D. Han, Y.H. Joo
      Clinical Otolaryngology.2016; 41(3): 222.     CrossRef
    • Gender Difference in the Epidemiological Association between Metabolic Syndrome and Olfactory Dysfunction: The Korea National Health and Nutrition Examination Survey
      Se-Hwan Hwang, Jun-Myung Kang, Jae-Hyun Seo, Kyung-do Han, Young-Hoon Joo, Yiqing Song
      PLOS ONE.2016; 11(2): e0148813.     CrossRef
    • Age- and Gender-Related Mean Hearing Threshold in a Highly-Screened Population: The Korean National Health and Nutrition Examination Survey 2010–2012
      Yun Hwi Park, Seung-Ho Shin, Sung Wan Byun, Ju Yeon Kim, Pietro Cipresso
      PLOS ONE.2016; 11(3): e0150783.     CrossRef
    • Serum 25-Hydroxyvitamin D Levels and Dry Eye Syndrome: Differential Effects of Vitamin D on Ocular Diseases
      Donghyun Jee, Seungbum Kang, Changzheng Yuan, Eunyoung Cho, Jorge G. Arroyo, Andrew W Taylor
      PLOS ONE.2016; 11(2): e0149294.     CrossRef
    • The Association of Metabolic Syndrome with Diabetic Retinopathy: The Korean National Health and Nutrition Examination Survey 2008–2012
      Tai Kyong Kim, Jae Yon Won, Jeong Ah Shin, Yong-Moon Park, Hyeon Woo Yim, Young-Hoon Park, Chi-Ling Chen
      PLOS ONE.2016; 11(6): e0157006.     CrossRef
    • Positive Association between Blood 25-Hydroxyvitamin D Levels and Pterygium after Control for Sunlight Exposure
      Donghyun Jee, Eun Chul Kim, Eunyoung Cho, Jorge G. Arroyo, Andrzej T Slominski
      PLOS ONE.2016; 11(6): e0157501.     CrossRef
    • The relationship between chronic obstructive pulmonary disease and comorbidities: A cross-sectional study using data from KNHANES 2010–2012
      Yong Suk Jo, Sun Mi Choi, Jinwoo Lee, Young Sik Park, Sang-Min Lee, Jae-Joon Yim, Chul-Gyu Yoo, Young Whan Kim, Sung Koo Han, Chang-Hoon Lee
      Respiratory Medicine.2015; 109(1): 96.     CrossRef
    • Association between blood cadmium level and bone mineral density reduction modified by renal function in young and middle-aged men
      Eunae Burm, Mina Ha, Ho-Jang Kwon
      Journal of Trace Elements in Medicine and Biology.2015; 32: 60.     CrossRef
    • Association between serum 25-hydroxyvitamin D levels and age-related cataracts
      Donghyun Jee, Eun Chul Kim
      Journal of Cataract & Refractive Surgery.2015; 41(8): 1705.     CrossRef
    • Metabolic Syndrome and Chronic Laryngitis
      Choung-Soo Kim, Seong-Soo Lee, Kyung-do Han, Young-Hoon Joo
      Medicine.2015; 94(43): e1890.     CrossRef
    • Association between Blood Lead Levels and Age-Related Macular Degeneration
      Ho Sik Hwang, Seung Bum Lee, Donghyun Jee, Demetrios Vavvas
      PLOS ONE.2015; 10(8): e0134338.     CrossRef
    • Association between Chronic Laryngitis and Particulate Matter Based on the Korea National Health and Nutrition Examination Survey 2008–2012
      Young-Hoon Joo, Seong-Soo Lee, Kyung-do Han, Kyung-Ho Park, Roger A Coulombe
      PLOS ONE.2015; 10(7): e0133180.     CrossRef
    • Association of Hearing Loss and Tinnitus with Health-Related Quality of Life: The Korea National Health and Nutrition Examination Survey
      Young-Hoon Joo, Kyung-do Han, Kyung Ho Park, Manuel S. Malmierca
      PLOS ONE.2015; 10(6): e0131247.     CrossRef
    • Relationship between Olfactory Dysfunction and Suicidal Ideation: The Korea National Health and Nutrition Examination Survey
      Young-Hoon Joo, Se-Hwan Hwang, Kyung-do Han, Jae-Hyun Seo, Jun-Myung Kang
      American Journal of Rhinology & Allergy.2015; 29(4): 268.     CrossRef
    • Association between Obesity and Chronic Laryngitis in Women - Data from the Korea National Health and Nutrition Examination Survey
      Young-Hoon Joo, Kyung-Do Han, Seong-Su Lee
      Obesity Facts.2015; 8(4): 252.     CrossRef
    • Risk of suicidal ideation in diabetes varies by diabetes regimen, diabetes duration, and HbA1c level
      Hoo-Yeon Lee, Myung-Il Hahm, Sang Gyu Lee
      Journal of Psychosomatic Research.2014; 76(4): 275.     CrossRef
    • Prevalence and Risk Factors for Age-Related Macular Degeneration: Korean National Health and Nutrition Examination Survey 2008–2011
      Tae Yoon La, Eunyoung Cho, Eun Chul Kim, Seungbum Kang, Donghyun Jee
      Current Eye Research.2014; 39(12): 1232.     CrossRef
    • Age-Related Macular Degeneration
      Sang Jun Park, Ju Hyun Lee, Se Joon Woo, Jeeyun Ahn, Jae Pil Shin, Su Jeong Song, Se Woong Kang, Kyu Hyung Park
      Ophthalmology.2014; 121(9): 1756.     CrossRef
    • Inverse Association between High Blood 25-Hydroxyvitamin D Levels and Diabetic Retinopathy in a Representative Korean Population
      Donghyun Jee, Kyung do Han, Eun Chul Kim, Demetrios Vavvas
      PLoS ONE.2014; 9(12): e115199.     CrossRef

    Related articles

    JPMPH : Journal of Preventive Medicine and Public Health