LATEST PRINTED ISSUE

LATEST FREELY ACCESSIBLE MATERIALS

Using Paradata for Imputation of Missing Values in Sociological Survey Data: Results of Statistical Modeling (Case of Croatia and Slovakia)

stmm. 2024 (3): 62-82

DOI https://doi.org/10.15407/sociology2024.03.062

Full text: https://stmm.in.ua/archive/ukr/2024-3/6.pdf

ANDRII GORBACHYK, Candidate of Sciences in Mathematics, Associate Professor, Faculty of Sociology, Taras Shevchenko National University of Kyiv (64/13, Volodymyrska St., Kyiv, Ukraine, 01601)

a.gorbachyk@knu.ua

https://orcid.org/0000-0003-1944-435X

YAROSLAV KOSTENKO, PhD student, Faculty of Sociology, Taras Shevchenko National University of Kyiv (64/13, Volodymyrska St., Kyiv, Ukraine, 01601)

yarosl.kostenko@gmail.com

https://orcid.org/0009-0001-7878-5034

Missing values are a common issue in quantitative social researches. One of the ways to handle missing data is by data imputation. This article outlines the challenges of traditional data imputation methods, which often introduce biases, and presents an advanced approach that features integration of paradata—auxiliary information collected during surveys—into the imputation process, using the European Social Survey (ESS) as its dataset. It is proposed that the usage of paradata could enhance predictive models used for imputation. It discusses the practical applications of data imputation, particularly through the lens of sensitive topics such as LGBT issues in socially conservative countries, where missingness could be heavily skewed due to social inacceptability of certain answers. To evaluate the effectiveness of the proposed approach towards imputation, the research employs the approach of using the 'ideal dataset', which is a subset of the original dataset with no missing vales, and then introduces artificial missing values that are not MCAR (Missing Completely at Random) to simulate the real case of missing data. Having artificial missingness allows for evaluation of the imputation procedure by comparing it with the original dataset. The study uses a novel approach towards creation of realistic missing data patterns through clustering based on response patterns. The research uses advanced statistical methods to handle missing data, and incorporates paradata from the survey process to improve the accuracy of predictive models. By comparing statistical metrics such as RMSE, MAE, and R-squared, the article evaluates the effectiveness of these methods in mimicking the original dataset's variability.

Keywords: missing data; item non-response; data imputation; multiple imputation; paradata; missing data patterns; modelling of missing data

References

  1. Aitken, A., Hörngren, J., Jones, N., Lewis, D., & Zilhгo, M.J. (2004). Handbook on improving quality by analysis of process variables. Eurostat.

  2. Brunton-Smith, I. & Tarling, R. (2017). Harnessing paradata and multilevel multiple imputation when analysing survey data: A case study. International Journal of Social Research Methodology, 20(6), 709-720. https://doi.org/10.1080/13645579.2017.1287842

  3. Couper, M.P. (1998). Measuring Survey Quality in a CASIC Environment. Survey Research Center, University of Michigan.

  4. Graham, J.W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549-576. https://doi.org/10.1146/annurev.psych.58.110405.085530

  5. Lee, J. H. & Huber Jr., J. (2011). Multiple imputation with large proportions of missing data: How much is too much? In: Proceedings of the 23rd United Kingdom Stata Users' Group Meetings. Stata Users Group.

  6. Little, R.J.A. & Rubin, D.B. (1989). The analysis of social science data with missing values. Sociological Methods & Research, 18(2-3), 292-326. https://doi.org/10.1177/0049124189018002004

  7. Mathiowetz, N.A. (1998). Respondent expressions of uncertainty: Data source for imputation. Public Opinion Quarterly, 62(1), 47-56. McKnight, P.E., McKnight, K.M., Sidani, S., & Figueredo, A.J. (2007). Missing Data: A Gentle Introduction. Guilford Press. https://doi.org/10.1086/297830

  8. Newman, D.A. (2014). Missing data: Five practical guidelines. Organizational Research Methods, 17(4), 372-411. https://doi.org/10.1177/1094428114548590

  9. Rubin, D.B. (1987). Multiple Imputation for Nonresponse in Surveys. John Wiley & Sons, Inc. https://doi.org/10.1002/9780470316696

  10. Skafida, V., Morrison, F., & Devaney, J. (2022). Answer refused: Exploring item non-response on domestic abuse questions in a social survey affects analysis. Survey Research Methods, 16(2), 227-240.

Received 06.05.2024

Using Paradata for Imputation of Missing Values in Sociological Survey Data: Results of Statistical Modeling (Case of Croatia and Slovakia)

stmm. 2024 (3): 62-82

DOI https://doi.org/10.15407/sociology2024.03.062

Full text: https://stmm.in.ua/archive/ukr/2024-3/6.pdf

ANDRII GORBACHYK, Candidate of Sciences in Mathematics, Associate Professor, Faculty of Sociology, Taras Shevchenko National University of Kyiv (64/13, Volodymyrska St., Kyiv, Ukraine, 01601)

a.gorbachyk@knu.ua

https://orcid.org/0000-0003-1944-435X

YAROSLAV KOSTENKO, PhD student, Faculty of Sociology, Taras Shevchenko National University of Kyiv (64/13, Volodymyrska St., Kyiv, Ukraine, 01601)

yarosl.kostenko@gmail.com

https://orcid.org/0009-0001-7878-5034

Missing values are a common issue in quantitative social researches. One of the ways to handle missing data is by data imputation. This article outlines the challenges of traditional data imputation methods, which often introduce biases, and presents an advanced approach that features integration of paradata—auxiliary information collected during surveys—into the imputation process, using the European Social Survey (ESS) as its dataset. It is proposed that the usage of paradata could enhance predictive models used for imputation. It discusses the practical applications of data imputation, particularly through the lens of sensitive topics such as LGBT issues in socially conservative countries, where missingness could be heavily skewed due to social inacceptability of certain answers. To evaluate the effectiveness of the proposed approach towards imputation, the research employs the approach of using the 'ideal dataset', which is a subset of the original dataset with no missing vales, and then introduces artificial missing values that are not MCAR (Missing Completely at Random) to simulate the real case of missing data. Having artificial missingness allows for evaluation of the imputation procedure by comparing it with the original dataset. The study uses a novel approach towards creation of realistic missing data patterns through clustering based on response patterns. The research uses advanced statistical methods to handle missing data, and incorporates paradata from the survey process to improve the accuracy of predictive models. By comparing statistical metrics such as RMSE, MAE, and R-squared, the article evaluates the effectiveness of these methods in mimicking the original dataset's variability.

Keywords: missing data; item non-response; data imputation; multiple imputation; paradata; missing data patterns; modelling of missing data

References

  1. Aitken, A., Hörngren, J., Jones, N., Lewis, D., & Zilhгo, M.J. (2004). Handbook on improving quality by analysis of process variables. Eurostat.

  2. Brunton-Smith, I. & Tarling, R. (2017). Harnessing paradata and multilevel multiple imputation when analysing survey data: A case study. International Journal of Social Research Methodology, 20(6), 709-720. https://doi.org/10.1080/13645579.2017.1287842

  3. Couper, M.P. (1998). Measuring Survey Quality in a CASIC Environment. Survey Research Center, University of Michigan.

  4. Graham, J.W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549-576. https://doi.org/10.1146/annurev.psych.58.110405.085530

  5. Lee, J. H. & Huber Jr., J. (2011). Multiple imputation with large proportions of missing data: How much is too much? In: Proceedings of the 23rd United Kingdom Stata Users' Group Meetings. Stata Users Group.

  6. Little, R.J.A. & Rubin, D.B. (1989). The analysis of social science data with missing values. Sociological Methods & Research, 18(2-3), 292-326. https://doi.org/10.1177/0049124189018002004

  7. Mathiowetz, N.A. (1998). Respondent expressions of uncertainty: Data source for imputation. Public Opinion Quarterly, 62(1), 47-56. McKnight, P.E., McKnight, K.M., Sidani, S., & Figueredo, A.J. (2007). Missing Data: A Gentle Introduction. Guilford Press. https://doi.org/10.1086/297830

  8. Newman, D.A. (2014). Missing data: Five practical guidelines. Organizational Research Methods, 17(4), 372-411. https://doi.org/10.1177/1094428114548590

  9. Rubin, D.B. (1987). Multiple Imputation for Nonresponse in Surveys. John Wiley & Sons, Inc. https://doi.org/10.1002/9780470316696

  10. Skafida, V., Morrison, F., & Devaney, J. (2022). Answer refused: Exploring item non-response on domestic abuse questions in a social survey affects analysis. Survey Research Methods, 16(2), 227-240.

Received 06.05.2024

LATEST PRINTED ISSUE

LATEST FREELY ACCESSIBLE MATERIALS

} } } } }