Religious involvement over time: Assessing measurement invariance of the Religious Involvement scale in Ukraine
stmm. 2024 (4): 96-110
DOI https://doi.org/10.15407/sociology2024.04.096
Full text:
DANYIL KARAKAI, student of PhD program, Faculty of Sociology, Taras Shevchenko National University of Kyiv, Manager of Sociological Research at Kyiv School of Economics (4d, Glushkova Avenue, Kyiv, 03022)
dkarakai08@gmail.com
https://orcid.org/0000-0001-9121-5282
RUSLANA MOSKOTINA, PhD in Sociology, Assistant Professor, Department of Methodology and Methods of Sociological Research, Faculty of Sociology, Taras Shevchenko National University of Kyiv (4d, Glushkova Avenue, Kyiv, 03022)
rmoskotina@ukr.net
https://orcid.org/0000-0002-2195-3121
This study examines the measurement invariance of the Religious Involvement Scale (RI scale) in Ukraine. Using data from the European Social Survey (ESS) and a nationwide survey conducted just before the full-scale Russian invasion in 2022, we provide a detailed analysis of the RI scale in the Ukrainian context.
Previous research using multigroup confirmatory factor analysis (MGCFA) across countries lacked a focused analysis on Ukraine, especially after the Revolution of Dignity.
We used MGCFA to test the RI scale across different ESS waves and the 2022 Ukrainian survey. The metric invariance of the scale across all time points was not confirmed. We also tested results excluding data from occupied territories and found similar patterns. Partial metric invariance was observed for the period from 2004 to 2013. Our findings indicate that full metric invariance was only achieved for 2006-2013, with scalar invariance not achieved. In addition, the surveys conducted in 2004 and after 2014 had somewhat different patterns of correlations between scale components compared to other waves of the ESS.
We suggest that political dynamics have influenced the social aspects of religiosity in Ukraine; therefore, it is important to consider the political context when assessing religious involvement. Our preliminary findings highlight the importance of socio-political factors in measuring and interpreting religiosity.
Keywords: measurement invariance; religious involvement scale; MGCFA; religious transformation; longitudinal data
References
Billiet, J. (2002). Proposal for questions on religious identity. In European Social Survey Core Questionnaire Development (pp. 339-383). S.l.
Błaszczyński, K. (2024). Impact of multi-dimensional religiosity on party support in Poland. Social Compass, 71(1), 136-154. https://doi.org/10.1177/00377686241239613
Bogdan, O. (2009). How religious is Ukrainian society? A comparative analysis of religiosity indicators based on the data of the International Social Survey Program (ISSP, 2008). [In Ukrainian]. NaUKMA Research Papers. Sociology, 96, 67-73.
Brik, T. (2018). When Church Competition Matters? Intra-doctrinal Competition in Ukraine, 1992-2012. Sociology of Religion. https://doi.org/10.1093/socrel/sry005
Chen, F.F. (2007). Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464-504. https://doi.org/10.1080/10705510701301834
Gu, D., Bai, C., Feng, Q., & Dupre, M.E. (2022). Religious Involvement, Health, and Longevity. In D. Gu & M. E. Dupre (Eds.), Encyclopedia of Gerontology and Population Aging (pp. 1-15). Springer International Publishing. https://doi.org/10.1007/978-3-319-69892-2_149-2
Himmelfarb, H.S. (1975). Measuring Religious Involvement. Social Forces, 53(4), 606. https://doi.org/10.2307/2576476
Hout, M. & Fischer, C.S. (2002). Why More Americans Have No Religious Preference: Politics and Generations. American Sociological Review, 67(2), 165. https://doi.org/10.1177/000312240206700201
Joshanloo, M. (2016). Religiosity moderates the relationship between negative affect and life satisfaction: A study in 29 European countries. Journal of Research in Personality, 61, 11-14. https://doi.org/10.1016/j.jrp.2016.01.001
Leitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., De Roover, K., Jak, S., Meitinger, K., Menold, N., Muthén, B., Rudnev, M., Schmidt, P., & Van De Schoot, R. (2023). Measurement invariance in the social sciences: Historical development, methodological challenges, state of the art, and future perspectives. Social Science Research, 110, 102805. https://doi.org/10.1016/j.ssresearch.2022.102805
Liefbroer, A.C. & Rijken, A.J. (2019). The Association Between Christianity and Marriage Attitudes in Europe. Does Religious Context Matter? European Sociological Review, 35(3), 363-379. https://doi.org/10.1093/esr/jcz014
Margolis, M.F. (2022). Reversing the Causal Arrow: Politics' Influence on Religious Choices. Political Psychology, 43(S1), 261-290. https://doi.org/10.1111/pops.12829
Meitinger, K., Davidov, E., Schmidt, P., & Braun, M. (2020). Measurement Invariance: Testing for It and Explaining Why It is Absent. Survey Research Methods, 345-349 Pages.
Meuleman, B. & Billiet, J. (2011). Religious involvement: Its relation to values and social attitudes. In Cross-cultural analysis: Methods and applications (pp. 173-206). Routledge/Taylor & Francis Group.
Meuleman, B. & Billiet, J. (2018). Religious Involvement. In Cross-Cultural Analysis (pp. 181-214). Routledge. https://doi.org/10.4324/9781315537078-7
Montgomery, K.A. & Winter, R. (2015). Explaining the Religion Gap in Support for Radical Right Parties in Europe. Politics and Religion, 8(2), 379-403. https://doi.org/10.1017/S1755048315000292
Moore, D. (2024). A Variety of Functions for a Variety of Applications. R package [R]. Retrieved from: https://github.com/davidblakneymoore/DBM.functions
Pirralha, A. & Weber, W. (2020). Correction for measurement error in invariance testing: An illustration using SQP. PLOS ONE, 15(10), e0239421. https://doi.org/10.1371/journal.pone.0239421
Parashchevin, M. (2022). The transformation of Ukraine's denominational space. [In Ukrainian]. In Ye. Golovakha & S. Makeiev (Eds.), Ukrainian society in wartime (pp. 120-130). Institute of Sociology of the National Academy of Sciences of Ukraine.
Putnick, D.L. & Bornstein, M.H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71-90. https://doi.org/10.1016/j.dr.2016.06.004
Razumkov Centre. (2018). Peculiarities of religious and church-religious self-identification of Ukrainian citizens: Trends 2010-2018. [In Ukrainian]. https://razumkov.org.ua/uploads/article/2018_Religiya.pdf
Razumkov Centre. (2023). Ukrainian society, the state, and the church during the war. Church-religious situation in Ukraine-2023. [In Ukrainian]. https://razumkov.org.ua/images/2023/12/19/2023-Religiya-F.pdf
Remizova, A., Davidov, E., & Rudnev, M. (2022). Religious Involvement Across Europe: Examining its Measurement Comparability. Survey Research Methods, 51-62 Pages.
Rosseel, Y. (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2). https://doi.org/10.18637/jss.v048.i02
Salnikova, S. & Savelyev, Y. (2024). The role of political institutions in the religious sphere before and during the Russo-Ukrainian war: national security vs. freedom of religion. Innovation: The European Journal of Social Science Research, 1-17. https://doi.org/10.1080/13511610.2024.2395265
Saroglou, V. (2011). Believing, Bonding, Behaving, and Belonging: The Big Four Religious Dimensions and Cultural Variation. Journal of Cross-Cultural Psychology, 42(8), 1320-1340. https://doi.org/10.1177/0022022111412267
Verkuyten, M. & Yildiz, A.A. (2007). National (Dis)Identification and Ethnic and Religious Identity: A Study Among Turkish-Dutch Muslims. Personality and Social Psychology Bulletin, 33(10), 1448-1462. https://doi.org/10.1177/0146167207304276
Voas, D. (2007). Does Religion Belong in Population Studies? Environment and Planning A: Economy and Space, 39(5), 1166-1180. https://doi.org/10.1068/a38154
Received 27.06.2024
Religious involvement over time: Assessing measurement invariance of the Religious Involvement scale in Ukraine
stmm. 2024 (4): 96-110
DOI https://doi.org/10.15407/sociology2024.04.096
Full text:
DANYIL KARAKAI, student of PhD program, Faculty of Sociology, Taras Shevchenko National University of Kyiv, Manager of Sociological Research at Kyiv School of Economics (4d, Glushkova Avenue, Kyiv, 03022)
dkarakai08@gmail.com
https://orcid.org/0000-0001-9121-5282
RUSLANA MOSKOTINA, PhD in Sociology, Assistant Professor, Department of Methodology and Methods of Sociological Research, Faculty of Sociology, Taras Shevchenko National University of Kyiv (4d, Glushkova Avenue, Kyiv, 03022)
rmoskotina@ukr.net
https://orcid.org/0000-0002-2195-3121
This study examines the measurement invariance of the Religious Involvement Scale (RI scale) in Ukraine. Using data from the European Social Survey (ESS) and a nationwide survey conducted just before the full-scale Russian invasion in 2022, we provide a detailed analysis of the RI scale in the Ukrainian context.
Previous research using multigroup confirmatory factor analysis (MGCFA) across countries lacked a focused analysis on Ukraine, especially after the Revolution of Dignity.
We used MGCFA to test the RI scale across different ESS waves and the 2022 Ukrainian survey. The metric invariance of the scale across all time points was not confirmed. We also tested results excluding data from occupied territories and found similar patterns. Partial metric invariance was observed for the period from 2004 to 2013. Our findings indicate that full metric invariance was only achieved for 2006-2013, with scalar invariance not achieved. In addition, the surveys conducted in 2004 and after 2014 had somewhat different patterns of correlations between scale components compared to other waves of the ESS.
We suggest that political dynamics have influenced the social aspects of religiosity in Ukraine; therefore, it is important to consider the political context when assessing religious involvement. Our preliminary findings highlight the importance of socio-political factors in measuring and interpreting religiosity.
Keywords: measurement invariance; religious involvement scale; MGCFA; religious transformation; longitudinal data
References
Billiet, J. (2002). Proposal for questions on religious identity. In European Social Survey Core Questionnaire Development (pp. 339-383). S.l.
Błaszczyński, K. (2024). Impact of multi-dimensional religiosity on party support in Poland. Social Compass, 71(1), 136-154. https://doi.org/10.1177/00377686241239613
Bogdan, O. (2009). How religious is Ukrainian society? A comparative analysis of religiosity indicators based on the data of the International Social Survey Program (ISSP, 2008). [In Ukrainian]. NaUKMA Research Papers. Sociology, 96, 67-73.
Brik, T. (2018). When Church Competition Matters? Intra-doctrinal Competition in Ukraine, 1992-2012. Sociology of Religion. https://doi.org/10.1093/socrel/sry005
Chen, F.F. (2007). Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464-504. https://doi.org/10.1080/10705510701301834
Gu, D., Bai, C., Feng, Q., & Dupre, M.E. (2022). Religious Involvement, Health, and Longevity. In D. Gu & M. E. Dupre (Eds.), Encyclopedia of Gerontology and Population Aging (pp. 1-15). Springer International Publishing. https://doi.org/10.1007/978-3-319-69892-2_149-2
Himmelfarb, H.S. (1975). Measuring Religious Involvement. Social Forces, 53(4), 606. https://doi.org/10.2307/2576476
Hout, M. & Fischer, C.S. (2002). Why More Americans Have No Religious Preference: Politics and Generations. American Sociological Review, 67(2), 165. https://doi.org/10.1177/000312240206700201
Joshanloo, M. (2016). Religiosity moderates the relationship between negative affect and life satisfaction: A study in 29 European countries. Journal of Research in Personality, 61, 11-14. https://doi.org/10.1016/j.jrp.2016.01.001
Leitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., De Roover, K., Jak, S., Meitinger, K., Menold, N., Muthén, B., Rudnev, M., Schmidt, P., & Van De Schoot, R. (2023). Measurement invariance in the social sciences: Historical development, methodological challenges, state of the art, and future perspectives. Social Science Research, 110, 102805. https://doi.org/10.1016/j.ssresearch.2022.102805
Liefbroer, A.C. & Rijken, A.J. (2019). The Association Between Christianity and Marriage Attitudes in Europe. Does Religious Context Matter? European Sociological Review, 35(3), 363-379. https://doi.org/10.1093/esr/jcz014
Margolis, M.F. (2022). Reversing the Causal Arrow: Politics' Influence on Religious Choices. Political Psychology, 43(S1), 261-290. https://doi.org/10.1111/pops.12829
Meitinger, K., Davidov, E., Schmidt, P., & Braun, M. (2020). Measurement Invariance: Testing for It and Explaining Why It is Absent. Survey Research Methods, 345-349 Pages.
Meuleman, B. & Billiet, J. (2011). Religious involvement: Its relation to values and social attitudes. In Cross-cultural analysis: Methods and applications (pp. 173-206). Routledge/Taylor & Francis Group.
Meuleman, B. & Billiet, J. (2018). Religious Involvement. In Cross-Cultural Analysis (pp. 181-214). Routledge. https://doi.org/10.4324/9781315537078-7
Montgomery, K.A. & Winter, R. (2015). Explaining the Religion Gap in Support for Radical Right Parties in Europe. Politics and Religion, 8(2), 379-403. https://doi.org/10.1017/S1755048315000292
Moore, D. (2024). A Variety of Functions for a Variety of Applications. R package [R]. Retrieved from: https://github.com/davidblakneymoore/DBM.functions
Pirralha, A. & Weber, W. (2020). Correction for measurement error in invariance testing: An illustration using SQP. PLOS ONE, 15(10), e0239421. https://doi.org/10.1371/journal.pone.0239421
Parashchevin, M. (2022). The transformation of Ukraine's denominational space. [In Ukrainian]. In Ye. Golovakha & S. Makeiev (Eds.), Ukrainian society in wartime (pp. 120-130). Institute of Sociology of the National Academy of Sciences of Ukraine.
Putnick, D.L. & Bornstein, M.H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71-90. https://doi.org/10.1016/j.dr.2016.06.004
Razumkov Centre. (2018). Peculiarities of religious and church-religious self-identification of Ukrainian citizens: Trends 2010-2018. [In Ukrainian]. https://razumkov.org.ua/uploads/article/2018_Religiya.pdf
Razumkov Centre. (2023). Ukrainian society, the state, and the church during the war. Church-religious situation in Ukraine-2023. [In Ukrainian]. https://razumkov.org.ua/images/2023/12/19/2023-Religiya-F.pdf
Remizova, A., Davidov, E., & Rudnev, M. (2022). Religious Involvement Across Europe: Examining its Measurement Comparability. Survey Research Methods, 51-62 Pages.
Rosseel, Y. (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2). https://doi.org/10.18637/jss.v048.i02
Salnikova, S. & Savelyev, Y. (2024). The role of political institutions in the religious sphere before and during the Russo-Ukrainian war: national security vs. freedom of religion. Innovation: The European Journal of Social Science Research, 1-17. https://doi.org/10.1080/13511610.2024.2395265
Saroglou, V. (2011). Believing, Bonding, Behaving, and Belonging: The Big Four Religious Dimensions and Cultural Variation. Journal of Cross-Cultural Psychology, 42(8), 1320-1340. https://doi.org/10.1177/0022022111412267
Verkuyten, M. & Yildiz, A.A. (2007). National (Dis)Identification and Ethnic and Religious Identity: A Study Among Turkish-Dutch Muslims. Personality and Social Psychology Bulletin, 33(10), 1448-1462. https://doi.org/10.1177/0146167207304276
Voas, D. (2007). Does Religion Belong in Population Studies? Environment and Planning A: Economy and Space, 39(5), 1166-1180. https://doi.org/10.1068/a38154
Received 27.06.2024