Public opinion exists, but is it always detectable?

The article examines the problem of the reliability of the results of public opinion polls, taking into account the fact that the respondents’ answers, due to various reasons, do not always reflect their true opinion.

The article presents the results of an expert survey, during which experts assessed the extent of deviations in the results of public opinion polls due to the tendency of respondents to give “conformist” answers, caused by the fear of expressing views that may be punished by the authorities, in various situations: when conducting surveys in the regions of Ukraine, which are controlled by the Ukrainian authorities; if surveys are conducted by Ukrainian research institutions in the territories of Ukraine temporarily occupied by Russia; if survey are conducted by Russian research institutions in the territories of Ukraine temporarily occupied by Russia; when surveys are conducted in the territory of Russia. Both the results of the analysis of poll studies and the results of an expert survey indicate that there is always a problem in public opinion polls of the insincerity of respondents’ answers and a systematic error caused by the bias of the sample in the direction of respondents “loyal to the government” or respondents who consider themselves to be in the “ideological majority”. This problem is significantly exacerbated in the conditions of strengthening authoritarian tendencies in society or an atmosphere of intolerance, including that caused by war.

Under certain circumstances, these factors can significantly reduce the reliability of the results of public opinion polls. The magnitude of the shift in survey results caused by the influence of these factors will vary significantly depending on changes in the socio-psychological atmosphere of society, the subject of research and questions, and the level of their sensitivity.

Keywords: reliability of survey results; public opinion; sensitive questions; sincerity of respondents’ answers; expert survey

References

Arenina, K., Rubin, M., Badanin, R. (2022). Non-Natural Numbers (Part Two). A Story About How Sociologists Convinced Russians to Love Putin and the War in Ukraine. [In Russian]. Proiekt, July 7, 2022. Retrieved from: https://www.proekt.media/narrative/rating-putina/. [= Аренина, Рубин, Баданин 2022]

Bourdieu, P. (1993). Sociology of Politics. [In Russian]. Moscow: Socio-Logos. [= Бурдье 1993]

In Penza, Schoolchildren Wrote a Denunciation on a Teacher (2022). [In Russian]. Meduza, April 1, 2022. Retreived from: https://meduza.io/news/2022/04/01/v-penze-shkolniki-napisali-donos-na-uchitelnitsu-rasskazavshuyu-o-voyne-v-ukraine-na-pedagoga-zaveli-ugolovnoe-delo-po-statie-o-feykah/ [= В Пензе, 2022]

Davydov, A.A., Davydova, E.V. (1992). Measuring the Sincerity of the Respondent. [In Russian]. Moscow: IS RAS. [= Давыдов, Давыдова 1992] A Resident of the Moscow Region Turned his Wife in to the Police Because of Criticism of the Special Operation (2022). [In Russian]. Moskovskii Komsomolets, July 13, 2022. Retrieved from: https://www.mk.ru/incident/2022/07/13/zhitel-podmoskovya-sdal-v-policiyu-zhenu-izza-kritiki-specoperacii.html. [= Житель Подмосковья 2022]

Zvonovskii, V. (2022). Cooperation of Respondents in Polls on the Topic of Military Operation. [In Russian]. Post-release #6, April 23, 2022. Retrieved from: https://www.extremescan.eu/ru/post/5-кооперация-респондентов-в-опросах-на-тему-военных-операций. [= Звоновский 2022]

Levada Centre (2022). Participation in Polls and Trust in Data. [In Russian]. Retrieved from: https://www.levada.ru/2022/05/24/uchastie-v-oprosah-i-doverie-dannym/. [= Левада-центр 2022]

Miagkov, A.Y. (2012). Sincerity of Respondents in Sensitive Surveys: Methods of Diagnosis and Stimulation. [In Russian]. Moscow: Variant LLC. [= Мягков 2012]

Ossovskyi, V.L. (2005). Sociology of Public Opinion. [In Ukrainian]. Kyiv: Stilos. [= Оссовський 2005]

Chernysh, O. (2022). Why do Ukrainians Believe in Victory, and Russians Love War? Sociologist Paniotto Explains. [In Ukrainian]. BBC News Ukraine, April 21, 2022. Retrieved from: https://www.bbc.com/ukrainian/features-61151164. [= Черниш 2022]