Integrating quantitative and qualitative methods in ideology studies: a case study of Victorian ideology analysis
DOI:
https://doi.org/10.32589/2311-0821.1.2024.309634Keywords:
ideological analysis, human-run and machine-assisted methodologies, blended methodsAbstract
The paper provides an overview of both traditional and modern methodological approaches for the study of ideology, while showcasing the author’s earlier research on Victorian ideology. It argues that the long-standing traditions of critical theory analysis, discourse analysis, and hermeneutics in ideology critique have created a rich legacy for conceptual categorization of knowledge about the organization and evolution of ideologies. This legacy has benefited contemporary, machine-assisted studies of ideologically laden textual data, offering valuable insights for operationalizing ideology.
The study focuses on the modern shift towards analyzing the emotional components of ideology, using the latest text and opinion mining techniques to explore the cognitiveemotive nature of relevant ideological categories. While advocating for an emotion-centered view of ideology organization, the paper proposes an alternative approach to ideology analysis by endorsing a blended methodology. This methodology integrates human-run qualitative discourse analysis with machine-assisted quantitative content analysis in the study of Victorian ideology.
The article presents an algorithm for ideological analysis, starting with data acquisition, choosing the methodological path, and demonstrating the efficacy of the co-occurrence network tool for computerized topic extraction at the conceptual macro-level of ideology analysis. Keywords are recontextualized at the microlevel of analysis to provide an indepth view of the extracted quantitative metrics, seeking an interpretative approach. This approach encourages further triangulation of research tools and data sources to ensure the iterative nature of the research and solidify the hypotheses.
References
Aksenov, D., Bourgonje, P., Zaczynska, K., Ostendorff, M., Moreno-Schneider, J., &
Rehm G. (2021). Fine-grained Classification of Political Bias in German News: A Data
Set and Initial Experiments. In Proceedings of the Fifth Workshop on Online Abuse and
Harms, 121–131.
Bayram, U., Pestian, J., Santel, D., & Minai, A. A. (2019). What’s in a Word? Detecting
Partisan Affiliation from Word Use in Congressional Speeches. In Proceedings of
International Joint Conference on Neural Networks (IJCNN).
https://doi.org/10.1109/IJCNN.2019.8851739
Barna, C. & Dugan, C. (2016). The Ukrainian Hybrid Warfare and Neuroscience:
Dismantling Some Facets of the Psychosphere. In N. Iancu, A. Fortuna, & C. Barna
(Eds.), Countering Hybrid Threats: Lessons Learned from Ukraine (pp. 115–140).
Amsterdam: IOS Press.
https://doi.org/10.3233/978-1-61499-651-4-115
Bartscherer, Sh. F. (2022). Emotion in British politics – a mixed methods analysis of
Conservative and Labour Party speeches from 1900–2019. In European Politics and
Society, 24(5), 680–702.
https://doi.org/10.1080/23745118.2022.2081016
Benoit, K., Conway, D., Lauderdale, B. E., Laver, M., & Mikhaylov, S. (2016). Crowd-
Sourced Text Analysis: Reproducible and Agile Production of Political Data. In
American Political Science Review 110(2), 278–295.
Biber, D., Finegan, E., & Atkinson, D. (1994). ARCHER and its challenges. Compiling and
exploring a representative corpus of historical English registers. In U. Fries, G. Tottie,
and P. Schneider (Eds.), Creating and using English language corpora, (pp. 1–14).
Amsterdam: Rodopi.
Chandler, D. & Munday, R. (Eds.). (2011). A Dictionary of Media and Communication.
Oxford: Oxford University Press.
Custodi, J. (2019). Podemos and the Imagined Nation. The Construction of Spain in
the Political Discourse of Pablo Iglesias. PSA Political Studies Association – Annual
International Conference, Nottingham, 15–17 April 2019.
De Smet, H., Flach, S., Tyrkkö, J. & Diller, H.-J. (2015). The corpus of Late Modern
English (CLMET), version 3.1: Improved tokenization and linguistic annotation.
Katholieke Universiteit Leuven, Freie Universitӓt Berlin, Tampere University, Ruhr-
Universitӓt Bochum.
De Smet, H. (2005). A Corpus of Late Modern English Texts. In International Computer
Archive of Modern and Medieval English (ICAME) Journal, 29, 69–82.
Eagleton, T. (2003). Literary Theory: An Introduction. Minneapolis: The University of
Minnesota Press.
Franks, B., Jun, N., & Williams, L. (Eds.). (2018). Anarchism: A Conceptual Approach.
New York: Routledge.
Freeden, M. (1996). Ideologies and Political Theory: A Conceptual Approach. Oxford:
Oxford University Press.
Glavaš, G., Nanni, F., & Ponzetto, S. P. (2019). Computational Analysis of Political Texts:
Bridging Research Efforts Across Communities. In Proceedings of the 57th Annual
Meeting of the Association for Computational Linguistics: Tutorial Abstracts, 18–23.
Haidt, J. (2003). The Moral Emotions. In R. J. Davidson, K. R. Scherer, & H. H.
Goldsmith (Eds.), Handbook of Affective Sciences (pp. 852–870). Oxford: Oxford
University Press.
Heywood, A. (2022). Political ideologies: An introduction. London, New York: Bloomsbury
Academic.
Hirst, G., Riabinin, Ya., Graham, J., & Boizot-Roche, M. (2010). Text to Ideology or Text
to Party Status? In Proceedings of T2PP Workshop, Vrije Universiteit Amsterdam.
Homer-Dixon, Th., Maynard, J.L., Mildenberger, M., Milkoreita, M., Mocka, S. J., Quilley,
S., Schröder, T., & Thagard P. (2013). A Complex systems approach to the study of
ideology: Cognitive-affective structures and the dynamics of belief systems. In Journal
of Social and Political Psychology, 1(1).
https://doi.org/10.5964/jspp.v1i1.36
Hunston, S. (2002). Corpora in Applied Linguistics. Cambridge: Cambridge University
Press.
Jimenez-Silva, M., Bernstein, K. A., Baca, E. C. (2016). An analysis of how restrictive
language policies are interpreted by Arizona’s Department of Education and three
individual school districts’ websites. Education Policy Analysis Archives, 24(105).
http://dx.doi.org/10.14507/epaa.24.2291
Jin, Zh. & Micalcea, R. (2023). Natural Language Processing for Policy Making. In E.
Bertoni, M. Fontana, L. Gabrielli, S. Signorelli, & M. Vespe (Eds), Handbook of
Computational Social Science for Policy (pp.141–162). New York: Springer.
https://doi.org/10.1007/978-3-031-16624-2
Krippendorff, K. (2004). Content Analysis: An Introduction to Its Methodology. Thousand
Oaks: Sage Publications.
Khurana, D., Koli, A., Khatte, K., & Singh, S. (2023). Natural Language Processing: State
of the Art,
Current Trends and Challenges. In Multimedia Tools and Applications, 82, 3713–3744.
https://doi.org/10.1007/s11042-022-13428-4
Korzycki, M., Gatkowska, I., & Lubaszewski, W. (2017). Can the Human Association
Norm Evaluate Machine-Made Association Lists? In Cognitive Approach to Natural
Language Processing, 13, 21-40.
https://doi.org/10.1016/B978-1-78548-253-3.50002-0
Lakoff, G. (2002). Moral Politics: How Liberals and Conservatives Think. Chicago and
London: The University of Chicago Press.
Lees, E. and Shepherd, E. (2018). Morphological Analysis of Legal Ideology: Locating
Interpretive Divergence. In Journal of Property, Planning and Environmental Law,
(1), 5–16.
https://doi.org/10.1108/JPPEL-12-2017-0041
Lipinski, A. (2017). Qualitative approaches in Populism Research. In Athenaeum. Polish
Political Science Studies, 56, 244–256.
Liu, Y., Zhang, J., & Yang, L. (2021). A Corpus Linguistics Approach to the Representation
of Western Religious Beliefs in Ten Series of Chinese University English Language
Teaching Textbooks. In Frontiers in Psychology, 12: 789660.
https://doi.org/10.3389/fpsyg.2021.789660
Mudde, C. (2007). Populist Radical Right Parties in Europe. Cambridge: Cambridge
University Press.
Pinich, I. (2020). Emotions in metamental organization of ideologies. In LOGOS, 103, 18–29.
https://doi.org/10.24101/logos.2020.23
Pinich, I. (2019a). Affective-Discursive Practices of Anger and Indignation in the Sustainability
of Victorian Ideology. In Lege Artis. Language Yesterday, Today, Tomorrow. The Journal
of University of SS Cyril and Methodius in Trnava, IV(2), 216–260.
Pinich, I. (2019b). Logical and psychological aspects of ideology enactment: a descriptive
approach. In Ad orbem per linguas. До світу через мови. Матеріали Міжнародної
науково-практичної конференції (сс. 465–468). Київський національний
лінгвістичний університет.
Pinich, I. (2019c). The discursive emotional aspect of ideological transitions in the
Victorian age. Messenger of Kyiv National Linguistic University, 22(1), 66–77.
https://doi.org/10.32589/2311-0821.1.2019.170160
Pinich, I. (2018a). Negative self-conscious moral emotions in constructing Victorian moral
identity (a corpus-based study). In Південний архів. Філологічні науки: Збірник
наукових праць, 76, 78–85.
Pinich, I. (2018b). Positive moral emotions in cultivating ideology of VICTORIAN
MORALITY (a corpus-based study). In Наукові записки Національного університету
“Острозька академія”, серія “Філологія”, 1 (69), Ч. 2, 96–101.
http:://doi.org/10.25264/2519-2558-2018-1(69)/2-96-101
Siemund, R. & Claridge, C. (1997). The Lampeter Corpus of Early Modern English Tracts.
In International Computer Archive of Modern and Medieval English (ICAME) Journal,
, 61–70.
Sim, Y., Acree, B., Gross, J., & Smith, N. (2013). Measuring Ideological Proportions in
Political Speeches. In Proceedings of the 2013 Conference on Empirical Methods in
Natural Language Processing, 91–101.
Slaby, J., & von Scheve, Ch. (2019). Affective Communities: Key Concepts. London and
New York: Routledge.
Smith, H. W. (1975). Strategies of Social Research: The Methodological Imagination.
Englewood Cliffs, NJ: Prentice-Hall.
Stanley, B. (2008). The thin ideology of populism. In Journal of Political Ideologies, 13(1),
–110.
http://dx.doi.org/10.1080/13569310701822289
Stubbs, M. (2004). Language Corpora. In A. Davies & C. Elder (Eds.), The Handbook of
Applied Linguistics (pp. 106–132). Oxford: Blackwell Publishing Ltd.
Thagard, P. (2006). Hot Thought: Mechanisms and Applications of Emotional Cognition.
Cambridge: The Massachusetts Institute of Technology Press.
Van Atteveldt, W., Welbers, K., &Van der Velden, M.A.C.G. (2019). Studying Political
Decision Making with Automatic Text Analysis. In D. P. Redlawsk (Ed.), Oxford
Encyclopedia of Political Decision Making.
https://doi.org/10.1093/acrefore/9780190228637.013.957
Zhang, Y. & Wildemuth, B. M. (2005). Qualitative Analysis of Content. In Human Brain
Mapping 30(7), 2197–2206.
Zirn, C., Glavaš, G., Nanni, F., Eichorst, J., & Stuckenschmidt H. (2016). Classifying
Topics and Detecting Topic Shifts in Political Manifestos. In Proceedings of the
International Conference on the Advances in Computational Analysis of Political Text.
https://manifestoproject.wzb.eu
Zmigrod, L. (2022). Mental Computations of Ideological Choice and Conviction: The Utility
of Integrating Psycho-Economics and Bayesian Models of Belief. In Psychological
Inquiry, 33(2), 107–116.
https://doi.org/10.1080/1047840X.2022.2065134
Zmigrod, L. (2021). A neurocognitive model of ideological thinking. In Politics and the
Life Sciences, 40(2), 224–238.
Downloads
Published
Issue
Section
License
1. Authors take full responsibility for the content of the articles as well as the fact of their publication.2. All the authors must follow the current requirements for publication of manuscripts. Plagiarism itself and its representation as the original work as well as submission to the editorial office previously published articles are unacceptable. In case of plagiarism discovery the authors of the submitted materials take all the responsibility.
3. Authors shall inform the editor of any possible conflict of interests which could be influenced by the publication of the manuscript results.
4. The editorial board has the right to refuse publication of an article in case of non-compliance with these requirements.
