Overview of the Oppositional Thinking Analysis PAN Task at CLEF 2024

Korenčić, Damir; Chulvi, Berta; Bonet-Casals, Xavier; Taulé, Mariona; Rosso, Paolo; Rangel, Francisco (2024) Overview of the Oppositional Thinking Analysis PAN Task at CLEF 2024. In: Faggioli, Guglielmo; Ferro, Nicola; Galuščáková, Petra; García Seco de Herrera, Alba, (eds.) CEUR Workshop Proceedings. Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024), Aachen University (RWTH), pp. 2462-2485 .

PDF - Published Version - article Available under License Creative Commons Attribution. Download (2MB)

Abstract

This paper describes the Oppositional Thinking Analysis task at CLEF 2024. The task focuses on analyzing conspiracy theories and critical thinking narratives, and is comprised of two subtasks. Subtask 1 is a binary classification task aimed at distinguishing between critical and conspiracy texts. Subtask 2 is a token classification task aimed at detecting text spans corresponding to the key elements of oppositional (critical and conspiracy) narratives. The subtasks are based on a dataset of English and Spanish COVID19-related texts obtained from oppositional Telegram channels, and labeled using a topic-agnostic annotation scheme. A total of 82 teams participated in the challenge, and 17 teams published working notes papers with system descriptions. The participants employed a range of NLP methods and pushed the state-of-art performance on both subtasks beyond the performance of the strong baseline systems that were provided.

Item Type:	Conference or workshop item published in conference proceedings (UNSPECIFIED)
Uncontrolled Keywords:	Conspiracy Theories; Oppositional Thinking; Computational Social Science; Natural Language Processing; Text Classification; Sequence Labeling
Subjects:	TECHNICAL SCIENCES > Computing > Artificial Intelligence
Divisions:	Division of Electronics
Depositing User:	Damir Korenčić
Date Deposited:	22 Jan 2026 08:27
URI:	http://fulir.irb.hr/id/eprint/10816

Actions (login required)

View Item