Computer-aided Analysis of Unreliability and Truth in Fiction - Interconnecting and Operationalizing Narratology (CAUTION)
General and Comparative Linguistics, Experimental Linguistics, Typology, Non-European Languages
Final Report Abstract
The project focused on a multi-tracked, computer-aided investigation of the narrative phenomenon of unreliable narration. Unreliable narration in the variant investigated here refers to narrators in fictional literary texts that make incorrect claims about the fictional world of the narration. In literary research, this phenomenon is classified as strongly interpretation-dependent, which is why it is assumed that the assessment of the reliability of a narrative instance can (legitimately) vary depending on the interpreter. The justifications provided for this assumption vary in the research literature, and no empirical verification has yet taken place. At the same time, research has identified various textual features, so-called indicators, which can point to a narrator being unreliable. A discussion of the question which indicators are connected to which variant of unreliable narration as well as (theoretical or empirical) investigations concerning the indicative power of said indicators have not yet been addressed. In CAUTION, the aforementioned research desiderata were addressed within the framework of a multi-tracked experimental computer-assisted approach. First, a corpus of nine short fictional narratives (reliable and unreliable) from the period between the 19th and 21st centuries was created. Potentially relevant textual indicators (or indicative characteristics of narrators) for unreliable narration were then selected (emotional agitation, intention to appear certain, uncertainty, addressee-orientation, distraction and intention to distract). On the one hand, these indicators were to be determined as automatically as possible in the corpus using available NLP models (shallow track). On the other hand, the indicators were identified using manual annotation, as well as occurrences of unreliably narrated passages (middle track). Finally, the decisions underlying the annotation decisions were made visible and put up for discussion (deep track). The data resulting from the three approaches can be evaluated and compared in order to generate different (initially tentative due to the small size of the corpus) findings: (1) Identification of indicators: Do the automatically identified indicators match the manually identified indicators? Can the manual annotations be used to optimize the NLP models? (2) Indicative power: What is the actual indicative power of the indicators? Which indicators actually correlate sufficiently often with unreliable narration, and in which way? (3) Interpretation dependence: How much do interpreters' assessments of unreliable narration actually differ? What effect do the visualization and discussion of the underlying decisions have? The results will be reflected upon in terms of literary theory and made available for subsequent use.
Publications
-
Platinstandard-Annotation in der digitalen Literaturwissenschaft: Definition, Funktionen und diskursive Argumentvisualisierung als Best-Practice-Beispiel. In: Nils Reite/Thomas Haider/Daniel Kababgi/Hendrik Buschmeier (ed.): DHd 2025. Under Construction. Konferenzabstracts, 279–283
Jacke, Janina
-
Detecting unreliable narration. Chances and challenges of a computational approach to unreliability and truth in fiction. ENN Conference, 2021, Riga (digital event)
Jacke, Janina & Kuhn, Jonas
-
Interpretation schematisieren? Eine computergestützte Analyse unzuverlässigen Erzählens. Networking-Event des Göttinger Zentrums „Textstrukturen“, 2022, Göttingen
Jacke, Janina
-
Mehrdeutigkeit und unzuverlässiges Erzählen in E. T. A. Hoffmanns Der Sandmann. Ein digital gestützter Ansatz. Germanistentag, 2022, Paderborn
Jacke, Janina
-
Projektpräsentation „CAUTION“. Forschungskolloquium Analytische Literaturwissenschaft, 2022, Göttingen
Jacke, Janina
-
(Dis)Agreement in Holistic Content-Specifying Interpretation and Argumentation. Workshop Mind the Gap. (Dis)agreement Evaluation in Computational Literary Studies, 2023. Be'er Sheva
Jacke, Janina
-
CAUTION – Computer-aided Analysis of Unreliability and Truth in Fiction. Treffen des DFG Schwerpunktprogramms Computational Literary Studies, 2023, Göttingen
Jacke, Janina
-
Computer-aided Approach to Unreliability and Truth in Fiction – Interconnecting and Operationalizing Narratology (CAUTION). BGU Literary Lab, 2023, Be'er Sheva
Jacke, Janina
-
Die (computationelle?) Operationalisierung unzuverlässigen Erzählens. Ein Beitrag zur Theorie und Methodik literaturwissenschaftlichen Interpretierens. In: Textpraxis 21 (2)
Jacke, Janina
-
Interpretation, Argumentation, Computation. Expanding New Ways in Computational Literary Studies. Public Event Redefining Reading. Computational Literary Studies in Israel: Scholarship, Communities, 2023, Be'er Sheva
Jacke, Janina
-
Operationalization and Interpretation Dependence in Computational Literary Studies. Workshop Measuring Meaning, Computing Concepts. Practices of Operationalization and their Implication for Text Studies, 2023, Köln
Jacke, Janina
-
Operationalizing Complex Concepts in Digital Humanities. Some Ideas on Approximation and Mixed Methods. Workshop Interdisciplinary and Experimental Approaches to Suspense and Related Phenomena, 2023, Graz
Jacke, Janina
-
Thematisierte Mehrdeutigkeit in E.T.A. Hoffmanns Der Sandmann. Zur Rekonstruktion und Relevanz fiktiver Welten. Mehrdeutigkeit als literarisches Thema, 23-46. transcript Verlag.
Jacke, Janina
-
Vom sprachlichen Indikator zum komplexen Phänomen? Operationalisierungsprobleme in der computationellen Literaturwissenschaft am Beispiel des unzuverlässigen Erzählens. In: Anna Busch/Peer Trilcke (ed.): DHd 2023. Open Humanities, Open Culture. Konferenzabstracts, 317–321
Jacke, Janina
-
Agreement und Kookkurrenz bei unzuverlässigem Erzählen. Ziele, Herausforderungen und erste Ergebnisse aus dem Projekt CAUTION. In: Joëlle Weis/Thomas Haider/Estelle Bunout (ed.): DHd 2024. Quo Vadis DH. Konferenzabstracts, 107–111
Blessing, André; Jacke, Janina & Kuhn, Jonas
-
CAUTION Annotations
Blessing, André; Jacke, Janina & Kuhn, Jonas
-
Operationalization and Interpretation Dependence. In: Journal of Computational Literary Studies 4 (1)
Jacke, Janina
