Probing and Mitigating the Limits of Variability Prompt Variability in Large Language Models (D01 {ehem. B06})

• Subject Area: General and Comparative Linguistics, Experimental Linguistics, Typology, Non-European Languages
• Term: since 2021
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 317633480

This project investigates prompt (in)stability in Large Language Models. While this is typically treated as a technical problem, it is treated here as a means for exploring the limits of linguistic variability captured by these systems. By defining a range of controlled prompt manipulations and evaluating the induced functions on standard datasets, the project aims to elucidate the way these models go from analysis and interpretation of prompts to instruction following – and the extent to which it concurs with linguistic predictions.

• DFG Programme: Collaborative Research Centres
• Subproject of: SFB 1287: Limits of Variability in Language: Cognitive, Computational, and Grammatical Aspects
• Applicant Institution: Universität Potsdam
• Project Head: Professor Dr. David Schlangen