We cordially invite you to the guest lecture of Prof. Dr. Anna-Maria De Cesare (Technische Universität Dresden) „Beyond the surface: Evaluating the quality of ‘texts’ generated in Italian by Large Language Models“ eingeladen.
*Time: Thursday, May 30, 2024, 10:15-11:45 a.m.*.
*Location: University of Potsdam, Campus 'Am Neuen Palais', Room 1.19.4.15*.
The flyer of the event can be found here.
Beyond the surface: Evaluating the quality of ‘texts’ generated in Italian by Large Language Models
Anna-Maria De Cesare (Technische Universität Dresden)
Abstract:
The advent of large language models (LLMs) has revolutionized our ability to generate linguistic output in a wide range of languages. According to many evaluations, LLM-generated outputs are coherent, high-quality texts that are in many ways comparable to and indistinguishable from human-written texts. The aim of this talk is to reflect on how we can verify these claims and assess whether LLM-generated output is indeed human-like. Based on the results of several case studies analyzing data drawn from a self-assembled corpus of GPT-4-generated and human-written biographies, I will show that LLM-generated texts appear well-written only at first glance. On closer inspection of textual parameters (related to the referential dimension of textual organization), these texts tend to be repetitive and monotonous.