Projekt
A Systematic Analysis of Linguistic Features in AI-Generated Text Detection Across Domains and Models
Interpretable linguistic features offer a promising approach for explaining why a given text appears machine-generated, particularly for non-expert users. However, existing findings on which features reliably indicate LLM-generated text remain fragmented across feature sets, models, and text domains. To address this g…
Interpretable linguistic features offer a promising approach for explaining why a given text appears machine-generated, particularly for non-expert users. However, existing findings on which features reliably indicate LLM-generated text remain fragmented across feature sets, models, and text domains. To address this gap, we conduct a large-scale empirical study assessing the robustness of linguistic signals for characterizing AI-generated text. Our analysis covers 284 interpretable linguistic features across outputs from 27 LLMs and ten text domains under cross-model and cross-domain generalization settings. We show that classifiers based solely on linguistic features can reliably distinguish AI-generated from human-written text. However, many previously proposed indicators prove strongly context-dependent, with the exception of measures of lexical richness, which remain robust signals across model families and text domains. These results demonstrate which linguistic signals generalize across contexts and provide a foundation for more reliable, interpretable analyses of AI-generated language.
Technologien
- Generative AI Generative AI – Überblick über Forschungsprojekte, Patente und Akteure im TechnologieAtlas.
Hochschulen
- University of Stuttgart University of Stuttgart – Hochschule bzw. Forschungseinrichtung mit Aktivitäten in Forschung und Innovation.
- GESIS - Leibniz Institute for the Social Sciences GESIS - Leibniz Institute for the Social Sciences – Hochschule bzw. Forschungseinrichtung mit Aktivitäten in…
- Heinrich Heine University Düsseldorf Heinrich Heine University Düsseldorf – Hochschule bzw. Forschungseinrichtung mit Aktivitäten in Forschung und…