The use of ChatGPT for personality research

Administering questionnaires using generated personas

Journal Article (2024)
Authors

Joost C F de Winter (TU Delft - Human-Robot Interaction)

Tom Driessen (TU Delft - Human-Robot Interaction)

D Dodou (TU Delft - Medical Instruments & Bio-Inspired Technology)

Research Group
Human-Robot Interaction
To reference this document use:
https://doi.org/10.1016/j.paid.2024.112729
More Info
expand_more
Publication Year
2024
Language
English
Research Group
Human-Robot Interaction
Volume number
228
DOI:
https://doi.org/10.1016/j.paid.2024.112729
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Personality research has traditionally relied on questionnaires, which bring with them inherent limitations, such as response style bias. With the emergence of large language models such as ChatGPT, the question arises as to what extent these models can be used in personality research. In this study, ChatGPT (GPT-4) generated 2000 text-based personas. Next, for each persona, ChatGPT completed a short form of the Big Five Inventory (BFI-10), the Brief Sensation Seeking Scale (BSSS), and a Short Dark Triad (SD3). The mean scores on the BFI-10 items were found to correlate strongly with means from previously published research, and principal component analysis revealed a clear five-component structure. Certain relationships between traits, such as a negative correlation between the age of the persona and the BSSS score, were clearly interpretable, while some other correlations diverged from the literature. An additional analysis using four new sets of 2000 personas each, including a set of ‘realistic’ personas and a set of cinematic personas, showed that the correlation matrix among personality constructs was affected by the persona set. It is concluded that evaluating questionnaires and research hypotheses prior to engaging with real individuals holds promise.