Detecting Midjourney-Generated Images

An Eye-Tracking Study

Journal Article (2025)
Author(s)

Joost C.F. de Winter (TU Delft - Mechanical Engineering)

Jenna Pfeifer (TU Delft - Mechanical Engineering)

Dimitra Dodou (TU Delft - Mechanical Engineering)

Yke Bauke Eisma (TU Delft - Mechanical Engineering)

Research Group
Human-Robot Interaction
DOI related publication
https://doi.org/10.1177/10711813251363209 Final published version
More Info
expand_more
Publication Year
2025
Language
English
Research Group
Human-Robot Interaction
Journal title
Proceedings of the Human Factors and Ergonomics Society
Issue number
1
Volume number
69
Pages (from-to)
2000-2005
Event
69th Human Factors and Ergonomics Society Annual Meeting, HFES 2025 (2025-10-13 - 2025-10-17), Chicago, United States
Downloads counter
43
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

This study investigated human performance in identifying AI-generated images. In a speeded forced-choice task, 255 participants viewed paired images (one real, one AI-generated by Midjourney) of standard or futuristic cars and buildings and had to identify the AI-generated one, while eye movements were recorded using an eye-tracker. Results revealed a powerful “futurism-as-artificiality” heuristic. Specifically, participants performed poorly (55% correct) when an AI-generated standard image was paired with a real futuristic image. Conversely, accuracy was high (91% correct) when the AI-generated futuristic image was paired with a real standard image. Participants’ gaze landed first on the AI-generated image more often when it depicted a futuristic design than when it depicted a standard one. The demonstrated heuristic presents a double-edged sword for information veracity: it may lead to the uncritical acceptance of AI-generated misinformation that appears conventional, while simultaneously causing real forward-thinking designs to be dismissed as fake.