ChatGPT Images 2.5 in the Wild: A Launch-Period Dataset and Detector Evaluation
cs.CV, cs.AI
Submitted: 2026-09-14
Updated: 2026-09-22
Comments: 22 pages, 8 figures, 12 tables
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: An image tool can change its underlying generator while retaining its public name, making version attribution from online posts ambiguous.
Terminology
Abstract
An image tool can change its underlying generator while retaining its public name, making version attribution from online posts ambiguous. We study this problem after the ChatGPT Images 2.5 launch. Our frozen collection contains 3,478 images from 2,440 posts across 8 sources. Recorded posting times fall within the first 51.1 hours after the announcement. It records three attribution tiers and retains standalone images after image-form filtering and targeted review. Caption claims and host records provide admission evidence, not independently verified generator identity. The observed content profile depends on the source mixture: NightCafe supplies 39.0% of images but 77.0% of CLIP-assigned fantasy scenes. We then evaluate six frozen detectors at thresholds calibrated to a 5% flag rate on reference photographs. Collection flag rates range from 3.7 to 56.4%, falling 42-81 percentage points below GenImage recall. Held-out artwork false-positive rates range from 1.5 to 96.5%, so a higher collection flag rate does not by itself establish better detection. An exploratory X-only comparison with our April collection finds a higher September flag rate for Effort, and a suggestive difference for DoU, under fixed-threshold post-clustered bootstrap intervals. Attribution, content and processing differences prevent a causal interpretation of these contrasts. The collection supports analysis of reported model use during a product transition, with source and attribution evidence retained for interpretation.
Sources
- An Empirical Study of GPT-4o Image Generation Capabilities
- Synthetic Politics: Prevalence, Spreaders, and Emotional Reception of AI-Generated Political Images on X
- TrueFake: A Real World Case Dataset of Last Generation Fake Images also Shared on Social Networks
- AMMeBa: A Large-Scale Survey and Dataset of Media-Based Misinformation In-The-Wild
- Where Detectors Fail: Probing Generative Space for Generalizable AI-Generated Image Detection
- Examining the Prevalence and Dynamics of AI-Generated Media in Art Subreddits
- TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2
- GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generation
- Can Multi-modal (reasoning) LLMs work as deepfake detectors?
- GPT-Image-2 in the Wild: A Twitter Dataset of Self-Reported AI-Generated Images from the First Week of Deployment
- GPT4o-Receipt: A Dataset and Human Study for AI-Generated Document Forensics
- How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark study
- A Benchmark Dataset for MLLM-Generated Image Detection: GPT Image2 & Nano Banana2
- PGC: Peak-Guided Calibration for Generalizable AI-Generated Image Detection
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models