Who Laughs with Whom? Disentangling Influential Factors in Humor Preferences across User Clusters and LLMs
cs.CL, cs.AI
Submitted: 2026-01-06
Updated: 2026-09-07
Comments: Accepted at EMNLP2026 Main
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Humor preferences vary widely across individuals and cultures, complicating the evaluation of humor using large language models (LLMs).
Terminology
Abstract
Humor preferences vary widely across individuals and cultures, complicating the evaluation of humor using large language models (LLMs). In this study, we model heterogeneity in humor preferences in Oogiri, a Japanese creative response game, by clustering users with voting logs and estimating cluster-specific weights over interpretable preference factors using Bradley-Terry-Luce models. We elicit preference judgments from LLMs by prompting them to select the funnier response and found that user clusters exhibit distinct preference patterns and that the LLM results can resemble those of particular clusters. Finally, we demonstrate that, by persona prompting, LLM preferences can be directed toward a specific cluster. The scripts for data collection and analysis are publicly available to support reproducibility.
Sources
- Who's Laughing Now? An Overview of Computational Humour Generation and Explanation
- Evaluation of Text Generation: A Survey
- UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
- Oogiri-Master: Benchmarking Humor Understanding via Oogiri
- Does Prompt Formatting Have Any Impact on LLM Performance?
- Assessing the Capabilities of LLMs in Humor:A Multi-dimensional Analysis of Oogiri Generation and Evaluation
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering