Simulating the Resident: Generating Executable Smart Home Schedules via LLM Personas

arXiv:2607.08231 · cs.CR, cs.HC · Submitted 2026-07-09 · Read on arXiv

Victor Jüttner, Xenia Wagner, Christoph Jahn, Erik Buchmann

cs.CR, cs.HC

Submitted: 2026-07-09

Comments: Published in the Proc. 1st Symposium on Artificial Intelligence throughout the Human-Centered Design Process (https://dl.gi.de/handle/20.500.12116/48536). Winner of the Best Paper Award

Journal ref: Proc. 1st Symposium on Artificial Intelligence throughout the Human-Centered Design Process 2026 (AI-HCD)

DOI: 10.18420/AIHCD2026_025

Code: https://github.com/Genymobile/scrcpy

License: http://creativecommons.org/licenses/by/4.0/

The gist: Smart homes have emerged as an important domain for HCI research, including work on usable security and privacy.

Terminology

Abstract

Smart homes have emerged as an important domain for HCI research, including work on usable security and privacy. Ideally, studies in these areas draw on datasets collected in real homes with real residents, capturing authentic device interactions, network traffic, and daily routines. However, creating such datasets is slow, expensive, and raises significant privacy concerns, as it requires long-term observation of people in their most private spaces. We propose using LLMs to generate diverse resident personas that interact with a simulated smart home, producing behaviorally grounded interaction schedules that can be executed on physical testbeds. We present (1) a design framework configuring simulated households across five socio-technical dimensions, (2) a multi-stage LLM pipeline that produces structured, executable device interaction schedules, and (3) a proof of concept demonstrating feasibility. As a work in progress, we aim to support scalable, privacy-conscious smart-home experimentation without relying on intrusive real-world data collection.

Sources

Related papers