Optimal Design for Multinomial Logit Model with Applications to Best Assortment Identification

arXiv:2605.25592 · stat.ML, cs.LG · Submitted 2026-05-25 · Read on arXiv

stat.ML, cs.LG

Submitted: 2026-05-25

Updated: 2026-08-26

Comments: Accepted at ICML 2026

License: http://creativecommons.org/licenses/by-sa/4.0/

The gist: We study optimal experimental design for multinomial logit (MNL) bandits, where an agent repeatedly selects a subset of K items from a ground set of size N and observes single-choice feedback.

Terminology

Abstract

We study optimal experimental design for multinomial logit (MNL) bandits, where an agent repeatedly selects a subset of K items from a ground set of size N and observes single-choice feedback. Unlike linear or generalized linear bandits, MNL bandits have a combinatorial action space, which makes classical optimal design approaches and naive optimization over all subsets computationally intractable. We propose a computationally efficient optimal design framework for MNL models that achieves both statistical efficiency and scalability through two complementary approaches: (i) an exact or certified-approximate reformulation of the design oracle as a 0 - 1 mixed-integer linear program (MILP) with solver-certified early stopping, and (ii) a fully polynomial-time lifted design that replaces the nonlinear objective with a tractable surrogate. Using the Kiefer-Wolfowitz equivalence theorem, we establish near G-optimality guarantees and characterize the induced statistical-computational trade-offs. As an application, we develop a best assortment identification algorithm for MNL bandits with linear utilities and non-uniform revenues, and prove an instance-dependent sample complexity of (d N over Δ squared), where d is the feature dimension, N is the number of arms, and Δ is the minimum revenue gap.

Sources

Related papers