DANTINOX: A Unified Framework for Multi-Paradigm Language Modeling

arXiv:2609.17535 · cs.CL · Submitted 2026-07-11 · Read on arXiv

cs.CL

Submitted: 2026-07-11

Updated: 2026-07-11

License: http://creativecommons.org/licenses/by-nc-sa/4.0/

The gist: Language generation research increasingly spans three paradigms: autoregressive decoding, discrete masked diffusion, and continuous flow-matching.

Terminology

Abstract

Language generation research increasingly spans three paradigms: autoregressive decoding, discrete masked diffusion, and continuous flow-matching. Comparing them is difficult because each lives in a separate codebase, so measured differences often reflect implementation details rather than the paradigms themselves. We present DantinoX, an open-source JAX/Flax library in which a single modular Transformer backbone serves all three paradigms. Switching the generation paradigm, attention mechanism, or hardware topology requires only a configuration change, while the backbone architecture, tokenizer, initialization strategy, and training infrastructure remain consistent. This enables controlled cross-paradigm comparisons within one API for training, streaming inference, and benchmarking.

Related papers