AuthorMix: Modular Authorship Style Transfer via Layer-wise Adapter Mixing
cs.CL, cs.AI
Submitted: 2026-03-24
Updated: 2026-09-16
Comments: Proceedings of EMNLP 2026
Code: https://github.com/FacebookResearch/Nevergrad
License: http://creativecommons.org/licenses/by/4.0/
The gist: The task of authorship style transfer involves rewriting text in the style of a target author while preserving the meaning of the original text.
Terminology
Abstract
The task of authorship style transfer involves rewriting text in the style of a target author while preserving the meaning of the original text. Existing style transfer methods train a single model on large corpora to model all target styles at once: this high-cost approach offers limited flexibility for target-specific adaptation, and often sacrifices meaning preservation for style transfer. In this paper, we propose AuthorMix: a lightweight, modular, and interpretable style transfer framework. We first train individual, style-specific LoRA adapters on a small set of high-resource authors: this allows for the rapid training of specialized adaptation models for each new target using layer-wise adapter mixing via reinforcement learning, necessitating only a handful of target-style training examples. AuthorMix ranks first on the combined style-meaning score among all baselines, including GPT-5.1, and substantially improves meaning preservation over the trained baselines; under human evaluation it is the only method best-or-tied on every dimension.
Sources
- A standardized Project Gutenberg corpus for statistical analysis of natural language and quantitative linguistics
- Authorship Style Transfer with Policy Optimization
- Low-Resource Authorship Style Transfer: Can Non-Famous Authors Be Imitated?
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering