Synchronization-Free Algebraic Fingerprints for Large Language Models: From Autoregressive to Diffusion Models
Jaroslaw Janas, Josef Pieprzyk, Pawel Morawiecki
cs.CR, cs.IT
Submitted: 2026-07-18
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large Language Models (LLMs) have created an urgent need for reliable watermarking methods that enable attribution of generated text while remaining robust to editing and paraphrasing.
Terminology
Abstract
Large Language Models (LLMs) have created an urgent need for reliable watermarking methods that enable attribution of generated text while remaining robust to editing and paraphrasing. We propose a novel synchronization-free watermarking scheme in which every watermark consists of a single binary congruence generated from a pair of neighbouring tokens. For each token pair, a cryptographic hash determines an evaluation point of a Reed--Solomon polynomial representing the secret identity, while the parity of the polynomial evaluation determines the watermark bit embedded into the second token of the pair. Since each congruence is self-contained and depends only on the local token pair, the proposed construction is naturally resistant to insertions, deletions, and token reordering. We analyse the recovery problem from an algebraic perspective, discuss several decoding algorithms suitable for different identity sizes, and model watermark corruption as a Binary Symmetric Channel. The analysis shows that reliable recovery requires only a small redundancy even for relatively high token corruption rates. Unlike existing block-based watermarking schemes, the proposed method avoids synchronization problems while providing a flexible framework for embedding both short and long secret identities.
Sources
- Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge
- GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trick
- LLaMA: Open and Efficient Foundation Language Models
- Channels with Markov Synchronization Errors: Information Stability and Capacity Bounds
- Provably Robust Multi-bit Watermarking for AI-generated Text
- FreqMark: Frequency-Based Watermark for Sentence-Level Detection of LLM-Generated Text
- Duwak: Dual Watermarks in Large Language Models
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills
- Token Composition: A Graph Based on EVM Logs