Evidence-Bound Gateway-Path Provenance for Third-Party LLM Inference
cs.CR
Submitted: 2026-06-21
Updated: 2026-10-16
Comments: 13 pages, 4 figures. Expanded protocol model and security analysis of authorization, request/stream binding, charge integrity, metadata leakage, and runtime lifecycle; existing measurements retained
License: http://creativecommons.org/licenses/by/4.0/
The gist: Third-party LLM gateways select providers, models, endpoints, and fallback paths while also authoring the records used to explain and bill those decisions.
Terminology
Abstract
Third-party LLM gateways select providers, models, endpoints, and fallback paths while also authoring the records used to explain and bill those decisions. We present evidence-bound gateway-path provenance, which makes these decisions subject to client-verifiable request contracts. An attested mediation runtime intersects a signed service policy with the client's authorization, constructs provider-facing calls, and protects streamed responses. The contract distinguishes initial routes from fallback destinations and admits each transition only after an authorized failure. A signed close-out binds the execution trace, provider-reported usage, authorized pricing, and complete response. We formalize the protocol state machine and establish authorization preservation, execution and stream binding, charge integrity, and channel confidentiality relative to the public receipt metadata. The analysis also characterizes replay, runtime replacement, and the information disclosed by public payload commitments. Controlled software-path measurements show 0.442 ms paired p95 latency overhead at concurrency one, peak throughput of 10.65 thousand requests/s, and stream close-out below 0.4 ms p95. An AWS Nitro Enclaves prototype completed 30 live single-route streaming requests with attestation-bound session and signing keys. The design separates gateway administration from payload processing and supplies a verifiable account of each confirmed execution.
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills
- Token Composition: A Graph Based on EVM Logs