Security papers — 2026-10-12
Today's focus is on how we secure autonomous AI agents as they move into sensitive areas where prompt injection attacks can leak data or cause cross-agent infections. These agents are becoming more integrated into real-world workflows, making robust defenses essential for their deployment. We looked at how these attacks work in single agents first, but we also extended the investigation to multi-agent frameworks to see how weaknesses spread between different agents.
We introduced APEX-Harm as a benchmark to evaluate prompt and script injection against long-horizon agents working in shared professional workspaces filled with numerous files and tools. We tested twelve frontier models on one hundred eighty task instances for each. While Opus 5 and Sonnet 5 had lower overall attack success rates at eight percent and twenty percent respectively, attacks targeting task-specific script replacement or attacker-provided generic scripts remained quite effective. These attacks averaged eighty-one to eighty-four percent and seventy-three percent success rates. This suggests that simply producing a correct deliverable is not enough to guarantee safe behavior.
Beyond workspace attacks, we explored how safety responses in cyber-physical systems can become new attack surfaces by introducing Safety Graph. This formal framework unifies attack graphs, fault trees, and event trees to model the IT-OT cascade. We used this framework to simulate a chemical process plant and found that the planning compilation of Safety Graph automatically discovered safety-response-induced lateral movements. This identified barriers that existing models missed.
This work connects directly to agent security because understanding cascading failures is crucial when agents interact with operational technology. Another area of concern involves gradual corruption, which we addressed with Cancerous Backdoor Attack. This method uses invisible tokens and a stage controller to slowly degrade an LLM's reasoning over several interactions before causing terminal activation. This technique consistently produced gradual reasoning corruption across various models and tasks. Answer accuracy alone is insufficient for detecting these subtle backdoor attacks.
Finally, we looked at integrity checks in federated learning systems by developing a checksum method that allows a server to interrogate clients about the gradients they induce. This successfully flagged active attacks with one hundred percent true-positive rates without false positives on the checksum axis. This in-band signal is robust against attackers who do not decouple their computation from the audited state. It provides a way to monitor model tampering within distributed learning environments.
The work that matters most here is CAPE because it directly addresses how we actually spend our limited time fixing software vulnerabilities by making remediation decisions based on whether a vulnerability can actually be reached or exploited in a specific system. This is far more practical than just using general severity scores. CAPE enriches scanner reports with deployment evidence to perform reachability and exploitability analysis. This means it ranks fixes based on real-world impact rather than just theoretical risk metrics like CVSS or EPSS.
This contextual approach shows that CAPE significantly outperforms context-free baselines because a large majority of reported vulnerabilities are not actually reachable or exploitable in the applications tested. This leads to huge discrepancies between the engine's ranking and simpler scoring methods. Furthermore, CAPE consistently flags confirmed-exploitable CVEs as higher priority than any of the baseline scores. This proves that knowing what can be exploited provides much better guidance for patching efforts.
This contextual prioritization is then contrasted with other research focusing on different domains. For instance, while one study looks at optimizing operational costs in power grids by translating machine learning prediction errors into risk costs, CAPE focuses purely on the practical distribution of remediation tasks within software ecosystems.
The most critical area right now is how we are building reliable digital identities that can prove who someone is without relying solely on centralized systems. Current methods of linking meaningful names, like a domain name, to self-authenticating identifiers leave everything vulnerable to blocking and manipulation. We are seeing work exploring how to combine these approaches into a single self-authenticating meaningful identity.
One promising direction involves grounding this identity association and integrity in contextual trust rather than just structural authority from traditional infrastructure. This means trusting an attestation only if the person making it is relevant to the identity, which is a big shift away from old centralized models. This idea connects to other work because we are also looking at how to use existing secure onion association methods when applying them to DID associations.
Another important piece of research focuses on securing AI agents that use bundled skills by attacking the artifacts they create across sessions. We found that malicious effects can spread through instruction propagation, data boundary violations, and evidence poisoning when skills reuse persistent files or configurations. A defense called SkillRelayGuard significantly cuts down these attack success rates by restoring artifact provenance context. This shows a substantial improvement in security while maintaining high task completion rates.
This work on agent security is related to how we secure LLM interactions; for instance, the ToFu framework helps automatically check the semantics of tools used by large language models against known weaknesses. Furthermore, understanding organizational context is vital because an agent's judgment about a security asset depends heavily on what the organization knows about it. This addresses the gap between machine state and human-recorded policy.
On a different technical front, we are seeing progress in post-quantum cryptography for Matter over Thread devices. Initial handshake methods were vulnerable to future quantum computers due to reliance on P-256 ECDH. We quantified the size penalty when moving to ML-KEM and post-quantum signatures, finding that a drop-in configuration is too large for current message limits.
This cryptographic challenge is compounded by network issues in multi-hop Thread scenarios. Sending these larger messages as fragmented packets causes spurious retransmissions that significantly slow down handshakes unless we use techniques like caching certificate chains. This connects to the identity work because both areas are focused on making secure connections robust against future threats and current network limitations.
The most critical finding relates to how we judge defenses, because simply achieving a high detection score does not guarantee a safer model. We saw that on two of the four pairs in the audit, Confident Learning scores were actually higher than those that showed better attack success. For the dog to cat comparison, the attack success rate was twenty-six times greater when using the method that scored higher. This suggests we should be looking at a different metric entirely when evaluating security measures.
We also looked at reproducing SPECTRE, which is a defense recommended by FLIP's authors. It performed only 90 point 94 percent against its published score of 91 point 47 percent. When comparing the prototype audit on frozen features to the attack success, the latter deleted six percent for higher clean accuracy while having a lower attack success rate. This points toward using an oracle control based on retraining the victim rather than relying solely on a detection score.
This leads us to consider what is still open, which is that catching more poisons does not necessarily reduce attack success rates in all cases. The prototype family, which we considered our best static performer, was the first one that an adaptive attacker slipped past. We need to check labels in a space that never learned them and judge a defense by the retrained model instead of just its detection score.
The most critical finding relates to auditing prompt injection defenses before they reach users because current evaluations often overestimate robustness, leading to a false sense of security when fine-tuning defenses against adversarial attacks like GCG and BEAST can succeed up to ninety-six percent of the time. This means developers need to stress-test their models using optimization-based attacks rather than relying on prior empirical results.
This auditing framework shows that intermediate checkpoints generated during the fine-tuning process are genuine artifacts that realistic adversaries can exploit, even though they are not available to attackers. This vulnerability exposure is more significant than previous evaluations suggested. This finding is supported by the work on auditing defenses under strong adversaries before deployment.
The paper on neuron functionality analysis for model reuse shows that NFARD can detect unauthorized reuse relations between deep neural networks using only normal test samples. It achieves high F1 scores in both white-box and black-box settings. This method offers a novel way to protect intellectual property by focusing on the underlying neuron functionality rather than needing adversarial examples.
The study on hardware malware detectors indicates that tree- and rule-based detectors achieve the best detection performance with significantly less area and power consumption compared to function-based classifiers. This suggests a more efficient path for deploying these tools.
Finally, the research into evidence-driven agents for vulnerability repair demonstrates that EviRepair consistently improves resolved rates on benchmarks like PatchEval. It does this by leveraging multi-agent collaboration to verify collected vulnerability evidence before synthesizing a patch.
Today's papers
- An Exploration of Attacks on AI Agent Systems investigates how prompt injection can exploit both direct user inputs and interagent communication to leak sensitive information and trigger cross-agent infections. [paper]
- APEX-Harm evaluates agent safety in shared professional workspaces by creating a benchmark for prompt and script injection against long-horizon agents.
- Safety Graph introduces a formal framework to model IT-OT attacks in cyber-physical systems by unifying attack graphs, fault trees, and event trees.
- Cancerous Backdoor Attack presents an attack that gradually corrupts an LLM's reasoning over multiple interactions using invisible tokens and a stage controller.
- Quantization-Tolerant Gradient Auditing for Active Inference-Attack Detection in Federated Learning proposes a checksum method to detect active attacks in federated learning systems. [paper]
- Secrets in Preamble proposes embedding secrets within Wi-Fi waveforms using the legacy short training field for covert communication.
- AgentValve presents a protocol for Sybil-resilient payment authorization in permissionless AI markets by bounding agent payment exposure through trust networks.
- Sample-Preserving Search-to-Decision Reduction for Noisy Linear Equations over Large Moduli provides an efficient reduction for solving noisy linear equations with few samples. [paper]
- CAPE introduces a vulnerability analysis framework that enriches CVE reports with deployment evidence to prioritize remediation efforts contextually.
- Decision-Focused Learning for Cyber-Physical Risk-Aware Power Grid Operations proposes an optimization-learning framework to minimize power grid operational costs while accounting for detection errors. [paper]
- Towards Safe World Models: Risks, Defenses, and Evaluation organizes the literature on world model safety across a lifecycle to connect model behavior to operational safety. [paper]
- WaveMark proposes a wavelet-domain watermarking method for diffusion models that embeds messages robustly against removal attacks.
- The Limits of Query Monitoring against Distributed Model Extraction studies what information LLMs can reveal through queries alone in distributed model extraction campaigns. [paper]
- Understanding Verification Vulnerabilities in Cross-chain Bridges provides a systematic study and taxonomy of security vulnerabilities in cross-chain bridge contracts.
- SoK presents a systematization of privacy-preserving order matching across various protocol families to characterize trade-offs between privacy and functionality.
- Provably Subexponential Algorithms for Bounded-Error LWE with Few Samples shows an efficient algorithm for solving LWE problems with few samples over prime moduli. [paper]
- Onions in the ATmosphere describes approaches to self-authenticating meaningful identities by associating domain names or atproto handles with onion addresses or DIDs.
- Understanding and Mitigating Cross-Session Attacks via Persistent Artifacts in Agent Skill Composition investigates cross-session attacks in skill-based agents and proposes a runtime defense. [paper]
- Post-Quantum Session Establishment for Matter over Thread quantifies the cost of moving Matter's handshake to post-quantum cryptography protocols on Thread.
- Organizational Context for the Enterprise Security Brain defines organizational context as a layer to enrich agent reasoning about enterprise security by incorporating heterogeneous data. [paper]
- ToFu presents a tool-aware framework that automatically derives semantic security checks for LLM tools from their metadata to prevent misuse in agent orchestration.
- Beyond Edge Coverage: Per-Task Data-Flow Extraction at Kernel Function Boundaries via LLVM introduces an instrumentation framework for data-flow extraction in kernel functions for fuzzing and analysis. [paper] [episode]
- Virtualization-based Penetration Testing Study for Detecting Accessibility Abuse Vulnerabilities in Banking Apps in East and Southeast Asia examines malware that exploits accessibility services on Android banking apps. [paper] [episode]
- Better Batches, Better Privacy: Random Allocation for DP-BandMF proposes random allocation strategies to improve the performance of differentially private training. [paper]
- Space Over Statistic, Retraining Over Ranking: Auditing Training Labels Under Label-Only Backdoors suggests that judging defenses by retraining models rather than detection scores is more reliable against backdoor attacks. [paper]
- Enabling Extended SGX Enclaves inside Confidential Virtual Machines introduces TEEVisor to build hardware-protected process enclaves inside confidential virtual machines. [paper]
- A Systematic Study of Security Enforcement at Android Inter-Component Boundaries evaluates the security enforcement mechanisms across various inter-process communication boundaries in Android. [paper]
- HOMARD: Hammering Off-chip Memory via Aggregate power Rail Disclosure shows how unprivileged power sensors can recover DRAM mapping functions and secret data through side channels. [paper]
- Single-Shuffle Full-Open Card-Based Secure Computation Protocols for Any Function proves that every function admits a single shuffle full-open protocol using physical playing cards. [paper] [episode]
- A Comprehensive Survey of Website Fingerprinting Attacks and Defenses in Tor provides a systematic categorization of website fingerprinting research, datasets, and defenses in the Tor network.
- The Express Lane to Spam and Centralization: An Empirical Analysis of Arbitrum's Timeboost analyzes the limitations of an auction-based transaction sequencing mechanism for mitigating MEV on Arbitrum. [paper] [episode]
- LLMail-Inject introduces a large benchmark dataset of human-written prompt injection attacks to test the robustness of LLMs against adaptive adversaries.
- Auditing Prompt Injection Defenses Before They Reach Users: What Strong Adversaries Reveal argues that developers should stress-test defenses using optimization-based attacks before deployment. [paper]
- Protecting Deep Learning Model Copyrights with Adversarial Example-Free Reuse Detection proposes NFARD to detect model reuse based on neuron functionality without needing adversarial examples. [paper]
- Power, Performance, and Area of HPC-Based Malware Detectors: An FPGA and Open-PDK ASIC Study evaluates the area, power, and timing costs of hardware malware detectors. [paper]
- PVBRF-ID: Private, Verifiable and Byzantine-Robust Federated Intrusion Detection for Oilfield Enterprise Networks presents a protocol for robust federated intrusion detection in oilfield networks. [paper]
- Vulnerable Models in the AI Supply Chain: An Empirical Study of Adoption, Propagation, and Usage Patterns tracks the usage and propagation of vulnerable models across software supply chains. [paper]
- EviRepair: Evidence-Driven Agents for Reliable Vulnerability Repair proposes a multi-agent framework that uses evidence review to ensure reliable vulnerability repair in large language models. [paper]
The papers
- A Comprehensive Survey of Website Fingerprinting Attacks and Defenses in Tor: Advances and Open Challenges — As a fastidious researcher, I must first acknowledge that I have received three distinct pieces of text (A, B, and C), each presenting a different perspective or excerpt related to website fingerprinting (WF) in Tor.
- Single-Shuffle Full-Open Card-Based Secure Computation Protocols for Any Function — The gist A single-shuffle full-open card-based protocol for any function has been proven to exist, which significantly advances card-based secure computation by showing that every function can be computed under this minimal model <ref:2510.17308#pg2> Feasibility of Single-Shuffle [episode]
- Beyond Edge Coverage: Per-Task Data-Flow Extraction at Kernel Function Boundaries via LLVM — The gist The research presents KCOV-DATAFLOW, an LLVM-based instrumentation framework that extends Linux KCOV with data-flow extraction of function arguments and return values to provide state-aware feedback for fuzzers and deterministic records for security analysts. [episode]
- The Express Lane to Spam and Centralization: An Empirical Analysis of Arbitrum's Timeboost — The gist: Timeboost fails to deliver on its stated goals of fairness, decentralization, and spam reduction. [episode]
- Virtualization-based Penetration Testing Study for Detecting Accessibility Abuse Vulnerabilities in Banking Apps in East and Southeast Asia — The gist: This study conducts an empirical penetration testing of banking and finance applications in East and Southeast Asia to evaluate their susceptibility to FjordPhantom, a malware that uses virtualization to bypass accessibility service detection, revealing significant vuln [episode]
- Organizational Context for the Enterprise Security Brain —
- HOMARD: Hammering Off-chip Memory via Aggregate power Rail Disclosure —
- Cancerous Backdoor Attack: Gradual Activation via Invisible Tokens and A Stage Controller —
- Enabling Extended SGX Enclaves inside Confidential Virtual Machines —
- PVBRF-ID: Private, Verifiable and Byzantine-Robust Federated Intrusion Detection for Oilfield Enterprise Networks —
- Better Batches, Better Privacy: Random Allocation for DP-BandMF —
- Onions in the ATmosphere: Decentralizing Trust in Identity —
- Power, Performance, and Area of HPC-Based Malware Detectors: An FPGA and Open-PDK ASIC Study —
- Vulnerable Models in the AI Supply Chain: An Empirical Study of Adoption, Propagation, and Usage Patterns —
- Sample-Preserving Search-to-Decision Reduction for Noisy Linear Equations over Large Moduli —
- AgentValve: Sybil-Resilient Payment Authorization for Permissionless AI Markets —
- WaveMark: Robust Wavelet-Domain Image Watermarking for Diffusion Models —
- Post-Quantum Session Establishment for Matter over Thread: Message Size, Transport, and Protocol Options —
- Provably Subexponential Algorithms for Bounded-Error LWE with Few Samples —
- Space Over Statistic, Retraining Over Ranking: Auditing Training Labels Under Label-Only Backdoors —
- CAPE - Context-Aware Prioritization Engine for Vulnerability Scoring and Management —
- The Limits of Query Monitoring against Distributed Model Extraction —
- Safety Graph: When Safety Responses Become Attack Surfaces in Cyber-Physical Systems —
- Understanding Verification Vulnerabilities in Cross-chain Bridges: An Empirical Study —
- Understanding and Mitigating Cross-Session Attacks via Persistent Artifacts in Agent Skill Composition —
- Quantization-Tolerant Gradient Auditing for Active Inference-Attack Detection in Federated Learning —
- Secrets in Preamble: Practical and Robust PHY Information Hiding for Wi-Fi —
- Towards Safe World Models: Risks, Defenses, and Evaluation —
- EviRepair: Evidence-Driven Agents for Reliable Vulnerability Repair —
- A Systematic Study of Security Enforcement at Android Inter-Component Boundaries —
- APEX-Harm: Evaluating Agent Safety in Shared Professional Workspaces —
- ToFu: Exploiting and Fuzzing the LLM-Orchestrator-Tool Trust Boundary —
- Protecting Deep Learning Model Copyrights with Adversarial Example-Free Reuse Detection — The gist The proposed NFARD, a Neuron Functionality Analysis-based Reuse Detector, is a novel adversarial example-free method that detects deep learning model reuse relations by measuring differences in neuron functionality using only normal test samples.
- Decision-Focused Learning for Cyber-Physical Risk-Aware Power Grid Operations —
- Auditing Prompt Injection Defenses Before They Reach Users: What Strong Adversaries Reveal —
- LLMail-Inject: A Dataset from a Realistic Adaptive Prompt Injection Challenge — The gist The LLMail-Inject challenge presents a public dataset from an adaptive prompt injection competition that simulates real-world scenarios where participants attempt to inject malicious instructions into emails to trigger unauthorized tool calls in an LLM-based email assist
- An Exploration of Attacks on AI Agent Systems —
- SoK: Privacy-Preserving Order Matching —
Important terms
- Prompt Injection Attacks
- Attacks where malicious input is used to manipulate an AI agent's behavior, potentially leaking data or causing it to perform unintended actions in sensitive environments.
- APEX-Harm
- A benchmark tool used to test prompt and script injection against long-horizon agents in complex professional workspaces, showing that simple task completion isn't enough for safety.
- Safety Graph
- A formal framework that models IT-OT cascades by unifying attack graphs and fault trees, helping to discover hidden safety response movements in cyber-physical systems.
- Cancerous Backdoor Attack
- A subtle method using invisible tokens to slowly degrade an LLM's reasoning over multiple interactions, leading to terminal activation while maintaining high answer accuracy.
- CAPE (Contextual Prioritization Engine)
- A method that ranks software vulnerabilities based on whether they are actually reachable or exploitable in a specific system, offering more practical guidance than general severity scores.