Don't Trust the AI Ecosystem: Analyzing Privacy Leakage in Compromised Open-Source Components

arXiv:2607.27886 · cs.CR · Submitted 2026-07-30 · Read on arXiv

Jin-Seong Kim, Han-Ju Lee, Seok-Won Hong, Takeshi Takahashi, Chansu Han, Tomohiro Morikawa, Seok-Hwan Choi

cs.CR

Submitted: 2026-07-30

Comments: Extended version of the paper to appear in ACM CCS 2026 (17 pages, 10 figures)

Code: https://github.com/KimJinSeong-Git/GradLock

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Accuracy — 29× in this paper · explained in 1 episode
Fidelity — 28× in this paper · explained in 2 episodes
Model Inversion — 23× in this paper
Robustness — 14× in this paper · explained in 5 episodes
Quantization — 12× in this paper · explained in 12 episodes
Pruning — 11× in this paper · explained in 4 episodes
Transformer — 8× in this paper · explained in 2 episodes
Generalization — 7× in this paper · explained in 13 episodes
Fine-Tuning — 6× in this paper · explained in 5 episodes
Generalizability — 5× in this paper · explained in 6 episodes
Computer Vision and Pattern Recognition — 4× in this paper
Confidence Gap — 4× in this paper
Consistency — 4× in this paper · explained in 3 episodes
Ablation — 3× in this paper · explained in 1 episode
Alignment — 3× in this paper · explained in 1 episode
Core — 3× in this paper · explained in 2 episodes
Federated Learning — 3× in this paper · explained in 14 episodes
Generative Model — 3× in this paper · explained in 2 episodes
Ablation study — 2× in this paper · explained in 1 episode
Benchmark — 2× in this paper · explained in 2 episodes
Computational overhead — 2× in this paper · explained in 2 episodes
Conference on Computer and Communications Security — 2× in this paper
Provenance — 2× in this paper · explained in 3 episodes
Verification — 2× in this paper · explained in 2 episodes
Ablation Studies — 1× in this paper · explained in 1 episode
Abstraction — 1× in this paper · explained in 1 episode
Adversarial Training — 1× in this paper · explained in 1 episode
Annual Network and Distributed System Security Symposium — 1× in this paper
Attack Success Rate — 1× in this paper
Attack Success Rate (ASR) — 1× in this paper · explained in 2 episodes
Batch Normalization — 1× in this paper
Cosine Similarity — 1× in this paper · explained in 3 episodes
Decoupling — 1× in this paper · explained in 2 episodes
Distillation — 1× in this paper · explained in 2 episodes
Failure Modes — 1× in this paper · explained in 3 episodes
Federated Learning (FL) — 1× in this paper · explained in 7 episodes
Generative Adversarial Networks (GANs) — 1× in this paper · explained in 3 episodes
Generative Models — 1× in this paper · explained in 2 episodes
IEEE Symposium on Security and Privacy — 1× in this paper
Influence Functions — 1× in this paper · explained in 2 episodes
Knowledge Distillation — 1× in this paper · explained in 11 episodes
Learned Perceptual Image Patch Similarity — 1× in this paper
Loss Function — 1× in this paper · explained in 2 episodes
Redundancy — 1× in this paper · explained in 2 episodes
Regularization — 1× in this paper · explained in 3 episodes
Semantic Similarity — 1× in this paper · explained in 2 episodes
Trace — 1× in this paper · explained in 2 episodes
Transfer Learning — 1× in this paper · explained in 10 episodes
Two-sample Kolmogorov-Smirnov — 1× in this paper
Vision Transformer (ViT) — 1× in this paper · explained in 2 episodes

Don't Trust the AI Ecosystem: Analyzing Privacy Leakage in Compromised Open-Source Components

Terminology

Sources

Related papers