Investigating Social Bias Changes in Quantized Language Models

arXiv:2602.06181 · cs.CL · Submitted 2026-02-05 · Read on arXiv

cs.CL

Submitted: 2026-02-05

Updated: 2026-08-31

Code: https://github.com/stan-hua/PostTrainingBiasBenchmark

Terminology

• Quantization — 154× in this paper · explained in 12 episodes
• Benchmark — 12× in this paper · explained in 2 episodes
• Alignment — 6× in this paper · explained in 1 episode
• Calibration — 5× in this paper · explained in 7 episodes
• Benchmarking — 4× in this paper · explained in 3 episodes
• Accuracy — 3× in this paper · explained in 1 episode
• Activation-Aware Weight Quantization — 3× in this paper
• Adam — 3× in this paper · explained in 2 episodes
• Aggregation — 3× in this paper · explained in 1 episode
• Fine-Tuning — 3× in this paper · explained in 5 episodes
• Hallucination — 3× in this paper · explained in 3 episodes
• Interference Misinformation — 3× in this paper
• Transformer — 3× in this paper · explained in 2 episodes
• Unified Framework — 3× in this paper · explained in 5 episodes
• Generalization — 2× in this paper · explained in 13 episodes
• Perplexity — 2× in this paper · explained in 3 episodes
• Robustness — 2× in this paper · explained in 5 episodes
• Adaptation — 1× in this paper · explained in 1 episode
• Clustering — 1× in this paper · explained in 2 episodes
• Downstream Tasks — 1× in this paper · explained in 2 episodes
• Elias — 1× in this paper · explained in 2 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Generalization Bounds — 1× in this paper · explained in 2 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• LoRA Adapters — 1× in this paper · explained in 3 episodes
• Low-Rank Adaptation (LoRA) — 1× in this paper · explained in 9 episodes
• Reconstruction Error — 1× in this paper · explained in 2 episodes

Sources

• Measuring Implicit Bias in Explicitly Unbiased Large Language Models
• Lessons from the Trenches on Reproducible Evaluation of Language Models
• Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
• FairMT-Bench: Benchmarking Fairness for Multi-turn Dialogue in Conversational LLMs
• GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
• Bias and Fairness in Large Language Models: A Survey
• Intrinsic Bias Metrics Do Not Correlate with Application Bias
• Understanding the Effect of Model Compression on Social Bias in Large Language Models
• Do Compressed LLMs Forget Knowledge? An Experimental Study with Practical Implications
• Decoding Compressed Trust: Scrutinizing the Trustworthiness of Efficient LLMs Under Compression
• Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations
• Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
• A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners
• Debiasing isn't enough! -- On the Effectiveness of Debiasing MLMs and their Social Biases in Downstream Tasks
• The Impact of Inference Acceleration on Bias of LLMs
• Uncertainty-based Fairness Measures
• The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models
• Fairness Testing of Large Language Models in Role-Playing
• Unlocking Tokens as Data Points for Generalization Bounds on Larger Language Models
• SimPO: Simple Preference Optimization with a Reference-Free Reward

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering