GPTBIAS: A Comprehensive Framework for Evaluating Bias in Large Language Models
cs.CL, cs.CY, cs.LG
Submitted: 2023-12-11
Updated: 2026-09-02
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- PaLM: Scaling Language Modeling with Pathways
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
- On Measuring Social Biases in Sentence Encoders
- StereoSet: Measuring stereotypical bias in pretrained language models
- CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models
- Instruction Tuning with GPT-4
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
- Safety Assessment of Chinese Large Language Models
- LLaMA: Open and Efficient Foundation Language Models
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
- Self-Instruct: Aligning Language Models with Self-Generated Instructions
- Emergent Abilities of Large Language Models
- OPT: Open Pre-trained Transformer Language Models
- Universal and Transferable Adversarial Attacks on Aligned Language Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering