EPT Benchmark: Evaluation of Persian Trustworthiness in Large Language Models

arXiv:2509.06838 · cs.CL, cs.CR · Submitted 2025-09-08 · Read on arXiv

cs.CL, cs.CR

Submitted: 2025-09-08

Updated: 2025-09-08

Code: https://github.com/Rezamirbagheri110/EPT-Benchmark

Terminology

• Benchmark — 45× in this paper · explained in 2 episodes
• Robustness — 36× in this paper · explained in 5 episodes
• Alignment — 31× in this paper · explained in 1 episode
• Consistency — 5× in this paper · explained in 3 episodes
• Evaluation of Persian Trustworthiness — 5× in this paper
• Hallucination — 5× in this paper · explained in 3 episodes
• Accuracy — 4× in this paper · explained in 1 episode
• Generalization — 4× in this paper · explained in 13 episodes
• Adaptability — 3× in this paper · explained in 1 episode
• Adversarial Attacks — 3× in this paper · explained in 1 episode
• Benchmarking — 3× in this paper · explained in 3 episodes
• Fine-Tuning — 3× in this paper · explained in 5 episodes
• Adversarial Training — 2× in this paper · explained in 1 episode
• Alignment Techniques — 2× in this paper · explained in 1 episode
• Large Language Models (LLMs) — 2× in this paper · explained in 6 episodes
• Standardized Benchmarks — 2× in this paper · explained in 2 episodes
• AI Alignment — 1× in this paper · explained in 2 episodes
• Accountability — 1× in this paper · explained in 2 episodes
• Adaptive Response — 1× in this paper · explained in 1 episode
• Adversarial Debiasing — 1× in this paper · explained in 1 episode
• Calibration — 1× in this paper · explained in 7 episodes
• Differential Privacy — 1× in this paper · explained in 4 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Generative Model — 1× in this paper · explained in 2 episodes
• Generative Models — 1× in this paper · explained in 2 episodes
• Human-in-the-Loop — 1× in this paper · explained in 3 episodes
• Interpretability — 1× in this paper · explained in 15 episodes
• Prompt Engineering — 1× in this paper · explained in 4 episodes
• RAG — 1× in this paper · explained in 3 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Reinforcement Learning — 1× in this paper · explained in 4 episodes
• Retrieval-Augmented Generation (RAG) — 1× in this paper · explained in 16 episodes
• Self-Supervised Learning — 1× in this paper · explained in 8 episodes
• Sycophancy — 1× in this paper · explained in 4 episodes
• Temporal consistency — 1× in this paper · explained in 2 episodes
• Transformer — 1× in this paper · explained in 2 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• Emergent Abilities in Large Language Models: A Survey
• A Survey of Generative Categories and Techniques in Multimodal Generative Models
• Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations
• A Survey on Evaluation of Large Language Models
• Constitutional AI: Harmlessness from AI Feedback
• Reinforcement Learning for LLM Post-Training: A Survey
• A General Language Assistant as a Laboratory for Alignment
• AI Alignment: A Comprehensive Survey
• Large Language Model Alignment: A Survey
• Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment
• In ChatGPT We Trust? Measuring and Characterizing the Reliability of ChatGPT
• Modeling Emotions and Ethics with Large Language Models
• Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey
• Navigating LLM Ethics: Advancements, Challenges, and Future Directions
• A Survey on Privacy Risks and Protection in Large Language Models
• Jailbreak Attacks and Defenses Against Large Language Models: A Survey
• Trustworthiness in Retrieval-Augmented Generation Systems: A Survey
• TrustGPT: A Benchmark for Trustworthy and Responsible Large Language Models
• Link Prediction without Graph Neural Networks
• CValues: Measuring the Values of Chinese Large Language Models from Safety to Responsibility

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering