AEScorer: An Agentic Evidence-Grounded Framework for Graded Factuality Verification

arXiv:2601.03605 · cs.CL · Submitted 2026-01-07 · Read on arXiv

cs.CL

Submitted: 2026-01-07

Updated: 2026-08-27

Terminology

• Verification — 72× in this paper · explained in 2 episodes
• Verifier — 70× in this paper · explained in 2 episodes
• Agentic Search — 17× in this paper · explained in 1 episode
• Benchmark — 13× in this paper · explained in 2 episodes
• Generative Model — 10× in this paper · explained in 2 episodes
• Hallucination — 9× in this paper · explained in 3 episodes
• Generative Models — 5× in this paper · explained in 2 episodes
• Accuracy — 4× in this paper · explained in 1 episode
• Trace — 4× in this paper · explained in 2 episodes
• Ablation — 3× in this paper · explained in 1 episode
• Ablation Studies — 3× in this paper · explained in 1 episode
• Adaptability — 3× in this paper · explained in 1 episode
• Agentic Reasoning — 3× in this paper · explained in 1 episode
• Reinforcement Learning — 3× in this paper · explained in 4 episodes
• Transformer — 3× in this paper · explained in 2 episodes
• Adaptation — 2× in this paper · explained in 1 episode
• Alignment — 2× in this paper · explained in 1 episode
• Benchmarking — 2× in this paper · explained in 3 episodes
• F1 Score — 2× in this paper · explained in 3 episodes
• Fine-Tuning — 2× in this paper · explained in 5 episodes
• Hallucination Detection — 2× in this paper · explained in 2 episodes
• LLM-as-a-Judge — 2× in this paper · explained in 3 episodes
• Large Language Models (LLMs) — 2× in this paper · explained in 6 episodes
• Actor — 1× in this paper · explained in 3 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Feature Engineering — 1× in this paper · explained in 3 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Low-Rank Adaptation (LoRA) — 1× in this paper · explained in 9 episodes
• Parameter Efficiency — 1× in this paper · explained in 3 episodes
• Parameter-Efficient Fine-Tuning — 1× in this paper · explained in 2 episodes
• Scaling Laws — 1× in this paper · explained in 4 episodes
• Unified Framework — 1× in this paper · explained in 5 episodes
• alpha — 1× in this paper · explained in 1 episode

Sources

• FELM: Benchmarking Factuality Evaluation of Large Language Models
• DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
• LoRA: Low-Rank Adaptation of Large Language Models
• FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios
• Learning to Verify Summary Facts with Fine-Grained LLM Feedback
• A Revisit of Fake News Dataset with Augmented Fact-checking by ChatGPT
• TruthfulQA: Measuring How Models Mimic Human Falsehoods
• A Comprehensive Survey on Long Context Language Modeling
• When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories
• A Survey of Context Engineering for Large Language Models
• HalluciNot: Hallucination Detection Through Context and Common Knowledge Verification
• Towards Reliable Misinformation Mitigation: Generalization, Uncertainty, and GPT-4
• Atomic Inference for NLI with Generated Facts as Atoms
• LLaMA: Open and Efficient Foundation Language Models
• Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity
• Text Embeddings by Weakly-Supervised Contrastive Pre-training
• HuggingFace's Transformers: State-of-the-art Natural Language Processing
• Qwen3 Technical Report
• A Survey of Large Language Models

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering