"I Know Where to Look," But Does the LLM? Charting the Gaps Between Clinical Expert Needs and Unstructured Data Abstraction Tools

arXiv:2609.19318 · cs.HC, q-bio.OT · Submitted 2026-09-16 · Read on arXiv

cs.HC, q-bio.OT

Submitted: 2026-09-16

Updated: 2026-09-16

Code: https://github.com/BerriAI/litellm

Terminology

• Abstraction — 107× in this paper · explained in 1 episode
• Accuracy — 10× in this paper · explained in 1 episode
• Reviewing Data — 7× in this paper
• Adam — 6× in this paper · explained in 2 episodes
• Evaluating Results — 6× in this paper
• Specifying Tasks — 6× in this paper
• Core — 5× in this paper · explained in 2 episodes
• Large Language Models (LLMs) — 3× in this paper · explained in 6 episodes
• Prompt Engineering — 3× in this paper · explained in 4 episodes
• Steering — 3× in this paper · explained in 2 episodes
• Accountability — 2× in this paper · explained in 2 episodes
• Active Learning — 2× in this paper · explained in 6 episodes
• Failure Modes — 2× in this paper · explained in 3 episodes
• Initial Data — 2× in this paper · explained in 2 episodes
• Iterative Refinement — 2× in this paper · explained in 3 episodes
• Predictive Modeling — 2× in this paper · explained in 2 episodes
• Robustness — 2× in this paper · explained in 5 episodes
• Adaptivity — 1× in this paper · explained in 1 episode
• Alignment — 1× in this paper · explained in 1 episode
• Artificial Intelligence (AI) — 1× in this paper · explained in 2 episodes
• Benchmarking — 1× in this paper · explained in 4 episodes
• Consistency — 1× in this paper · explained in 3 episodes
• Contextual Understanding — 1× in this paper · explained in 2 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Hallucination — 1× in this paper · explained in 4 episodes
• Interpretability — 1× in this paper · explained in 15 episodes
• RAG — 1× in this paper · explained in 3 episodes
• Task Decomposition — 1× in this paper · explained in 2 episodes
• Temporal Reasoning — 1× in this paper · explained in 2 episodes
• Transfer Learning — 1× in this paper · explained in 10 episodes
• Uncertainty Quantification — 1× in this paper · explained in 8 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• EXMOS: Explanatory Model Steering Through Multifaceted Explanations and Data Configurations
• ClinicalVis: Supporting Clinical Task-Focused Design Evaluation
• TempoQL: A Readable, Precise, and Portable Query System for Electronic Health Record Data
• Red Teaming Language Models with Language Models
• Generalization in Healthcare AI: Evaluation of a Clinical Large Language Model
• From Fuzzy to Formal: Scaling Hospital Quality Improvement with AI
• Adaptive auditing of AI systems with anytime-valid guarantees

Related papers

• EduGage: A Multimodal Dataset and Benchmark for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning
• EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution
• HAGI++: Head-Assisted Gaze Imputation and Generation
• Linking Behaviour and Perception to Evaluate Meaningful Human Control over Partially Automated Driving
• Review of Explainable Decision Support and Adaptive Human-Machine Interfaces for Automation Transparency in Maritime Autonomous Surface Ships
• Towards Cognitive Process-Aware Proactive Writing Support