Toward Embedding-Based Psychometrics: Structural Modeling of Assessment-Item Semantics With Contextual Scores

arXiv:2609.31976 · cs.CL · Submitted 2026-09-25 · Read on arXiv

cs.CL

Submitted: 2026-09-25

Updated: 2026-09-25

Terminology

• Alignment — 15× in this paper · explained in 1 episode
• Calibration — 15× in this paper · explained in 7 episodes
• Embeddings — 10× in this paper · explained in 2 episodes
• Benchmark — 8× in this paper · explained in 2 episodes
• Accuracy — 4× in this paper · explained in 1 episode
• Clustering — 3× in this paper · explained in 2 episodes
• Regularization — 3× in this paper · explained in 3 episodes
• Parsimony — 2× in this paper · explained in 2 episodes
• Provenance — 2× in this paper · explained in 4 episodes
• Redundancy — 2× in this paper · explained in 2 episodes
• Transformer — 2× in this paper · explained in 2 episodes
• Variational Bayes — 2× in this paper · explained in 2 episodes
• Verification — 2× in this paper · explained in 2 episodes
• Verifier — 2× in this paper · explained in 2 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Semantic Alignment — 1× in this paper · explained in 3 episodes

Sources

• MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalisms
• Documents Are People and Words Are Items: A Psychometric Approach to Textual Data with Contextual Embeddings
• When Is a General Factor Distinguishable? Non-Proportionality, Stable Structure, and the Bifactor Decision
• Recovering Latent Structures after Variational Bayesian Variable Selection: Fit Assessment and Factor-Number Selection in Partially Exploratory Factor Analysis
• From Text to Parameters: Predicting Item Parameters from Embedding Regularization with Reliability and Design Ceilings
• A Variational Inference method for Bayesian variable selection
• Scalable Text-Embedding-informed Cognitive Diagnosis of Large Language Models

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering