FutureLens: Longitudinal Topic Patterns in Scholarly Text and Future-Work References
cs.DL, cs.AI, cs.IR
Submitted: 2026-10-09
Updated: 2026-10-09
Comments: 10 pages, Accepted at AI4SciSci 2026 (3rd International Workshop on Artificial Intelligence for the Science of Science), co-located with ACM/IEEE-CS JCDL 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: Future-work statements offer a record of the questions researchers choose to leave open.
Abstract
Future-work statements offer a record of the questions researchers choose to leave open. Using them to describe a field, however, requires separating thematic change from changes in document coverage, topic assignment, and scholarly writing. FutureLens examines these measurement issues in a recovered snapshot of 5,655 ACL papers published during 2012--2022, including 4,005 with supplied future-work reference text. We compare non-negative matrix factorization (NMF) and latent Dirichlet allocation (LDA), aggregate topic presence at the paper level, and examine normalized prevalence, exploratory trend statistics, assignment stability, and agreement between input-derived text and references. Across available seeds, NMF has higher mean normalized pointwise mutual information (0.1387 versus 0.1280) and higher pairwise assignment stability, while LDA has greater keyword diversity (0.8900 versus 0.7750). Seed-zero results show increasing prevalence of broad model-training and question-related vocabulary, alongside substantial citation and document-structure content. Mean input/reference topic-set overlap is 0.5191 for NMF and 0.4924 for LDA; temporal rank agreement varies widely and does not imply agreement in prevalence levels. These findings support a descriptive account of the available corpus, with explicit qualifications for missing references, incomplete runs, and unverified reference provenance. The contribution is an empirical measurement study of longitudinal scholarly signals, not a new topic-modeling algorithm or a forecasting system.
Related papers
- Persistence Paradox in Dynamic Science: Evidence from the Deep Learning Revolution
- How Deep Do Large Language Models Internalize Scientific Literature and Citation Practices?
- MTRACE: Multilingual Retrieval-Augmented Generation for Temporally Diverse Text Corpora
- Eleven Years of BRACIS: A Meta-Scientific Study of the Brazilian Conference on Intelligent Systems
- Evidence-Based Scientific Question Discovery: A Framework with Historical Backtesting