Forecast-Dojo: Replayable Environments for Benchmarking and Training LLM Forecasting Agents
cs.AI, cs.LG
Submitted: 2026-09-24
Updated: 2026-09-24
Terminology
Sources
- Scaling Open-Ended Reasoning to Predict the Future
- PolyBench: Benchmarking LLM Forecasting and Trading Capabilities on Live Prediction Market Data
- WorldReasoner: Evaluating Whether Language Model Agents Forecast Events with Valid Reasoning
- FutureSim: Replaying World Events to Evaluate Adaptive Agents
- FastText.zip: Compressing text classification models
- Reinforcement Learning for LLM-based Event Forecasting
- Evaluating Strategic Reasoning in Forecasting Agents
- Agentic Forecasting with Structured Linguistic Beliefs
- Consistency Checks for Language Model Forecasters
- MLE-Dojo: Interactive Environments for Empowering LLM Agents in Machine Learning Engineering
- Qwen3 Technical Report
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher
- FutureX-Pro: Extending Future Prediction to High-Value Vertical Domains
- Bench to the Future: A Pastcasting Benchmark for Forecasting Agents
- LLM-as-a-Prophet: Understanding Predictive Intelligence with Prophet Arena
- MIRAI: Evaluating LLM Agents for Event Forecasting
- Do Language Models Update their Forecasts with New Information?
- FutureX: An Advanced Live Benchmark for LLM Agents in Future Prediction
- Prediction Arena: Benchmarking AI Models on Real-World Prediction Markets
- Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection