TAC-Time: Texts as Channels For Multimodal Time Series Forecasting
cs.CL, cs.AI, cs.LG, cs.MM
Submitted: 2026-09-21
Updated: 2026-09-21
Comments: 11 pages, 6 figures, 4 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: Most existing time series forecasting methods rely solely on numerical observations, overlooking rich contextual information from auxiliary texts.
Terminology
Abstract
Most existing time series forecasting methods rely solely on numerical observations, overlooking rich contextual information from auxiliary texts. Recent multimodal approaches attempt to incorporate textual signals, but they often treat text as static features or use large language models as forecasting backbones, limiting their ability to capture temporal dynamics and increasing computational cost. To address these challenges, we propose TAC-Time, a unified framework that transforms textual information into additional temporal channels. By modeling text features jointly with numerical sequences in a shared temporal backbone, TAC-Time preserves temporal continuity and periodic structures while remaining efficient and scalable. This formulation also enables systematic interpretability analyses. We show strong cross-modal dependencies through attention and frequency-domain analyses, and identify predictive textual signals whose correlation-aware alignment yields partial forecasting improvements. Extensive experiments on real-world multimodal benchmarks demonstrate that TAC-Time outperforms prior methods.
Sources
- Text Reinforcement for Multimodal Time Series Forecasting
- iTransformer: Inverted Transformers Are Effective for Time Series Forecasting
- CC-Time: Cross-Model and Cross-Modality Time Series Forecasting
- Multimodal Conditioned Diffusive Time Series Forecasting
- Language in the Flow of Time: Time-Series-Paired Texts Weaved into a Unified Temporal Narrative
- UniCast: A Unified Framework for Instance-Conditioned Multimodal Time-Series Forecasting
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering