SeoulMMOD: A Large-Scale Multimodal Origin-Destination Flow Benchmark

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Today's paper: "SeoulMMOD: A Large-Scale Multimodal Origin-Destination Flow Benchmark".

Jane: The gist SeoulMMOD introduces a large-scale public benchmark for citywide multimodal mobility in Seoul, providing three years of hourly origin-destination flows across six travel modes and two spatial levels,

Tom: First, who's behind it and why it matters.

Paper summary: Tom: So, looking at SeoulMMOD: A Large-Scale Multimodal Origin–Destination Flow Benchmark, the authors are Taeyoung Yu, Seonbin Jo, Jiwon Kim, and Junyoung Byun #pg1. They introduce SEOULMMOD as a large-scale public benchmark for citywide multimodal mobility in Seoul #pg3.

Jane: It provides three years of hourly OD flows estimating total mobility for six urban travel modes across twenty-five districts and four hundred twenty-six sub-districts, together with travel-time, travel-distance, calendar, rainfall, and point-of-interest signals #pg3 <ref:2610.13730#pg1,urban travel modes across 25 districts and 426 sub-districts, together with>. That’s a lot of data for one benchmark.

Lu: The core contribution is releasing this data to benchmark fourteen forecasting baselines under a common protocol #pg3. They analyze the effects of spatial scaling, joint versus mode-separate training, and cross-year generalization #pg3.

Meng: They show that the OD flow follows a heavy-tailed distribution, which is consistent with observed human mobility patterns in cities #pg6. That means you’re dealing with some pretty extreme spikes in travel demand.

Tom: The spatial pattern is uneven, and the mode-specific network structure shows that modes differ in their spatial community structure #pg6. For instance, car trips show long-range connections spanning the city, which leads to low modularity and few large clusters with Q equals zero point five eight four and seven clusters #pg6.

Jane: That’s interesting because walk trips show short-range connections that form many localized clusters with Q equals zero point eight five two and fourteen clusters #pg6. It shows how different travel choices shape the city's structure depending on the mode you look at.

Lu: They also note that naive joint multi-mode training does not consistently improve accuracy #pg6. This suggests that simply feeding everything together isn't always the right approach for this kind of data #pg6.

Meng: And when you try to scale up, they found that several spatio-temporal models that work at a district level do not scale to sub-district OD forecasting #pg6. That’s a big warning for production systems; scaling the prediction target by two orders of magnitude means your existing infrastructure will likely break if you just try to add more spatial detail without changing how you train the model #pg10.

Tom: So, they are highlighting that we need to look beyond just fitting models on district level and figure out how to handle those finer spatial details consistently across all modes #pg6.

Jane: This paper gives us the framework and the data needed to start developing models that address these requirements for fine spatial resolution and cross-mode information #pg6.

Conclusion: Tom: So, wrapping up on SeoulMMOD, the large-scale multimodal origin-destination flow benchmark from Taeyoung Yu and his team #pg1. This paper provides three years of hourly mobility data across six modes in Seoul which is a massive dataset for testing #pg1.

Jane: It gives us three years of hourly mobility data across six modes in Seoul, which is a massive dataset for testing the limits of current forecasting systems #pg3. The core idea here is to create a reproducible testbed for forecasting citywide, multi-mode demand over multiple years #pg6.

Lu: The authors show that cross-year transfer can be tested by retraining five architectures on all of two thousand twenty-four and evaluating on all of two thousand twenty-five #pg10 <ref:2610.13730#pg2>. All five models have higher mean absolute error in cross-year evaluation, with iTransformer showing the smallest increase #pg10.

Meng: They also found that the seasonal ordering is consistent across architectures, with spring being the hardest and summer the easiest for prediction #pg10. That's a pattern we can use when setting expectations for future model performance.

Tom: The study points to STAEformer as performing best overall in terms of mean absolute error across all three prediction horizons #pg8. It reports the lowest overall MAE at all three horizons #pg8.

Jane: And they found that context signals, like holiday calendars or rainfall, actually help lower the error when added to certain models like STID over a twenty-four hour window #pg9. This is a concrete finding about how external information can help refine the forecast.

Lu: They also noted that training one model per mode outperforms joint training in average MAE for all four architectures #pg10. This suggests that future multi-mode models need mechanisms for mode-specific patterns and cross-mode signal, instead of just expanding the output dimension #pg10.

Meng: And they pointed to a limitation: forecasting OD demand at the sub-district level expands the prediction target by two orders of magnitude, from six hundred twenty-five to one hundred eighty-one thousand four hundred seventy-six OD pairs #pg10. Models that explicitly capture spatial interaction across OD pairs exceed the available memory when tested at this scale #pg10.

Tom: So, it’s a huge leap in complexity for any forecasting system trying to stay efficient and accurate while running in real time #pg3.

Jane: The paper is a reproducible testbed for developing and evaluating models that can actually handle this kind of city-scale problem #pg6. It shows the challenges we have right now with city-wide mobility data #pg6.