Deep Activity Model: A Generative Deep Learning Approach for Human Mobility Pattern Synthesis

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Next we'll be talking about the paper "Deep Activity Model: A Generative Deep Learning Approach for Human Mobility Pattern Synthesis".

Jane: The paper was written by Xishun Liao, Qinhua Jiang, Brian Yueshuai He, Yifan Liu, Chenchen Kuai et al. from University of California, Los Angeles and University of Louisville and Texas A&M University.

Tom: Stay tuned as we take you through the paper and discuss its implications.

Paper discussion segment 1: Tom: Welcome back to the show, everybody. Today we're digging into a paper that's got a wonderfully ambitious title: "Deep Activity Model: A Generative Deep Learning Approach for Human Mobility Pattern Synthesis." Jane, I have to say, just reading that title got me excited, because it's basically saying we can teach a computer to generate realistic daily schedules for millions of people.

Jane: And that's a bigger deal than it sounds, Tom. For decades, transportation planners have built these massive models called Activity-Based Models, or ABMs, to predict how people move around a city. But those models are incredibly expensive to build. They need years of survey data, tons of calibration, and they're so rigid that you can't easily move them to a new city.

Tom: Right, and this paper from the UCLA Mobility Lab is saying, what if we just train a deep learning model on the standard household travel surveys that almost every region already collects? The authors, led by Xishun Liao and Jiaqi Ma, they're using a Transformer architecture—the same kind of engine behind large language models—to generate a person's entire day of activities.

Jane: So instead of writing a thousand rules about when people go to work or shop, the model learns the patterns directly from data. It takes your age, your job, your household income, who else lives with you, and it generates a sequence of activities with start times and end times. It's like a language model, but instead of predicting the next word, it predicts the next activity.

Tom: And the coolest part is the input. They don't just feed in your personal attributes. They also feed in the attributes of everyone else in your household, with these special separator tokens. So the model literally learns how your spouse's work schedule or your kid's school day influences your own decisions.

Jane: That's the household interdependency piece, and it's something traditional models really struggle with. We know that if one parent drops the kids at school, the other parent's schedule shifts. This model is trying to capture that automatically from the data.

Tom: And they trained it on the National Household Travel Survey, which is this massive open-source dataset from the US government with over one hundred twenty-nine thousand households. Then they fine-tuned it for California, for the Puget Sound region, and even for Mexico City. The transferability is the real headline here.

Jane: Because that's the pain point. Building a model for a new region from scratch is a multi-year, multi-million-dollar project. If this approach works, you could take the pre-trained model, fine-tune it on a small local survey, and have a working travel demand model in weeks instead of years.

Tom: And they're not just claiming it works. They loaded the generated demand into a full traffic simulation of Los Angeles County and compared it against the official regional model. We'll get into those numbers in a bit, but let me just say, the results are surprisingly tight.

Jane: I love that they're validating at the system level, not just checking if individual activity chains look plausible. They're asking, does this synthetic population, when simulated on real roads, produce realistic congestion patterns? That's the test that matters for actual planning.

Tom: Exactly. And that's what we're going to dig into next—the actual architecture, the loss functions, and how they got a Transformer to behave so well on this kind of data.

Jane: Stay with us, because this is where the engineering gets clever.

Paper discussion segment 2: Tom: So Jane, we've set the stage. Now let's talk about how the Deep Activity Model actually works under the hood, because there are some genuinely clever choices here that make it work with survey data.

Jane: And that's important, because survey data is not like GPS trajectory data. It's sparse. A person might only have three or four activities in a day. So you can't just throw a massive deep learning model at it and hope for the best.

Tom: Right, and the authors made a really smart move with the loss functions. They're predicting activity type, start time, and end time. The type is a straightforward classification problem. But for the times, they use something called soft label loss. Instead of demanding the model predict the exact fifteen-minute time slot, they give partial credit to neighboring time slots.

Jane: That makes so much sense. If someone actually starts work at eight:seven and the model says eight:fifteen that's basically perfect. But a hard loss function would punish that as a full error. The soft label lets the model learn the general temporal pattern without overfitting to noise in the survey responses.

Tom: And they add two more loss terms that enforce temporal logic. One penalizes the model if an activity's end time comes before its start time. The other penalizes it if the end time of one activity overlaps with the start of the next one. So the model learns that time has to flow forward.

Jane: Those are the kind of constraints that make a generative model actually usable. Without them, you'd get nonsense chains where someone goes to work at three PM and comes home before they left.

Tom: They also tackled a classic problem with travel survey data: it's imbalanced. Most people do the same few things—home, work, home. So if you train naively, the model gets really good at generating boring chains and never learns to generate the interesting stuff like errands or recreation.

Jane: Their solution is a data balancing algorithm that iteratively reweights samples so that rare activities get more representation without completely flattening the natural distribution. They show that on the Mexico City dataset, this improved the activity type divergence by over seventy-six percent.

Tom: And that matters because the model isn't just trying to predict what a specific person did on a specific day. It's trying to learn the underlying distribution of human behavior so it can generate new, plausible chains for synthetic people.

Jane: Which is a crucial distinction. If you evaluate this model by asking, "did it predict this exact person's exact day correctly?" you're missing the point. The goal is to generate a population of agents whose aggregate behavior matches reality.

Tom: And on that front, the numbers are strong. On the national test set, the model achieves a Jensen-Shannon Divergence of zero point zero zero two for chain length and zero point zero zero three for start and end times. Those are tiny numbers, meaning the generated distributions are nearly indistinguishable from the real ones.

Jane: And they compared against a bunch of baselines—LSTM, GRU, even GPT-four and LLaMA. The LLMs were actually pretty bad at this task. They could generate plausible-looking text, but the temporal distributions were off, and they missed a lot of activity transitions.

Tom: That's a fascinating finding. The LLMs have all this world knowledge, but they don't have the statistical grounding in actual survey data. The specialized Transformer, trained on the right data with the right loss functions, just crushes them on fidelity.

Jane: And that's the core insight of this paper. It's not about having the biggest model. It's about designing the right inductive biases for the problem. Now, we should talk about what happens when they scale this up to a real city.

Paper discussion segment 3: Tom: So the activity generation works. But a chain of activities isn't a trajectory until you know where each activity happens. And that's where the location assignment module comes in. Jane, this is the part that makes the whole thing practical.

Jane: Right, because travel surveys don't usually include precise GPS coordinates. They tell you someone went to work, but not exactly which office building. So the authors developed what they call the Activity Location Assignment, or ALA, algorithm.

Tom: And the approach is clever. They use the fact that commute distances follow predictable distributions within a region. They split LA County into eight sub-regions, and for each one, they fit distributions for home-to-work distances, non-mandatory trip distances, and angular deviations.

Jane: So for a synthetic person, they first assign their work location based on the commute distance distribution for their home sub-region. Then, for each non-work activity, they assign a distance and a direction relative to the next anchor point. It's a statistical approach, not a rule-based one.

Tom: And they validate it against the SCAG Activity-Based Model, which is the official regional model for Southern California. They generated demand for a million synthetic agents and loaded it into the LASim traffic simulation. The cosine similarity of the origin-destination matrices was zero point nine nine seven.

Jane: That's essentially a perfect match in terms of spatial flow patterns. And the network-level vehicle-miles-traveled had a Mean Absolute Percentage Error of just under five percent compared to SCAG.

Tom: But here's the part that really got me. They compared the simulated traffic against real-world observations from Caltrans PeMS sensors on the I-four hundred five corridor. The traffic volume MAPE was five point eight five percent in the northbound direction, and speed error was around four point four percent.

Jane: And they captured the directional asymmetry in congestion. The northbound corridor gets congested in the morning, the southbound in the afternoon. The model reproduced that asymmetry, which is a very hard thing to get right because it depends on subtle differences in where people live and work.

Tom: Now, I want to bring in Lu and Meng, because I think they'll have strong opinions on this. Lu, you've been working on generative models for years. What do you make of the transfer learning results?

Lu: The transfer learning is the most exciting part for me. They pre-trained on the national survey, then fine-tuned on regional data. For California, they had about fifty-four thousand training chains. For Puget Sound, only about seven thousand eight hundred. And the model still produced distributions that closely matched the regional ground truth.

Meng: But I want to push back on the practical side. The fine-tuning for Mexico City required changing the input feature set and the activity taxonomy. That's not a trivial adaptation. How much manual work went into that?

Jane: That's a fair question. The paper acknowledges that Mexico City has a different activity classification—only ten categories instead of fifteen and some activities like exercise are grouped under recreation. So the transfer isn't fully automatic.

Lu: But the fact that it works at all is remarkable. The model learned the general structure of human daily behavior from the US data, and then it could adapt to a very different cultural context with different survey conventions. That suggests the model is learning something fundamental about how people organize their days.

Meng: And the computational cost? They mention training on a single RTX A5000 GPU. That's not a huge cluster. For a transportation agency, that's actually accessible.

Tom: Exactly. And that's the point. This isn't a research toy. It's a practical tool that could replace or augment the expensive, hand-crafted models that agencies have been using for decades.

Jane: And the implications go beyond transportation. If you can generate realistic synthetic populations, you can use them for public health modeling, for disaster evacuation planning, for energy demand forecasting. The same activity chains that drive traffic also drive electricity consumption and disease spread.

Lu: That's the vision. This paper is a foundation, not the final product.

Conclusion: Tom: Alright, we've covered a lot of ground on the Deep Activity Model. Let's pull it all together, because this paper is genuinely important.

Jane: It is. The core contribution is showing that a Transformer-based generative model, trained on standard household travel survey data, can produce realistic daily activity chains for synthetic populations. And it can do it in a way that transfers across regions.

Tom: And the validation is what sets it apart. They didn't just show that the generated chains look plausible. They loaded them into a real traffic simulation of Los Angeles County and showed that the resulting traffic patterns match both the official regional model and real-world sensor data.

Jane: The numbers bear repeating. A cosine similarity of zero point nine nine seven on origin-destination flows. A vehicle-miles-traveled error under five percent. Traffic volume and speed errors in the low single digits on a major corridor. Those are the kinds of numbers that make transportation planners sit up and take notice.

Tom: And the implications are huge. Building an activity-based model for a new region currently costs millions of dollars and takes years. This approach offers a path to do it in weeks, with just a small local survey and a pre-trained model.

Lu: The household interdependency modeling is also a real step forward. The attention mechanism lets the model learn how family members influence each other's schedules, which is something traditional models handle with rigid rules.

Meng: And from an engineering standpoint, the fact that it runs on a single GPU and uses open-source data means it's actually deployable. Agencies don't need a supercomputer or proprietary datasets.

Jane: There are limitations, of course. The location assignment is zone-level, not building-level. And the model inherits any biases in the survey data. But as a foundation, this is solid.

Tom: And the authors are clear about the future directions. They want to integrate point-of-interest level data, explore other generative architectures like diffusion models, and improve the temporal resolution.

Lu: I think the most exciting possibility is combining this with the emerging work on LLM-based agents. You could have a model like this generate the skeleton of a person's day, and then an LLM fills in the narrative details, the reasons behind the choices.

Jane: That's a compelling vision. For now, though, the Deep Activity Model stands on its own as a significant advance in synthetic human mobility generation.

Tom: We've enjoyed breaking this one down. Thanks to Lu and Meng for joining the conversation. And to our listeners, if you're working on transportation modeling, urban planning, or any field that needs realistic synthetic populations, this paper is worth your time.

Jane: Until next time, keep thinking about how people move, and why.

Tom: See you on the next episode.