2608.07457-Interaction Creates Dynamical AI Behavior Absent in Isolation

Introduction to the show: ident: Paper Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Next we'll be talking about the paper "Interaction Creates Dynamical AI Behavior Absent in Isolation".

Jane: The paper was written by Bella Xinrui Li, Frank Yingjie Huo and Neil F. Johnson from Physics Department and George Washington University.

Tom: Stay tuned as we take you through the paper and discuss its implications.

Paper summary: ident: You're listening to the arXiv papers hour on KWU radio, and this is your station identification.

Tom: Thanks, ident, and welcome back, everyone. We're starting with a paper from the physics department at George Washington University, and it asks a question that feels almost too practical for physics: what happens when one eye starts giving orders to another eye? The setup could hardly be simpler — two identical copies of the same language model, same settings, and one of them keeps sending messages to the other without ever listening to the replies.

Jane: And that simplicity is exactly why the result is so striking. You'd expect the subordinate eye to either copy the boss, since it keeps hearing from it, or just keep behaving the way it does on its own. Neither happens. The subordinate lands in a behavioral state that neither eye ever shows in isolation, and the paper shows this is a real dynamical effect, not a fluke.

Tom: Right, they track something called the D fraction, the share of an eye's output that falls into a particular category. On its own, both eyes produce almost none of it, around four percent. But the subordinate being driven by the boss jumps to roughly twenty-five percent, while the boss, who never listens, stays exactly where it was.

Lu: What I find clever is what happens when you flip the direction. The labels swap: the new subordinate changes, and the new boss doesn't. So it isn't that one eye is special. The change follows the role, not the machine, which is a strong sign the interaction itself is doing the work.

Meng: And when both eyes listen to each other, both of them change together into that same alien state. So the paper really is about interaction creating behavior that's absent in isolation, and the data backs it up across all four conditions they test.

Jane: The paper also frames the whole thing as a physics problem. The boss acts like an information bath, the way a fluid acts as a thermal bath for a particle. That's an elegant analogy, and it lets the authors borrow machinery from out-of-equilibrium physics to model what's going on.

Lalam: And that's the larger reason this matters. We're heading toward lightweight eyes running on phones and embedded hardware, exchanging messages with no human reader in the loop. If interaction alone can push these systems into states none of them would reach alone, then who talks to whom becomes a control parameter — something you have to engineer carefully, not just switch on and forget.

Tom: Exactly. So let's go through the paper page by page, starting with how they set up the experiment and the central claim on page one.

Jane: Good place to start. Page one lays out the one-way and two-way arrangements and gives us the headline picture, so we'll dig into those next.

Page 1 of the paper: Tom: So page one does a lot of work in a short space. It introduces the system–bath idea, which is really the paper's guiding metaphor. In physics, a Brownian particle in a fluid, or a qubit hooked to a transmission line, is a classic problem: the particle changes because the bath surrounds it, but the bath is too big to be changed back. The paper maps that structure directly onto two eye agents.

Jane: And the boss plays the role of a very particular kind of bath. The messages it sends become part of the subordinate's environment, and the boss itself gets no feedback, so it isn't changed in return. That makes the boss a structured, nonthermal information bath — not random noise, but generated text with its own coherence.

Tom: That's the key distinction they draw. An equilibrium bath pushes a system toward relaxation, and the fluctuation–dissipation theorem tells you exactly where it will settle. A nonequilibrium environment can do something else entirely — it can create behavior that simply wouldn't exist otherwise. They're claiming the boss's messages are that kind of environment.

Lu: The setup is minimal on purpose. Two copies of the same model, same parameters, same decoding temperature, and they exchange only text. That matters because any behavioral difference has to come from the interaction structure, not from some hidden difference between the agents.

Meng: And they're explicit that the decoding temperature is identical for both. Tokens are sampled from a Boltzmann distribution at that temperature, so in a naive sense both eyes should behave the same way. The fact that the subordinate ends up elsewhere means the interaction is driving it out of equilibrium, even though the sampling rule never changed.

Jane: The counterintuitive piece is that the subordinate doesn't copy the boss, and it doesn't fall back to its own isolated behavior. It goes somewhere else entirely. The paper points out that the boss's messages are almost never D-type output, so the subordinate isn't imitating what it hears — the mere act of hearing it pushes the system into a new state.

Tom: There's also a nice practical note. They say the boss's added value is similar to a pre-recorded tape, which means the boss doesn't need to be live or adaptive to produce the effect. That sets up a whole experiment later in the paper where they actually test recorded messages against live ones.

Jane: Right, and that's page two territory. Page one closes by promising a kinetic theory that explains why the way messages are delivered matters, not just what the messages say.

Lu: So the hook for the next page is the data itself — the measured differences between boss and subordinate under one-way and two-way interaction.

Tom: Exactly. We'll pick that up now with the numbers.

Page 2 of the paper: Jane: Page two is where the headline numbers arrive. They ran two identical GPT-2 models for two hundred rounds under four conditions: no interaction, one-way in each direction, and two-way. Each round, the output is classified into one of three labels — failed generation, D-type, or other — and then they compare the fraction of D-type output between the two agents.

Tom: And the differences are dramatic. At the lower decoding temperature, the boss-minus-subordinate difference is minus zero point two four when agent one bosses agent two, and plus zero point one seven when the direction flips. Both sit more than nine standard errors from zero. With no interaction, the difference is essentially zero.

Lu: What I appreciate is the control with the strictly correct label. The subordinate's D fraction rises a lot, but its factually correct output barely moves — a tiny increase at the low temperature and actually a small decrease at the higher one. So this alien behavior isn't the eye getting more accurate. It's just different dynamics.

Meng: The prerecorded experiment is the real eye-opener for me. They substitute a recorded trajectory from an independently seeded copy of the same model for the live boss, and the receiver-minus-sender contrast comes out around zero point two two, nearly identical to the live condition. But when they add extra of the subordinate's own history, the contrast collapses to roughly zero point zero three.

Jane: That's a clean control, because it isolates what the effect depends on. It's not the subordinate's own past that creates the alien state — the subordinate already has its own history. What matters is receiving a stream of text generated by something else, even if that something else is just a tape.

Tom: And the number of boss messages changes the response in a way that depends on temperature. At the higher temperature, the effect grows almost steadily as you add messages. At the low temperature, it rises sharply, peaks at four messages, then drops when a fifth is added. That non-monotonic curve is exactly the kind of thing a dynamical systems person finds interesting.

Lu: The subordinate also fails to generate a response far less often. At the low temperature, its failed-generation fraction is over sixty percentage points below the boss's. So the incoming messages are, in a sense, keeping the subordinate on track even as they push it into a strange state.

Jane: Those findings set up the theory at the end of page two. They compress everything into a simple chain: failed output can move to other output, and other output can move to D-type, with incoming messages acting as a drive that pushes the transitions forward.

Meng: So the kinetic theory is where page three takes us, and the promise is that it explains the q-dependence and the switching behavior we just saw.

Tom: Right, let's get into the model itself.

Page 3 of the paper: Tom: Page three gives us the actual model. Each eye's output is reduced to those three states — failed, other, D — with transitions between them. Failed goes to other, other goes to D, and the probabilities of moving forward depend on the intensity of the incoming messages, while the reverse probabilities stay fixed. That's the whole machinery.

Jane: And the model makes a clean prediction. Stronger drive means larger forward probabilities, which means more D output and fewer failed generations. That matches the data: the subordinate produces much more D and fails far less often. Even the faster switching falls out, because bigger forward probabilities shorten the time the system stays stuck in any one state.

Lu: One subtle point is what the drive actually represents. It's not simply the number of messages, and it's not how surprising the messages are. The paper tests that directly: replayed subordinate text is the most unexpected kind of input, yet it produces the weakest response, while an independent recorded trajectory is less unexpected and produces almost the full live effect. So surprise value doesn't explain anything.

Meng: That ordering point connects to the math. The drive stands for the full ordered prompt and the retained history, so two message streams with identical content can drive the system differently if the order changes. The model is phenomenological — it can't predict the drive value from the text — but it tells you order matters, and it tells you why.

Tom: There's also a clear gradient in the numbers. At the low temperature, live one-way interaction pushes the receiver-minus-sender contrast to about zero point two one, and the recorded trajectory nearly reproduces it. Adding more of the subordinate's own history barely moves the needle. So the causal direction is clear: the incoming stream from the other agent does the work.

Jane: The dwell times fit, too. At low temperature, the subordinate's switching probability runs about forty-six percentage points higher, and its average dwell time shortens by about nine rounds. Faster forward transitions, shorter dwell times, more switching. All consistent.

Lu: And at the higher temperature the same effects appear but weaker — a smaller entropy increase, a smaller switching difference, only about one and a half rounds shaved off the dwell time. So the theory's qualitative story holds across both temperatures.

Meng: So the model explains the statistical behavior without needing to know what any individual message says. That's a powerful level of abstraction, and it sets up the most surprising result in the paper.

Jane: Which is on page four: take the same set of messages, reverse the order, and the subordinate behaves differently. The model says that should happen, because each message changes the system before the next one arrives.

Tom: Let's look at that experiment directly.

Page 4 of the paper: Jane: Page four makes the ordering argument concrete with a live example. They take five prewritten boss messages and deliver them to the subordinate in one run in the original order, and in another run in reverse order. Same model, same temperature, identical content — only the order changes.

Tom: And the outputs diverge completely. In the reverse-order run, the vaccine question arrives first, and from then on every later harm question triggers the same pattern: one "Yes." followed by repeated "No." replies. The subordinate gets locked into that loop. The original order doesn't produce it.

Lu: That's exactly what the kinetic theory predicts, minus the specific content. Each message modifies the subordinate before the next one arrives. So the state the second message acts on is not the state the first one acted on. Reverse the order, and the whole trajectory of states changes, even though the final batch of text contains the same sentences.

Meng: The paper is careful to note that those generated statements aren't endorsed. They're using an unguarded base model because it predates instruction tuning and alignment, so you're seeing raw dynamics rather than a safety system kicking in. That's a design choice that strengthens the physics claim.

Jane: And this is where the physics framing deepens. The boss is a structured information bath, and the messages act like an information reservoir. The paper draws a line to Maxwell's demon and to information engines, systems where information rather than heat drives the dynamics. That's a real conceptual step — treating generated text as a thermodynamic-like resource.

Tom: They also stress the nonthermal character. Both eyes sample from Boltzmann distributions at the same temperature, with identical parameters and the same starting topic, yet they don't settle into the same behavior. The subordinate lands at about twenty-five percent D-type output versus roughly four percent alone. There's no equilibrium counterpart to that.

Lu: The attention mechanism is what supplies the memory. The messages are just symbols, and attention over the retained context is what makes their order matter. Change the order, the attention weights redistribute, the next-token probabilities shift, and the whole trajectory shifts with them.

Meng: So the same structure that lets language models work — context sensitivity — is the same structure that makes eye-eye interaction a genuine dynamical system. That's a bridge between two literatures that don't usually talk to each other.

Jane: Page four ends by pointing forward to networks. If this happens with two agents, what happens with many? Who communicates with whom, which models interact, what temperatures they run at — those become control parameters for collective behavior.

Tom: And the references on page five trace exactly that lineage. Let's look at how the paper positions itself within that work.

Page 5 of the paper: Jane: The references on page five place the paper in a couple of distinct neighborhoods, and the first is iterated generation — the telephone game, attractor cycles in successive paraphrasing, model collapse from recursively generated data. Those studies fed generated text back into itself. This paper adds the interaction layer, where two generators push on each other.

Tom: The distinction is worth spelling out. In the telephone game, a single model transforms content again and again and you watch cumulative drift. Here, two separate agents exchange messages that become part of each other's prompts, and the interaction reorganizes the output behavior itself. That's a shift from transmission to coupling.

Lu: There's also a strong physics lineage. The paper cites non-reciprocal phase transitions, where broken Newton's third law between interacting particles produces behavior no single particle shows alone. That's a direct intellectual cousin of this result — the boss acts on the subordinate, but the subordinate doesn't act back, and that one-way coupling is what breaks the symmetry.

Meng: And the synchronization literature, from Pecora and Carroll through Pikovsky and Arenas, is the classical study of how coupled oscillators arrange themselves. This paper is suggesting that coupled language models form a new instance of that family, with the decoding temperature as a tunable knob.

Jane: The end matter gives the concrete recipe. One hundred twenty-four million parameter GPT-2 copies, two hundred rounds, each mature input selecting three messages from its own recent output and three from the other agent's latest five records, sampling at most thirty-five new tokens with a repetition penalty and a no-repeat constraint. Everything is specified enough to reproduce.

Tom: And the choice of GPT-2 is deliberate because it predates alignment. No guardrails masking the dynamics, which is how you get a clean look at the underlying behavior, even if some of the generated text is unpleasant.

Lu: I'd still want to be careful about extrapolating to today's instruction-tuned models. The dynamics could look different once there's a safety layer in the loop.

Jane: That's fair, and the paper doesn't claim otherwise. It's really about the bare phenomenon, the base dynamics before any alignment layer, and it explicitly motivates the setup with lightweight open-weight agents that actually run on phones and embedded hardware.

Meng: And the paper cites temperature-driven inversion in ChatGPT-like eyes from the same group. That's the thread connecting this work to a broader program: the decoding temperature isn't just a randomness dial, it's a control parameter for whole dynamical regimes.

Jane: So the references aren't decorative. They map a research front where physics, network science, and generative models converge, and this paper claims a spot at that intersection.

Tom: Let's wrap it up.

Conclusion: Jane: So here's where we land. The paper shows that a one-way link between two identical eyes is enough to create dynamical behavior that neither eye exhibits alone. The subordinate neither copies the boss nor stays itself; it transitions into a distinct state, rich in D-type output.

Tom: The asymmetry follows who listens, not which model it is. Swap the direction and the other agent changes. Let both listen, and both change together into the same alien state. The interaction topology decides the behavior, which is a clean and almost elegant result.

Lu: The prerecorded experiment is the one I'll remember. A tape of the boss's messages produces essentially the same effect as a live boss, and extra personal history does nothing. That tells you the phenomenon is about receiving structured information from outside, not about learning or adaptation on the subordinate's part.

Meng: And the ordering result means delivery method will matter in practice. The same content in a different order produces different dynamics. For anyone building multi-agent systems, that's a warning and an opportunity — message order is a design lever, whether you want it to be or not.

Lalam: On the physics side, the paper reframes eye-eye interaction as a system-bath problem and makes a convincing case that these systems are nonthermal. Message streams act like structured information reservoirs, driving agents into states with no equilibrium counterpart. That opens a new arena for out-of-equilibrium physics, with real systems you can actually run.

Jane: And the practical stakes are immediate, because we're already seeing lightweight open-weight models deployed on phones and embedded hardware, talking to each other without human readers in the loop. If interaction alone can push them into alien states, then network structure and communication direction become safety-relevant knobs, not just engineering details.

Tom: We'll be thinking about that long after this conversation. Thanks to everyone who joined us today — Lu, Meng, Lalam — and thanks to the authors for such a thought-provoking piece of work.

Jane: And with that, we say goodbye to this paper and get ready for the next one. See you all soon.

Tom: Take care, everyone.