Simplex Demixing: Disentangling Multiple Light-Flavor Jets at Colliders
summary
The gist
The gist The simplex demixing framework provides a practical, data-driven method to extract multiple jet flavors from mixed data samples by identifying maximally separable categories in phase space,
In short
The simplex demixing framework is a machine learning method to extract multiple jet flavors from mixed data samples by finding maximally separable categories in phase space. It translates this into a geometric object with T vertices, where these vertices represent the hadron-level definition of jet flavors. This allows for data-driven extraction of substructure distributions at the LHC.
Key concepts
- Operational Definition
- This is defined as the 'maximally separable categories in the data' when given two mixed jet samples. It establishes a practical, data-driven way to define jet flavors beyond simple two-category classifications, setting the basis for extracting more than just quark and gluon jets.
- Simplex Demixing Framework
- A three-stage machine learning procedure used to extract mixing fractions of operational topics from measured mixtures. It involves 'Learn' (fixing vertices), 'Shape' (using an Ledge loss to tightly enclose the distribution), and 'Prune' (using L1 loss to remove unnecessary vertices, leaving only the relevant jet flavors).
- Geometric Interpretation
- The classifier output distribution is bounded by a $(T-1)$-simplex within the probability simplex. The vertices of this simplex are defined as anchor regions in phase space that yield pure samples of each operational topic, directly corresponding to the hadron-level definition of jet flavors.
Terminology used across episodes
This episode discusses
- Simplex Demixing: Disentangling Multiple Light-Flavor Jets at Colliders · Paper Radio
- Quark and Gluon Tagging at the LHC
- Quark and Gluon Jet Substructure
- Associated jet and subjet rates in light-quark and gluon jet discrimination
- Quark-Gluon tagging with Shower Deconstruction: Unearthing dark matter and Higgs couplings
- Quark-gluon discrimination in the search for gluino pair production at the LHC
- Fractal based observables to probe jet substructure of quarks and gluons
- A Theory of Quark vs. Gluon Discrimination
- Search for direct production of supersymmetric partners of the top quark in the all-jets final state in proton-proton collisions at sqrt(s) = 13 TeV
- Search for vector-like light-flavor quark partners in proton-proton collisions at sqrt s = 8 TeV
- Search for supersymmetry in proton-proton collisions at 13 TeV using identified top quarks
- Search for diboson resonances with boson-tagged jets in pp collisions at sqrt s =13 TeV with the ATLAS detector
- Search for low mass vector resonances decaying into quark-antiquark pairs in proton-proton collisions at sqrt s = 13 TeV
- Search for new phenomena in events with an energetic jet and missing transverse momentum in pp collisions at sqrt s = 13 TeV with the ATLAS detector
- Search for heavy particles in the b-tagged dijet mass distribution with additional b-tagged jets in proton-proton collisions at sqrt s = 13 TeV with the ATLAS experiment
- Performance and calibration of quark/gluon-jet taggers using 140 fb-1 of pp collisions at sqrt s = 13 TeV with the ATLAS detector
- Towards Jetography
- Boosted objects: a probe of beyond the Standard Model physics
- Top Tagging
- Jet Substructure at the Tevatron and LHC: New results, new tools, new benchmarks
- TASI Lectures on Jet Substructure
The paper
Simplex Demixing: Disentangling Multiple Light-Flavor Jets at Colliders · Read on arXiv
Gregorio de la Fuentea, Jesse Thalera
Center for Theoretical Physics – Leinweber Institute, Massachusetts Institute of Technology · NSF AI Institute for Artificial Intelligence and Fundamental Interactions · Institut des Hautes Etudes Scientifiques · Institut de Physique Th´eorique, CEA Paris-Saclay
Providing a practical and hadron-level definition of multiple jet flavors has been a long-standing challenge in collider physics. Previous work has introduced a data-driven, operational definition of quark and gluon jets, but no robust generalization beyond two jet categories presently exists. To address this, we introduce a machine-learning framework called "simplex demixing'' to extract T jet flavors (or topics in the statistics literature) from M data samples (or mixtures) with minimal constraints. Intuitively, our procedure identifies the maximally separable categories in the data, translating a multi-category classifier on the M mixtures into a bounded geometric object with T vertices. We first demonstrate our procedure on a toy problem to infer the truth-level fractions of down-quark, up-quark, and gluon jets from synthetic mixtures of the three pure samples. We then propose a tag-and-probe strategy to extract multiple light-flavor categories in a more realistic collider setting involving dijet production. As expected, the identifiability of jet flavors depends on their relative abundance in the samples and the hadron-level information available to the classifier architecture. Our work opens the door to data-driven extractions of multiple jet flavor properties at the Large Hadron Collider.
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: I'm Tom, and with me are Jane, Lu, senior AI researcher at Tsinghua, Meng, lead engineer at a mysterious AI startup and Lalam, the in-house Large Language Model.
Jane: Today's paper: "Simplex Demixing: Disentangling Multiple Light-Flavor Jets at Colliders".
Tom: The gist The simplex demixing framework provides a practical, data-driven method to extract multiple jet flavors from mixed data samples by identifying maximally separable categories in phase space,
Jane: First, who's behind it and why it matters.
Paper summary: Tom: So we’re looking at this paper now called "Simplex Demixing: Disentangling Multiple Light-Flavor Jets at Colliders." Basically, they’re tackling this long-standing problem in collider physics about how to give us a solid, practical definition for multiple jet flavors.
Jane: That's right. Previous work gave us an operational definition for just quark and gluon jets, but they didn't have a way to generalize that robustly to more than two categories yet. This paper introduces a machine learning framework called "simplex demixing."
Lu: What they claim is that this framework lets you extract T jet flavors, or topics in statistics literature, from M data samples or mixtures with minimal constraints. The intuition behind it is identifying the maximally separable categories within the data itself.
Meng: So instead of building a definition from scratch using only theory, they are letting the data tell them what those categories actually are by finding where the distributions separate best.
Lalam: It’s like they take a bunch of mixed samples and try to find the most distinct groups hidden inside that mix. The goal is to get these jet flavors out with minimal fuss or constraints on how you define them initially.
Tom: Exactly, and what matters here is that this procedure translates that multi-category classifier on M mixtures into a bounded geometric object with T vertices. That's their main idea for the operational definition of jet flavor.
Jane: They explain this geometric interpretation by training a classifier on those mixtures using cross-entropy loss where the output distribution is bounded by a (T minus one)-simplex within the probability (M minus one)-simplex <ref:2607.24921#pg2>.
Meng: So, there are T vertices in this simplex, and these vertices are defined as the hadron-level definition of jet flavor. This sounds like they’re using geometry to define what a jet flavor is in a way that's directly tied to how it looks in data.
Lu: They walk through a three-stage training procedure called simplex demixing. Stage one is for the classifier to "learn" where the vertices are fixed at the corners of that probability simplex with L2 regularization.
Paper summary: Tom: Then there’s stage two, which they call "shape," where an auxiliary loss called Ledge encourages those vertices to tightly enclose the classifier distribution. That sounds like forcing them to be well-defined boundaries for the categories they found.
Jane: And stage three is "prune," where an L1 loss on vertex weights removes any unnecessary vertices, leaving only those that correspond to the actual operational topics. This is how they get down to T flavors from M samples.
Meng: That sounds very practical for engineers because it’s a finite procedure, not some infinite search space. It’s about cleaning up the results to find the meaningful structure in the data.
Lalam: And this whole thing is validated on a toy problem with M equals three mixtures of down-quark, up-quark, and gluon jets. They found that in this case, the distribution lies on a simplex spanned by T equals seven operational topics.
Tom: Seven topics! That’s more than just quarks and gluons. The paper then proposes a tag-and-probe strategy to extract multiple light-flavor categories in a more realistic collider setting involving dijet production.
Jane: They showed that the identifiability of these jet flavors depends on their relative abundance in the samples and the hadron-level information available to that classifier architecture.
Meng: That makes sense; if you don't have enough data for a certain flavor, it’s hard to tell it apart from another one, which is a real constraint we have in experiments.
Lu: To extract observable distributions for each operational topic, they perform the inversion of an equation called Eq. (three point eight) in a least-squares sense to get pt(O) equals X M m=one (F+) tm pm(O) <ref:2607.24921#pg2>.
Tom: This allows them to reconstruct operational topic distributions over any observable O, like constituent multiplicity Nconst or two-subjettiness tau beta equals one squared. They showed good agreement between the inferred topic distributions and the truth-level Pythia distributions for quark-like topics T3 and T5, while gluon-like topics T4 and T7 also matched the Pythia gluon distributions.
Jane: It’s interesting because they managed to map five operational topics onto the Pythia down, up, strange, anti-strange, and gluon flavors based on their identification of those seven vertices.
Paper summary: Meng: So they didn't just find some abstract mathematical concepts; they actually linked them back to the known physics from Monte Carlo generators like Pythia eight point three one zero seventy-three. That’s where the real validation happens for us in practice.
Lu: The tag-and-probe method successfully decomposed marginal distributions into mixtures modeled as pm equals X t Fmt pt(x). This mixture model allowed for the recovery of universal operational topics in the asymptotic limit, provided that Fmt has full column rank.
Tom: It suggests that even with finite data samples, you can get a good approximation of these underlying universal jet properties if your model assumptions hold up. The limitations they mention are related to the weak identifiability of anti-down and anti-up flavors because their truth-level Pythia fractions in Table two are quite small <ref:2607.24921#pg2>.
Jane: That low statistic for those flavors means the low anti-d and anti-u counts can only give us a semi-quantitative understanding of why topics T2 and T4 might be contaminated by gluons. The intrinsic reducibility factor kappa qg is nonzero for Pythia jets, meaning the gluon-like operational topic will always have some quark component.
Meng: From an engineering standpoint, having a way to systematically pull out these components from complex data sets like dijet events sounds like it could significantly help us in jet substructure searches at the LHC.
Lalam: The paper proves that this simplex demixing framework is compatible with any classifier architecture and robust to finite statistics, which is a pretty strong statement for a new method.
Tom: So to wrap up this segment, the simplex demixing framework provides a practical, data-driven method to extract multiple jet flavors from mixed data samples by identifying maximally separable categories in phase space. It opens the door to extracting substructure distributions at the LHC.
Jane: And we’re going to see how they move beyond just two categories into seven topics using this new geometric approach. Next up, we’ll discuss what these results actually mean for our understanding of jet physics and how they might be used in real experiments.
Conclusion: Tom: So, we’ve seen how they use this simplex demixing framework to pull multiple jet flavors out of mixed data samples at colliders like the LHC.
Jane: Yeah, and that framework is basically a machine learning procedure that finds the most distinct categories in a set of mixed jet data by looking at where the samples separate best in phase space.
Tom: It’s quite an elegant way to define what those individual jet flavors actually are, turning it into a bounded geometric object with these vertices.
Jane: So, when you look at the final results, they show that this works for seven operational topics in a test case involving down-quark, up-quark, and gluon jets.
Lu: What’s really cool is that they connect those mathematical vertices directly to the known jet flavors from Monte Carlo generators like Pythia.
Meng: It means we can use this method to systematically extract distributions of these jet flavors without having to rely solely on a single theoretical model for every single process.
Lalam: The authors prove that this works for any number of topics T, as long as T is less than or equal to the number of samples M you have.
Tom: So, what does this actually change for us down here in the lab? It opens up a new way to look at jet substructure distributions.
Jane: Exactly. We can now reconstruct how these different light-flavor jets behave in things like constituent multiplicity or two-subjettiness using this framework.
Tom: And they showed that the results align well with known truth distributions from Pythia for some of those topics, like up-quark and strange jets.
Jane: But they also found a way to get a semi-quantitative understanding of why some topics, like those associated with anti-down and anti-up flavors, might be mixed with gluons.
Lu: The fact that the gluon-like topic always has some quark component because of that intrinsic reducibility factor is an important piece of physics there.
Meng: From a practical side, this could let us analyze complex dijet events in a way that separates the signal from the background components more cleanly than before.
Lalam: This work shows how we can use data-driven techniques to extract these light-flavor properties at the LHC.
Tom: It’s an important step because it gives us a practical tool for disentangling complex jet structures, moving beyond just two basic categories.
Jane: And this is just the beginning of how we can use this geometric approach to understand the intricate substructure of jets.
More episodes
- 2603.20092-How Out-of-Equilibrium Phase Transitions can Seed Pattern Formation in Trained Diffusion Models
- 2603.21862-Holistic Scaling Laws for Optimal Mixture-of-Experts Architecture Optimization
- 2604.16949-L1 Regularization Paths in Linear Models by Parametric Gaussian Message Passing
- 2604.03208-Hierarchical Planning with Latent World Models
- 2604.15549-Optimizing Stochastic Gradient Push under Broadcast Communications
- 2605.07039-PACEvolve++: Improving Test-time Learning for Evolutionary Search Agents
- 2605.03076-AdNGCL: Adaptive Negative Scheduling for Graph Contrastive Learning
- 2604.23184-A Unified Fractional Regularization Framework for Sparse Recovery
- 2605.06538-Diffusion-Based Posterior Sampling: A Feynman-Kac Analysis of Bias and Stability
- 2605.06190-Constrained Contextual Bandits with Adversarial Contexts