Multimodal AI predicts clinical outcomes of drug combinations from preclinical data

arXiv:2503.02781 · q-bio.QM, cs.AI, cs.LG · Submitted 2025-03-04 · Read on arXiv

q-bio.QM, cs.AI, cs.LG

Submitted: 2025-03-04

Updated: 2026-09-24

Code: https://github.com/mims-harvard/Madrigal

Project page: https://zitniklab.hms.harvard.edu/projects/Madrigal

Terminology

• Alignment — 26× in this paper · explained in 1 episode
• Transformer — 24× in this paper · explained in 2 episodes
• Embeddings — 20× in this paper · explained in 2 episodes
• AUROC — 19× in this paper · explained in 2 episodes
• Knowledge Graph — 12× in this paper · explained in 7 episodes
• Ablation — 11× in this paper · explained in 1 episode
• Benchmark — 8× in this paper · explained in 2 episodes
• Benchmarking — 8× in this paper · explained in 4 episodes
• Representation Learning — 5× in this paper · explained in 2 episodes
• Accuracy — 4× in this paper · explained in 1 episode
• Computational Biology — 4× in this paper · explained in 2 episodes
• Multimodal Learning — 4× in this paper · explained in 2 episodes
• Contrastive Learning — 3× in this paper · explained in 5 episodes
• Drug-Induced Liver Injury — 3× in this paper
• Generalization — 3× in this paper · explained in 13 episodes
• Heterogeneous Graph — 3× in this paper · explained in 2 episodes
• AUC — 2× in this paper · explained in 2 episodes
• AdamW Optimizer — 2× in this paper · explained in 1 episode
• Foundation Model — 2× in this paper · explained in 3 episodes
• Latent Representation — 2× in this paper · explained in 2 episodes
• Latent Space — 2× in this paper · explained in 7 episodes
• Personalization — 2× in this paper · explained in 2 episodes
• Robustness — 2× in this paper · explained in 5 episodes
• AI Agents — 1× in this paper · explained in 2 episodes
• Ablation study — 1× in this paper · explained in 1 episode
• Accountability — 1× in this paper · explained in 2 episodes
• Additivity — 1× in this paper · explained in 1 episode
• Anatomical Therapeutic Chemical — 1× in this paper
• Decode — 1× in this paper · explained in 2 episodes
• Distillation — 1× in this paper · explained in 2 episodes
• External Validation — 1× in this paper · explained in 2 episodes
• F1 Score — 1× in this paper · explained in 3 episodes
• FDA Adverse Event Reporting System — 1× in this paper
• Fine-Tuning — 1× in this paper · explained in 5 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes
• Generative Model — 1× in this paper · explained in 2 episodes
• Information Leakage — 1× in this paper · explained in 2 episodes
• Late Fusion — 1× in this paper · explained in 2 episodes
• Latent Representations — 1× in this paper · explained in 3 episodes
• Multimodal Fusion — 1× in this paper · explained in 3 episodes
• Multimodal Inputs — 1× in this paper · explained in 2 episodes
• Predictive Modeling — 1× in this paper · explained in 2 episodes
• Principal Component Analysis (PCA) — 1× in this paper · explained in 4 episodes
• Redundancy — 1× in this paper · explained in 2 episodes
• Sparsity — 1× in this paper · explained in 4 episodes
• Vision-language models — 1× in this paper · explained in 2 episodes

Sources

• Zorro: the masked multimodal transformer
• KGARevion: An AI Agent for Knowledge-Intensive Biomedical QA
• Autoencoders
• Representation Learning with Contrastive Predictive Coding

Related papers

• A likelihood-based framework for simultaneously learning both noise and growth dynamics using biologically-informed neural networks
• Automated Lesion Segmentation of Stroke MRI Using nnU-Net: A Comprehensive External Validation Across Acute and Chronic Lesions
• Resolving satellite-in situ mismatches in Net Primary Production using high-frequency in situ bio-optical observations in the subpolar Northwest Atlantic
• easyplater: The easy way to generate microplate designs deconvolved from multivariate clinical data
• Essential Workers at Risk: An Agent-Based Model (SAFE-ABM) with Bayesian Uncertainty Quantification
• OmniBioTwin: A System-of-Twinned-Systems Framework for Health Digital Twins