NV-Generate-Body: 3D Latent Diffusion Model forControllable Anatomy, Tumor, and Demographic Body Mask Synthesis

arXiv:2610.24153 · cs.CV · Submitted 2026-10-16 · Read on arXiv

cs.CV

Submitted: 2026-10-16

Updated: 2026-10-16

Comments: Code and model weights open-sourced

License: http://creativecommons.org/licenses/by/4.0/

The gist: Curating large labeled CT datasets is expensive and constrained by patient privacy.

Terminology

Abstract

Curating large labeled CT datasets is expensive and constrained by patient privacy. We present NV-Generate-BodyMask, a 3D latent diffusion model that synthesizes whole-body CT segmentation masks with precise, joint control over organ anatomy, tumor burden, and patient demographics. The model operates in the compressed latent space of a frozen mask autoencoder, generating 256 cubed volumetric label maps conditioned on a 19-dimensional vector via Adaptive Group Normalization and cross-attention. A size-adaptive ROI loss with spatial halo weighting and a paired tumor injection pipeline enable accurate tumor size conditioning despite the scarcity of annotated tumor cases. Trained on 8,571 masks across 26 cohorts spanning 132 labels, the model achieves Spearman ρ= 0.70 -- 0.92 for organ size, 85--100% tumor recall for lung, pancreatic, colon, and bone lesions, and strong demographic alignment (BMI ρ= 0.78, sex-conditioned perfect prostate control).

Related papers