Geodesics in the Deep Linear Network

arXiv:2510.07324 · math.DG, cs.LG, math.DS · Submitted 2025-09-18 · Read on arXiv

math.DG, cs.LG, math.DS

Submitted: 2025-09-18

Updated: 2026-10-18

License: http://creativecommons.org/licenses/by/4.0/

The gist: We derive a general system of ordinary differential equations and associated explicit solutions in a special case for geodesics between full rank matrices in the deep linear network geometry.

Abstract

We derive a general system of ordinary differential equations and associated explicit solutions in a special case for geodesics between full rank matrices in the deep linear network geometry. In the process, we find horizontal straight lines in the invariant balanced manifold that remain geodesics under Riemannian submersion.

Related papers