Fast Differentiable SVD on GPU via Polar Decomposition
math.NA, cs.LG, cs.NA
Submitted: 2026-09-26
Updated: 2026-09-26
Code: https://github.com/fallnlove/cans_svd
Project page: https://j-towns.github.io/papers/svd-derivative.pdf
Terminology
Sources
- Accelerating Newton-Schulz Iteration for Orthogonalization via Chebyshev-type Polynomials
- Pointer Sentinel Mixture Models
- Llama 2: Open Foundation and Fine-Tuned Chat Models
- Differentiable SVD based on Moore-Penrose Pseudoinverse for Inverse Imaging Problems
Related papers
- Do physics-informed neural networks (PINNs) need to be deep? Shallow PINNs using the Levenberg-Marquardt algorithm
- A Neural-preconditioned Poisson Solver for Mixed Dirichlet and Neumann Boundary Conditions
- Second-order consistency for learning chaotic dynamics via randomized Jacobian matching
- Windowed thinning and query complexity for the bouncy particle and Zigzag samplers
- Data-efficient Kernel Methods for Learning Hamiltonian Systems
- Adjoint Method versus Physics-Informed Neural Networks in PDE-Constrained Inverse Problems