Contribution to a conference proceedings

DZNE-2025-00172

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png INVARIANCE-BASED LEARNING OF LATENT DYNAMICS

Lagemann, K. (First author)DZNE* ; Lagemann, C. ; Mukherjee, S. (Last author)DZNE*

2024

Abstract: We propose a new model class aimed at predicting dynamical trajectories from highdimensional empirical data. This is done by combining variational autoencodersand (spatio-)temporal transformers within a framework designed to enforce certainscientifically-motivated invariances. The models allow inference of system behavior at any continuous time and generalization well beyond the data distributionsseen during training. Furthermore, the models do not require an explicit neuralODE formulation, making them efficient and highly scalable in practice. We studybehavior through simple theoretical analyses and extensive empirical experiments.The latter investigate the ability to predict the trajectories of complicated systemsbased on finite data and show that the proposed approaches can outperform existingneural-dynamical models. We study also more general inductive bias in the contextof transfer to data obtained under entirely novel system interventions. Overall, ourresults provide a new framework for efficiently learning complicated dynamics in adata-driven manner, with potential applications in a wide range of fields includingphysics, biology, and engineering.

---

Contributing Institute(s):

1. Statistics and Machine Learning (AG Mukherjee)

Research Program(s):

1. 354 - Disease Prevention and Healthy Aging (POF4-354) (POF4-354)

---