@RominaYalov
Can a JEPA world model provably avoid contraction and merging of latent states over long rollouts? Unconstrained autoregressive predictors may contract the latent distribution. Our Symplectic Hamiltonian JEPA (LeHami) replaces the predictor with an action-conditioned Hamiltonian flow over a latent state (q, p), integrated with an exactly symplectic leapfrog step. Volume is preserved at every rollout step, independently of the learned parameters or action sequence. With @randall_balestriero @ylecun Paper: https://t.co/JqJ7rrOXmF Website: https://t.co/I5pmtHM9VB Code: https://t.co/D9EIFGS87U 1/6... ๐งต๐