spectral ergodicity

Nov 15 2021

Periodic Spectral Ergodicity Accurately Predicts Deep Learning Generalisation

msuzen

Preamble     Dali (1931), The Persistence of Memory (Wikipedia)One of the new mathematical concepts arise due to understanding of deep learning is called periodic spectral ergodicity (PSE). The cascading PSE (cPSE) propagates over deep learning layers which can also be used as a complexity...

deep learning random matrix theory periodic spectral ergodicity complexity theory spectral ergodicity quantum mechanics random matrices ergodic hypothesis

Jul 28 2021

Deep Learning in Mind a Gentle Introduction to Spectral Ergodicity

msuzen

Preamble    Figure: Monalisa on Eigenvector grids (Wikipedia)In the post, A New Matrix Mathematics for Deep Learning : Random Matrix Theory of Deep Learning, we have outlined a new mathematical concepts that are aimed at deep learning but in general belonging to applied mathematics. Here, we dive...

machine learning statistical physics random matrix theory spectral ergodicity interpretable machine learning statistical mechanics ergodic hypothesis