Periodic Spectral Ergodicity Accurately Predicts Deep Learning Generalisation
msuzen
Preamble Dali (1931), The Persistence of Memory (Wikipedia)One of the new mathematical concepts arise due to understanding of deep learning is called periodic spectral ergodicity (PSE). The cascading PSE (cPSE) propagates over deep learning layers which can also be used as a complexity...