statistical models

Nov 16 2025

Why the simplest explanation is always the best

msuzen

PreambleThe simplest explanation is always the best among the explanations that are representative.  It is called the principle of parsimony,  Occam's razor. It is the bedrock of scientific enlightenment. There is a recent development that people start to do a category error to discard this...

machine learning data science overfitting complexity complexity theory interpretable machine learning bayesian statistics. statistical models evalutionary computation overgenearlisation

Oct 25 2022

Overfitting is about complexity ranking of inductive biases : Algorithmic recipe

msuzen

Preamble    Figure: Moon patterns human brain invents. (Wikipedia)Detecting overfitting is inherently a comparison problem of the complexity of multiple objects, i.e., models or an algorithm capable of making predictions. A model is overfitted (underfitted) if we only compare it to another model....

physics machine learning deep learning overfitting statistics interpretable machine learning sparse recovery statistical mechanics statistical models inductive bias