scikit-learn

Nov 02 2025

Something New Is Coming… One Chapter at a Time

codef0rmer

Six months ago, I knew nothing about Machine Learning since I had always viewed Machine Learning as a distant, almost mystical field reserved for mathematicians and data scientists. Then one day, curiosity got the better of me. I wanted to know, how does a machine actually learn?That simple...

python data science numpy regression scikit-learn simple-linear-regression

Apr 17 2025

Off with the polynomial’s tail!

Alex Shtoff

Intro Last time we did a small curve fitting exercise - we fit high degree polynomials represented in the Legendre basis to a curve, and observe the celebrated “double descent” phenomenon: after crossing the memorization threshold, the generalization error improves as the degree increases. Then,...

machine learning model pruning scikit-learn double descent feature selection polynomials polynomial regression california housing dataset feature engineering legendre polynomials