california housing dataset

Aug 19 2025

Paying attention to feature distribution alignment

Alex Shtoff

Intro Yes, I’m making a joke of the tendency to put the words “attention” and “alignment” in any ML paper 😎. Now let’s see how this provocative title is related to our adventures in the land of polynomial features. The Legendre polynomial basis serverd us well in recent posts about polynomial...

machine learning feature scaling correlation analysis polynomials polynomial regression orthogonal polynomials quantile transformer california housing dataset feature engineering legendre polynomials

Apr 17 2025

Off with the polynomial’s tail!

Alex Shtoff

Intro Last time we did a small curve fitting exercise - we fit high degree polynomials represented in the Legendre basis to a curve, and observe the celebrated “double descent” phenomenon: after crossing the memorization threshold, the generalization error improves as the degree increases. Then,...

machine learning model pruning scikit-learn double descent feature selection polynomials polynomial regression california housing dataset feature engineering legendre polynomials