interpretability

Jun 09

Book Review: 50 ML Projects to Understand LLMs

Andrey Lukyanenko

Book Review: 50 ML Projects to Understand LLMs Amazon Author’s website I was offered to read 50 ML Projects To Understand LLMs by Mike X Cohen in exchange for an honest review. Rather than building, fine-tuning, or prompting LLMs, the book treats GPT-2 as a scientific specimen and teaches you...

books llm transformers interpretability blogpost

Feb 03

Interpreting eigenvalue models

Alex Shtoff

Intro We continue our discussion of machine-learned models of the form \[f({\boldsymbol x};{\boldsymbol A}_{0:n}) = \lambda_k \Bigl({\boldsymbol A}_0 + \sum_{i=1}^n x_i {\boldsymbol A}_i\Bigr),\] where \({\boldsymbol A}_i\) are learned symmetric matrices, and \(\lambda_k\) is the \(k\)-th...

machine learning optimization interpretability minimax spectral methods eigenvalue models dc optimization

Jan 01

Robustness, interpretability, and scaling of eigenvalue models

Alex Shtoff

Intro We all want our models to perform well. But some of us would also like our models to be efficient, robust, or interpretable. So in this post we will discuss some mathematical properties of these models that are related to these three pillars. Robustness and interpretability may mean...

machine learning regularization interpretability adversarial robustness spectral norm eigenvalue models operator norm