de en es fr nl pl pt sv zh

llms

Pointers, Not Answers

Agam Brahma

tl;dr: treat llm output as a pointer to the answer, not the answerEveryone who leans on these tools has been burnt: an invented flag, a test that passes for the wrong reason. Abstaining isn't a serious option for me either ... the leverage is too large to leave on the table. So the question is how...

The Turing Gradient

Agam Brahma

tl;dr: the test was't really about measuring the machine, but rather about measuring us.Eliza was enoughJoseph Weizenbaum wrote ELIZA in the mid-1960s as a kind of "parody of therapy". It was a simple program that mostly took what you typed and turned it back into a question. If you said you were...

A new kind of AutoML: On the fallacy of many-shot in-context learning with LLMs and PLMs

msuzen

Extension of this post, appear as a short article with a conjecture:Mehmet Süzen. In-context learning as a new kind of symbolic-AutoML: Lyapunov conjecture for CoTs. 2024 HAL FrancePreamble A graph path (Wikipedia)With the common usage of  Pre-trained Large  Language Models (PLMs/LLMs), now it is...

Thoughts on ChatGPT, LLMs, and search engines

Martín Villalba

Now that everyone is talking about Large Language Models (LLMs) in general and ChatGPT in particular I thought I would share a couple thoughts I've been having about this technology that I haven't seen anywhere else. But first, let's talk about chess. Chess is a discipline notorious for coming out...