bg de en es fr it nl pl pt sv tr zh

neuroscience

Energy-Based Transformers are Scalable Learners and Thinkers

blank

Paper: https://energy-based-transformers.github.io/static/pdfs/paper.pdf1 Website: https://energy-based-transformers.github.io/ TLDR: We outscale (feed-forward) transformers while generalizing reasoning/system 2 thinking to any modality/problem without requiring verifiable rewards😮. Energy-Based...

The Neuroplasticity Hypothesis

blank

Idea formulated in June 2021 - blog started during date above. The Neuroplasticity Hypothesis ReLU Intuition Neuroplasticity The Neuroplasticity Hypothesis Residual Connections and Densenet Related Works Looking Forward References Footnotes ReLU Intuition When I was first started studying...