AILabby - AILab & Beyond
Having been living with GenAI and thinking about the transformer and MoE, which BTW was amazingly origined in this 1991 paper Adaptive Mixtures of Local Experts, the year another dinasour got his master’s degree in classical AI, I suddenly had the urge this Saturday morning to ask AI this...
AILabby - AILab & Beyond
Another 5 years have passed. Here’s a summary of what happened after I wrote in my last post “my mission statement” as “Building True AI with NLU and Common Sense”: I ported all my iOS and Android AI apps built with TensorFlow Mobile to PyTorch Mobile around 2021 - both platforms are long...
blank
Paper: https://energy-based-transformers.github.io/static/pdfs/paper.pdf1 Website: https://energy-based-transformers.github.io/ TLDR: We outscale (feed-forward) transformers while generalizing reasoning/system 2 thinking to any modality/problem without requiring verifiable rewards😮. Energy-Based...