ar bg de en es fr id it nl pl pt sv tr zh

nlg

Jun 03 2020

GPT-3, a Giant Step for Deep Learning and NLP

Yoel Zeldes

A few days ago, OpenAI announced a new successor to their Language Model (LM) - GPT-3. This is the largest model trained so far, with 175 billion parameters. While training this large model has its merits, reading a large portion of 72 pages can be tiresome. In this blog post I’ll highlight the...

nlp deep learning gpt-3 nlg

Nov 28 2019

The Accessibility of GPT-2 - Text Generation and Fine-tuning

Yoel Zeldes

Natural Language Generation (NLG) is a well studied subject among the NLP community. With the rise of deep learning methods, NLG has become better and better. Recently, OpenAI has pushed the limits, with the release of GPT-2 - a Transformers based model that predicts the next token at each time...

nlp deep learning gpt-2 nlg