Home›Models
Models
Models
Foundation, generative, multimodal and specialised models.
Total 251 · Clear filters
2019
-
Oct 23, 2019
T5 (Text-to-Text Transfer Transformer)
T5 is a family of Google Transformer models that recasts every language task as text in, text out. Its 11-billion-parameter version set state of the art on several benchmarks, and the code, models and C4 dataset were released openly.
-
Jul 29, 2019
ERNIE 2.0
ERNIE 2.0 is Baidu's pre-trained language model framework, published in 2019, which builds pre-training tasks incrementally through continual multi-task learning and reported results above BERT and XLNet on English and Chinese benchmarks.
-
Mar 2019
ERNIE 1.0
Baidu's first ERNIE pre-trained language model, released in March 2019, added entity- and phrase-level masking to BERT-style pre-training and reported state-of-the-art results on five Chinese NLP tasks.
-
Feb 14, 2019
GPT-2
GPT-2 is a large language model that OpenAI announced in February 2019. Its largest version has 1.5 billion parameters. OpenAI first withheld the full model, then released it in stages through November 2019.
-
Jan 2019
AlphaStar
AlphaStar is a DeepMind system that plays StarCraft II. In 2019 it reached Grandmaster level with all three races, ranking above 99.8% of active players on Battle.net.
2018
-
Oct 11, 2018
BERT
BERT is a language model from Google that reads text in both directions and is pre-trained by filling in masked words. Fine-tuned per task, it set new records on question answering and language-understanding benchmarks and later went into Google Search.
-
Jun 11, 2018
GPT-1
GPT-1 was OpenAI's first generative pre-trained transformer, published in June 2018. It showed that one language model, pre-trained on unlabelled text and then fine-tuned, could improve results on many language tasks.
2017
-
Dec 5, 2017
AlphaZero
AlphaZero is a general game-playing system from DeepMind, described in a preprint in December 2017, that reached a superhuman level in chess, shogi and Go within 24 hours starting from random play, using only the rules of each game.
-
Oct 18, 2017
AlphaGo Zero
A DeepMind Go program that learned the game from scratch by playing against itself, using no human game records, and beat earlier versions of AlphaGo within days.
2016
-
Jan 27, 2016
AlphaGo
AlphaGo is a Go-playing program from DeepMind that combined deep neural networks with Monte Carlo tree search. In 2016 it beat top professional Lee Sedol in a widely watched match, a landmark for learned systems.
2011
-
Feb 2011
IBM Watson
IBM Watson is a question-answering computer system built by an IBM research team led by David Ferrucci; in February 2011 it defeated the two foremost all-time champions of the televised quiz show Jeopardy!