TellWorldAI World Archive

Home›Models

Models

Models

Foundation, generative, multimodal and specialised models.

Total 547

2023

2022

2021

  • Dec 23, 2021 ERNIE 3.0 Titan

    ERNIE 3.0 Titan is a Chinese pre-trained language model with over 260 billion parameters, described by its authors as the largest dense Chinese model of its time and reported to beat state-of-the-art systems on 68 NLP datasets.

    Large language modelsResearch historyChina

  • Dec 8, 2021 Gopher

    Gopher is DeepMind's 280-billion-parameter language model, announced in December 2021 alongside a study of what scale does to language models and a companion taxonomy of their risks.

    Large language modelsResearch historyEurope

  • Oct 11, 2021 Megatron-Turing NLG 530B

    Megatron-Turing NLG 530B is a 530-billion-parameter language model announced by NVIDIA and Microsoft on 11 October 2021, then the largest monolithic transformer language model, trained on NVIDIA's Selene supercomputer with Megatron-LM and DeepSpeed combined.

    Large language modelsFoundation modelsHardware & compute

  • Aug 2021 Jurassic-1

    Jurassic-1 is the first family of large language models from AI21 Labs, announced with the AI21 Studio developer platform in August 2021. Its largest model, Jumbo, has 178 billion parameters.

    Large language modelsFoundation modelsDeveloper tools

  • Jul 15, 2021 RoseTTAFold

    RoseTTAFold is a three-track neural network for protein structure prediction, published by the Baker lab in 2021; its accuracy approached AlphaFold2's at CASP14, it models protein–protein complexes from sequence alone, and it is distributed as open code with a public web server.

    Research historyOpen sourceDeep learning

  • Jul 7, 2021 OpenAI Codex (2021 model)

    OpenAI Codex is a 2021 GPT language model fine-tuned on public code from GitHub. It translates natural language into code, and was introduced alongside the HumanEval benchmark for testing code correctness.

    Large language modelsResearch historyDeveloper tools

  • Jul 5, 2021 ERNIE 3.0

    ERNIE 3.0 is a 10-billion-parameter pre-trained language model from 2021 that trains on plain text plus a large-scale knowledge graph and fuses auto-encoding and auto-regressive networks, so one model handles both language understanding and generation.

    Large language modelsResearch historyChina

  • Jun 2021 GPT-J-6B

    GPT-J-6B is a six-billion-parameter open language model released by EleutherAI in June 2021 under the Apache 2.0 license. Its published scores sit close to GPT-3 Curie, making it a widely used free baseline for large-model research.

    Large language modelsResearch historyOpen source

  • May 18, 2021 LaMDA

    LaMDA is a family of conversational language models that Google announced in 2021 and described in a 2022 paper, notable for its work on safety and factual grounding in dialogue and for later powering Bard.

    Large language modelsResearch historyConsumer apps

  • Mar 21, 2021 GPT-Neo

    GPT-Neo is a family of open text-generation models released by EleutherAI in March 2021 at 125M, 1.3B and 2.7B parameters, built to replicate the GPT-3 architecture and distributed with freely downloadable weights under an MIT license.

    Large language modelsResearch historyOpen source

  • Jan 5, 2021 CLIP

    An image-text model from OpenAI that learns to match pictures with their captions. Trained on about 400 million image-caption pairs, it can classify images by comparing them against written prompts, with no task-specific training.

    Open sourceFoundation modelsMultimodal

  • Jan 5, 2021 DALL·E

    DALL·E is OpenAI's text-to-image model unveiled on 5 January 2021: a 12-billion-parameter transformer trained on 250 million text-image pairs that generates a picture token by token from a caption.

    MultimodalGenerative modelsCreative tools

2020

  • Nov 30, 2020 AlphaFold2

    AlphaFold2 is DeepMind's protein structure prediction system, announced in 2020. It reached accuracy competitive with experimental methods in many cases, and work in this area received half of the 2024 Nobel Prize in Chemistry.

    Research historyDeep learningScience

  • May 28, 2020 GPT-3

    GPT-3 is an autoregressive language model with 175 billion parameters, described in a May 2020 paper. It could perform new tasks from a few examples in the prompt, without any gradient updates, and it was first offered through OpenAI's API.

    Large language modelsResearch historyFoundation models

  • Jan 28, 2020 Meena

    Meena is a 2.6-billion-parameter open-domain chatbot from Google, trained end-to-end on filtered social media conversations. Its 2020 paper introduced the SSA human-evaluation metric and linked next-token perplexity to human-judged chat quality. The work was later renamed LaMDA.

    Large language modelsResearch historyConsumer apps

2019

2018

2017

  • Dec 5, 2017 AlphaZero

    AlphaZero is a general game-playing system from DeepMind, described in a preprint in December 2017, that reached a superhuman level in chess, shogi and Go within 24 hours starting from random play, using only the rules of each game.

    Research historyDeep learningReasoning