TellWorldAI World Archive

Home›Models

Models

Models

Foundation, generative, multimodal and specialised models.

Total 140 · Clear filters

2023

2022

2021

  • Dec 23, 2021 ERNIE 3.0 Titan

    ERNIE 3.0 Titan is a Chinese pre-trained language model with over 260 billion parameters, described by its authors as the largest dense Chinese model of its time and reported to beat state-of-the-art systems on 68 NLP datasets.

    Large language modelsResearch historyChina

  • Oct 11, 2021 Megatron-Turing NLG 530B

    Megatron-Turing NLG 530B is a 530-billion-parameter language model announced by NVIDIA and Microsoft on 11 October 2021, then the largest monolithic transformer language model, trained on NVIDIA's Selene supercomputer with Megatron-LM and DeepSpeed combined.

    Large language modelsFoundation modelsHardware & compute

  • Aug 2021 Jurassic-1

    Jurassic-1 is the first family of large language models from AI21 Labs, announced with the AI21 Studio developer platform in August 2021. Its largest model, Jumbo, has 178 billion parameters.

    Large language modelsFoundation modelsDeveloper tools

  • Jul 5, 2021 ERNIE 3.0

    ERNIE 3.0 is a 10-billion-parameter pre-trained language model from 2021 that trains on plain text plus a large-scale knowledge graph and fuses auto-encoding and auto-regressive networks, so one model handles both language understanding and generation.

    Large language modelsResearch historyChina

  • Jan 5, 2021 CLIP

    An image-text model from OpenAI that learns to match pictures with their captions. Trained on about 400 million image-caption pairs, it can classify images by comparing them against written prompts, with no task-specific training.

    Open sourceFoundation modelsMultimodal

2020

  • May 28, 2020 GPT-3

    GPT-3 is an autoregressive language model with 175 billion parameters, described in a May 2020 paper. It could perform new tasks from a few examples in the prompt, without any gradient updates, and it was first offered through OpenAI's API.

    Large language modelsResearch historyFoundation models

2019

2018

  • Oct 11, 2018 BERT

    BERT is a language model from Google that reads text in both directions and is pre-trained by filling in masked words. Fine-tuned per task, it set new records on question answering and language-understanding benchmarks and later went into Google Search.

    Large language modelsResearch historyOpen source

  • Jun 11, 2018 GPT-1

    GPT-1 was OpenAI's first generative pre-trained transformer, published in June 2018. It showed that one language model, pre-trained on unlabelled text and then fine-tuned, could improve results on many language tasks.

    Large language modelsResearch historyOpen source