Models

Falcon-H1 is a family of open-weight language models that runs Transformer attention and state space layers in parallel, released in sizes from 0.5B to 34B parameters under the Falcon-LLM Licence.

Large language modelsOpen sourceFoundation models

A family of text-to-image models from Stability AI, announced in October 2024: the 8.1-billion-parameter Large, a 4-step Turbo variant and the 2.5-billion-parameter Medium, released under a community licence.

Open sourceGenerative modelsCreative tools

OpenVLA is a 7-billion-parameter open-source vision-language-action model trained on 970,000 real robot demonstrations, released with checkpoints and code so that other groups can fine-tune and run it on their own robots.

Open sourceFoundation modelsMultimodal

Stable Diffusion 3, announced by Stability AI on 22 February 2024, is a suite of 800 million to 8 billion parameter models that pairs a diffusion transformer with flow matching.

Open sourceGenerative modelsCreative tools

Grok-1 is xAI's first large language model, announced on 3 November 2023 as the engine of the Grok chatbot. Its 314-billion-parameter weights were released openly in March 2024.

Large language modelsOpen sourceFoundation models

RT-2 is a vision-language-action model from Google DeepMind, announced on 28 July 2023, that turns images and text instructions into robot actions written as text tokens. In over 6,000 trials it reached 62% on unseen scenarios, up from 32% for RT-1.

MultimodalRoboticsComputer vision

PaLM 2 is Google's second-generation Pathways language model, announced on 10 May 2023 in four sizes and used across more than 25 Google products, including Bard.

Large language modelsEnterpriseConsumer apps

Stable LM is Stability AI's family of open language models, first released in April 2023 as 3B- and 7B-parameter alpha versions under licenses that allow commercial use of the base models and research-only use of the instruction-tuned ones.

Large language modelsOpen sourceFoundation models

RT-1 is a transformer-based model for real-world robot control, trained on over 130,000 episodes collected with 13 robots and reported to perform more than 700 language instructions at a 97% success rate.

Research historyFoundation modelsMultimodal

OPT-175B is a 175-billion-parameter language model from Meta AI, announced in May 2022. Meta said it was the first model of its size released with both pretrained weights and the code to train and use them.

Large language modelsResearch historyOpen source

AlphaCode is a DeepMind code-generation system for competitive programming, announced in February 2022. On Codeforces contests held after its training data, it reached an estimated rank around the median participant. A Gemini-based AlphaCode 2 followed in December 2023.

Large language modelsResearch historyCode

Gopher is DeepMind's 280-billion-parameter language model, announced in December 2021 alongside a study of what scale does to language models and a companion taxonomy of their risks.

Large language modelsResearch historyEurope

Megatron-Turing NLG 530B is a 530-billion-parameter language model announced by NVIDIA and Microsoft on 11 October 2021, then the largest monolithic transformer language model, trained on NVIDIA's Selene supercomputer with Megatron-LM and DeepSpeed combined.

Large language modelsFoundation modelsHardware & compute

ERNIE 3.0 is a 10-billion-parameter pre-trained language model from 2021 that trains on plain text plus a large-scale knowledge graph and fuses auto-encoding and auto-regressive networks, so one model handles both language understanding and generation.

Large language modelsResearch historyChina

LaMDA is a family of conversational language models that Google announced in 2021 and described in a 2022 paper, notable for its work on safety and factual grounding in dialogue and for later powering Bard.

Large language modelsResearch historyConsumer apps

An image-text model from OpenAI that learns to match pictures with their captions. Trained on about 400 million image-caption pairs, it can classify images by comparing them against written prompts, with no task-specific training.

Open sourceFoundation modelsMultimodal

Meena is a 2.6-billion-parameter open-domain chatbot from Google, trained end-to-end on filtered social media conversations. Its 2020 paper introduced the SSA human-evaluation metric and linked next-token perplexity to human-judged chat quality. The work was later renamed LaMDA.

Large language modelsResearch historyConsumer apps

T5 is a family of Google Transformer models that recasts every language task as text in, text out. Its 11-billion-parameter version set state of the art on several benchmarks, and the code, models and C4 dataset were released openly.

Large language modelsOpen sourceFoundation models

ERNIE 2.0 is Baidu's pre-trained language model framework, published in 2019, which builds pre-training tasks incrementally through continual multi-task learning and reported results above BERT and XLNet on English and Chinese benchmarks.

Large language modelsResearch historyOpen source

Baidu's first ERNIE pre-trained language model, released in March 2019, added entity- and phrase-level masking to BERT-style pre-training and reported state-of-the-art results on five Chinese NLP tasks.

Large language modelsResearch historyOpen source