Models

GPT-4V is a version of GPT-4 that accepts image input alongside text, documented in OpenAI's system card of 25 September 2023 and released to developers through preview API models; image understanding later became native in GPT-4o.

Large language modelsMultimodalSafety & governance

Phi-1.5 is a 1.3-billion-parameter language model from Microsoft Research, trained on curated synthetic "textbook" text rather than web crawls; its report claims natural-language performance comparable to models five times larger.

Large language modelsOpen sourceReasoning

Baichuan 2 is the second-generation open model family from Baichuan, released on 6 September 2023 in 7B and 13B sizes. Commercial use required an application and was limited by user numbers.

Large language modelsOpen sourceChina

Qwen-VL is a family of vision-language models released in August 2023 that builds on the Qwen language model to caption images, answer questions about them, locate objects and read text, with open Base and Chat versions.

Open sourceChinaMultimodal

Code Llama is a family of coding models that Meta released in August 2023 by further training Llama 2 on code. It ranges from 7 billion to 70 billion parameters and uses the Llama 2 community license.

Large language modelsOpen sourceDeveloper tools

Qwen, known in Chinese as Tongyi Qianwen (通义千问), is Alibaba's family of large language models. Its first open-weight model, Qwen-7B, was released on 3 August 2023, and the family has grown through many later versions.

Large language modelsOpen sourceChina

RT-2 is a vision-language-action model from Google DeepMind, announced on 28 July 2023, that turns images and text instructions into robot actions written as text tokens. In over 6,000 trials it reached 62% on unseen scenarios, up from 32% for RT-1.

MultimodalRoboticsComputer vision

SDXL is Stability AI's open text-to-image diffusion model, announced in July 2023 with a 3.5B-parameter base model and a refiner stage, generating natively at 1024×1024. A distilled version, SDXL Turbo, cut generation down to a single step.

Open sourceGenerative modelsCreative tools

An open-source 13-billion-parameter language model from Baichuan, released in Base and Chat versions in July 2023, trained on 1.4 trillion tokens and benchmarked against Meta's LLaMA-13B.

Large language modelsOpen sourceChina

Phi-1 is a 1.3-billion-parameter Transformer language model for Python from Microsoft Research, which showed that filtered and synthetic "textbook quality" training data can partly substitute for model and data scale.

Large language modelsOpen sourceData & datasets

Baichuan-7B is an open-source, 7-billion-parameter language model for Chinese and English released in June 2023, the first model from Baichuan, trained on about 1.2 trillion tokens and evaluated on Chinese and English benchmarks.

Large language modelsOpen sourceChina

StarCoder is an open-access code language model of about 15.5 billion parameters, released on 4 May 2023 by the BigCode project led by Hugging Face and ServiceNow.

Large language modelsOpen sourceData & datasets

Stable LM is Stability AI's family of open language models, first released in April 2023 as 3B- and 7B-parameter alpha versions under licenses that allow commercial use of the base models and research-only use of the instruction-tuned ones.

Large language modelsOpen sourceFoundation models

Pythia is a suite of 16 open language models from EleutherAI, ranging from 70 million to 12 billion parameters, all trained on the same data in the same order, with 154 public checkpoints from each training run.

Large language modelsResearch historyOpen source

An open bilingual chat model from Zhipu AI and Tsinghua KEG with about 6.2 billion parameters, small enough to run on one consumer GPU, with weights fully open for research.

Large language modelsOpen sourceChina

Stable Diffusion 2 is an open-source text-to-image model family released by Stability AI on 24 November 2022, built on a new OpenCLIP text encoder and shipped with upscaling, depth-guided and inpainting models; version 2.1 followed weeks later.

Open sourceGenerative modelsCreative tools

Galactica is a large language model for science, unveiled by Meta AI and Papers with Code in November 2022. Its public demo was taken down about three days later, after users found it produced fake papers.

Large language modelsResearch historyOpen source

GLM-130B is a 130-billion-parameter open bilingual Chinese–English dense language model from Tsinghua University's KEG group and Zhipu AI, built to give researchers an open model that matches GPT-3 at the hundred-billion scale.

Large language modelsResearch historyOpen source

OPT-175B is a 175-billion-parameter language model from Meta AI, announced in May 2022. Meta said it was the first model of its size released with both pretrained weights and the code to train and use them.

Large language modelsResearch historyOpen source

Flamingo is a DeepMind visual language model announced in April 2022. It takes prompts that mix images, videos and text and replies in language, learning new tasks from only a few examples.

Large language modelsResearch historyMultimodal

GPT-NeoX-20B is a 20-billion-parameter open autoregressive language model released by EleutherAI in February 2022, with weights under Apache 2.0 and its training code, described by its makers as the largest publicly accessible general-purpose model of its kind at the time.

Large language modelsResearch historyOpen source

RoseTTAFold is a three-track neural network for protein structure prediction, published by the Baker lab in 2021; its accuracy approached AlphaFold2's at CASP14, it models protein–protein complexes from sequence alone, and it is distributed as open code with a public web server.

Research historyOpen sourceDeep learning

GPT-J-6B is a six-billion-parameter open language model released by EleutherAI in June 2021 under the Apache 2.0 license. Its published scores sit close to GPT-3 Curie, making it a widely used free baseline for large-model research.

Large language modelsResearch historyOpen source

GPT-Neo is a family of open text-generation models released by EleutherAI in March 2021 at 125M, 1.3B and 2.7B parameters, built to replicate the GPT-3 architecture and distributed with freely downloadable weights under an MIT license.

Large language modelsResearch historyOpen source

An image-text model from OpenAI that learns to match pictures with their captions. Trained on about 400 million image-caption pairs, it can classify images by comparing them against written prompts, with no task-specific training.

Open sourceFoundation modelsMultimodal

T5 is a family of Google Transformer models that recasts every language task as text in, text out. Its 11-billion-parameter version set state of the art on several benchmarks, and the code, models and C4 dataset were released openly.

Large language modelsOpen sourceFoundation models

ERNIE 2.0 is Baidu's pre-trained language model framework, published in 2019, which builds pre-training tasks incrementally through continual multi-task learning and reported results above BERT and XLNet on English and Chinese benchmarks.

Large language modelsResearch historyOpen source

Baidu's first ERNIE pre-trained language model, released in March 2019, added entity- and phrase-level masking to BERT-style pre-training and reported state-of-the-art results on five Chinese NLP tasks.

Large language modelsResearch historyOpen source

AlexNet is the eight-layer convolutional network that won the ILSVRC2012 image classification task by a wide margin, showing that a large network trained on a large labelled dataset with GPUs could beat hand-designed features.

Research historyDeep learningComputer vision

IBM Watson is a question-answering computer system built by an IBM research team led by David Ferrucci; in February 2011 it defeated the two foremost all-time champions of the televised quiz show Jeopardy!

Research historyEnterpriseReasoning