Models

Pangu-Weather is a three-dimensional deep-learning model for medium-range global weather forecasting, published in Nature in 2023; on reanalysis data it produced stronger forecasts than ECMWF's operational system across all tested variables.

ChinaDeep learningScience

An open-source 13-billion-parameter language model from Baichuan, released in Base and Chat versions in July 2023, trained on 1.4 trillion tokens and benchmarked against Meta's LLaMA-13B.

Large language modelsOpen sourceChina

Phi-1 is a 1.3-billion-parameter Transformer language model for Python from Microsoft Research, which showed that filtered and synthetic "textbook quality" training data can partly substitute for model and data scale.

Large language modelsOpen sourceData & datasets

ERNIE 3.5 is a Baidu large language model announced in June 2023 as the upgrade behind the ERNIE Bot chatbot, adding a plugin architecture and, according to Baidu, outperforming ChatGPT on several benchmarked abilities.

Large language modelsChinaConsumer apps

Baichuan-7B is an open-source, 7-billion-parameter language model for Chinese and English released in June 2023, the first model from Baichuan, trained on about 1.2 trillion tokens and evaluated on Chinese and English benchmarks.

Large language modelsOpen sourceChina

SparkDesk is iFlytek's cognitive large model, unveiled on 6 May 2023 as the company's answer to ChatGPT in education and enterprise uses, built on Huawei Ascend chips and followed by rapid version updates through 2024.

Large language modelsChinaEnterprise

StarCoder is an open-access code language model of about 15.5 billion parameters, released on 4 May 2023 by the BigCode project led by Hugging Face and ServiceNow.

Large language modelsOpen sourceData & datasets

SenseNova is SenseTime's family of foundation models, unveiled on 10 April 2023 with a chatbot, an image generator and an avatar video generator, first offered to government and corporate clients rather than the public.

Large language modelsChinaEnterprise

Midjourney V5 is a version of the Midjourney text-to-image model, released in alpha on 15 March 2023 and refined through the 5.x line before being succeeded by V6 in December 2023.

Consumer appsGenerative modelsCreative tools

Runway Gen-2 is a multimodal video generation system announced in March 2023 that turns text, images or video clips into new video, and was among the first commercially available text-to-video models.

MultimodalGenerative modelsCreative tools

Runway Gen-1 is a video-to-video diffusion model released in February 2023 that restyles existing footage from text or image prompts while keeping the source video's structure. It was among the first commercially available video-generation models.

MultimodalGenerative modelsCreative tools

An open bilingual chat model from Zhipu AI and Tsinghua KEG with about 6.2 billion parameters, small enough to run on one consumer GPU, with weights fully open for research.

Large language modelsOpen sourceChina

Stable Diffusion 2 is an open-source text-to-image model family released by Stability AI on 24 November 2022, built on a new OpenCLIP text encoder and shipped with upscaling, depth-guided and inpainting models; version 2.1 followed weeks later.

Open sourceGenerative modelsCreative tools

Midjourney V4 is the fourth-generation image generation model released in alpha on 5 November 2022. It was the first Midjourney model trained on Google TPUs, and reviewers described it as a large step up from V3.

Consumer appsGenerative modelsCreative tools

GLM-130B is a 130-billion-parameter open bilingual Chinese–English dense language model from Tsinghua University's KEG group and Zhipu AI, built to give researchers an open model that matches GPT-3 at the hundred-billion scale.

Large language modelsResearch historyOpen source

Midjourney V3, released on 25 July 2022, was the third model version of Midjourney; it raised image quality sharply by learning from how users behaved, and it produced the image that won a Colorado State Fair digital-art prize.

Consumer appsGenerative modelsCreative tools

Imagen is a text-to-image diffusion model announced by Google Research in May 2022, known for pairing a frozen large language model with diffusion and for the DrawBench benchmark; Google did not release it publicly.

Research historyGenerative modelsCreative tools

Midjourney V2 was the second model version of Midjourney's image generation model, released on 12 April 2022 and the default model until V3 arrived that July. Midjourney later described it as colorful and painterly but low in coherency.

Consumer appsGenerative modelsCreative tools

GPT-3.5 is the family of OpenAI language models between GPT-3 and GPT-4, released through API models such as text-davinci-002 and text-davinci-003 and underlying the first version of ChatGPT.

Large language modelsFoundation modelsProduct history

AlphaCode is a DeepMind code-generation system for competitive programming, announced in February 2022. On Codeforces contests held after its training data, it reached an estimated rank around the median participant. A Gemini-based AlphaCode 2 followed in December 2023.

Large language modelsResearch historyCode

Midjourney V1 was Midjourney's first image-generation model, released in February 2022 and used through a bot on the company's Discord server. It produced abstract, painterly images and was replaced by V2 and V3 within months.

Consumer appsGenerative modelsCreative tools

ERNIE 3.0 Titan is a Chinese pre-trained language model with over 260 billion parameters, described by its authors as the largest dense Chinese model of its time and reported to beat state-of-the-art systems on 68 NLP datasets.

Large language modelsResearch historyChina

ERNIE 3.0 is a 10-billion-parameter pre-trained language model from 2021 that trains on plain text plus a large-scale knowledge graph and fuses auto-encoding and auto-regressive networks, so one model handles both language understanding and generation.

Large language modelsResearch historyChina

ERNIE 2.0 is Baidu's pre-trained language model framework, published in 2019, which builds pre-training tasks incrementally through continual multi-task learning and reported results above BERT and XLNet on English and Chinese benchmarks.

Large language modelsResearch historyOpen source

Baidu's first ERNIE pre-trained language model, released in March 2019, added entity- and phrase-level masking to BERT-style pre-training and reported state-of-the-art results on five Chinese NLP tasks.

Large language modelsResearch historyOpen source

A DeepMind generative model that predicts raw audio one sample at a time, bringing neural text-to-speech close to human quality and later powering Google Assistant and Cloud Text-to-Speech voices.

Research historyDeep learningConsumer apps