Models

SenseNova 4.0, announced on 8 February 2024, upgraded SenseTime's model family with 4K, 32K and 128K context versions, specialised models and a first multimodal tool-calling API.

Large language modelsChinaEnterprise

Qwen1.5 is the Qwen family's open model release of February 2024, with base and chat models from 0.5B to 72B parameters, later extended to 110B, and a mixture-of-experts model.

Large language modelsOpen sourceChina

DeepSeekMath is a 7B-parameter open language model built for mathematical reasoning and released in 2024. It reached 51.7% on the competition-level MATH benchmark without external tools, and introduced GRPO, a reinforcement-learning algorithm that uses less memory than PPO.

Large language modelsOpen sourceChina

Aya 101 is a 13-billion-parameter, instruction-tuned language model from Cohere For AI that follows instructions in 101 languages. It was released under Apache 2.0 in February 2024.

Large language modelsOpen sourceFoundation models

Spark V3.5 is a large language model that iFlytek released on 30 January 2024. It was the first Spark model trained entirely on the domestic FlyingStar One computing platform, and iFlytek compared it with GPT-4 Turbo.

Large language modelsChinaFoundation models

Baichuan 3 is a closed language model with more than one hundred billion parameters, released by Baichuan on 29 January 2024. The company reported that it matched or beat GPT-4 on several Chinese benchmarks and on Chinese medical tasks.

Large language modelsChinaFoundation models

Yi-VL-34B and Yi-VL-6B are open vision-language models from 01.AI, released on 23 January 2024. They read images and text together and ranked first among open models on the MMMU and CMMMU benchmarks.

Open sourceChinaMultimodal

AlphaGeometry is a Google DeepMind system that pairs a neural language model with a symbolic deduction engine to solve olympiad geometry problems, reaching near gold-medal level on a benchmark of 30 problems.

Open sourceReasoningScience

DeepSeekMoE is a mixture-of-experts architecture from DeepSeek, released in January 2024, that splits experts finely and keeps a few shared experts always active so that each expert holds focused knowledge. Its 16B open-weights model matched larger dense models at a fraction of the computation.

Large language modelsOpen sourceChina

Midjourney V6 is a version of Midjourney's image generation model, released in alpha on 21 December 2023 and trained from scratch over nine months; its 6.1 update followed in July 2024.

Consumer appsGenerative modelsCreative tools

FunSearch is a method that uses a pretrained large language model inside an evolutionary loop to search for programs that solve mathematical and computational problems, rather than for answers directly. It produced new results on the cap set problem and on online bin packing.

Deep learningReasoningScience

Phi-2 is a 2.7-billion-parameter base language model from Microsoft Research, announced on 12 December 2023. Microsoft reported that it matched or beat models up to 25 times larger on complex benchmarks, making it a reference point for small-model training.

Large language modelsOpen sourceReasoning

An open-weight sparse mixture-of-experts language model from Mistral AI, released in December 2023: 46.7B total parameters but 12.9B used per token, a 32k-token context, and results above Llama 2 70B on most benchmarks.

Large language modelsOpen sourceFoundation models

Google's second-generation text-to-image model, released in December 2023, whose standout feature was rendering legible text and logos inside generated images.

EnterpriseGenerative modelsCreative tools

GNoME is a Google DeepMind deep-learning tool, announced on 29 November 2023, that predicts new inorganic crystals; it produced 2.2 million candidate structures, of which 380,000 were predicted to be stable.

Deep learningData & datasetsScience

DeepSeek LLM is DeepSeek's first general-purpose language model series, released on 29 November 2023 in 7B and 67B sizes, each with a base version and a chat version.

Large language modelsOpen sourceChina

Claude 2.1, released on 21 November 2023, doubled the context window to 200,000 tokens and cut false statements by half compared with Claude 2.0. It added tool use and system prompts.

Large language modelsEnterpriseAgents & tool use

Stable Video Diffusion is Stability AI's image-to-video model, released on 21 November 2023 as a research preview that turns a single still image into a clip of a few seconds.

Open sourceMultimodalGenerative models

Lyria is Google DeepMind's family of music-generation models, first announced in November 2023. It writes instrumental and vocal music from prompts, carries inaudible SynthID watermarks, and has reached users through YouTube Shorts, Vertex AI and the Gemini API.

Consumer appsGenerative modelsCreative tools

GraphCast is a Google DeepMind machine-learning model that makes global weather forecasts up to 10 days ahead, producing a 10-day forecast in under a minute on a single TPU and outperforming ECMWF's HRES on most tested variables.

Open sourceDeep learningScience

GPT-4 Turbo is a cheaper, more capable version of OpenAI's GPT-4, announced on 6 November 2023 with a 128,000-token context window and lower API prices.

Large language modelsEnterpriseMultimodal

Grok-1 is xAI's first large language model, announced on 3 November 2023 as the engine of the Grok chatbot. Its 314-billion-parameter weights were released openly in March 2024.

Large language modelsOpen sourceFoundation models

DeepSeek's first model release: a family of open-source code models from 1.3B to 33B parameters, trained from scratch on 2 trillion tokens and reported to beat Codex and GPT-3.5 on several benchmarks.

Large language modelsOpen sourceChina

Yi-34B and Yi-6B are open bilingual base models from 01.AI, released in November 2023 and trained on 3 trillion tokens. Yi-34B ranked first among open pre-trained models at launch.

Large language modelsOpen sourceChina

iFlytek's Spark V3.0, released on 24 October 2023, is a large language model the company said beat GPT-3.5 in Chinese; it arrived with a domestic Huawei-built computing platform and twelve industry models.

Large language modelsChinaFoundation models

Fuyu-8B is a decoder-only multimodal model that Adept open-sourced in October 2023; it drops the image encoder, accepts arbitrary resolutions, and reads screens and charts.

Open sourceAgents & tool useMultimodal

ERNIE 4.0 is Baidu's foundation model unveiled in October 2023, pitched as its most capable model and, in Robin Li's words, "not inferior in any aspect to GPT-4". It anchors Baidu's ERNIE Bot assistant and Qianfan platform.

Large language modelsChinaEnterprise

PLaMo-13B is a 13-billion-parameter, LLaMA-based language model from Preferred Networks, pre-trained on English and Japanese open data and released on Hugging Face in September 2023 under the Apache-2.0 licence.

Large language modelsOpen sourceFoundation models

GPT-4V is a version of GPT-4 that accepts image input alongside text, documented in OpenAI's system card of 25 September 2023 and released to developers through preview API models; image understanding later became native in GPT-4o.

Large language modelsMultimodalSafety & governance

DALL·E 3 is OpenAI's image generation model announced on 20 September 2023 and released inside ChatGPT that October. It turned a user's idea into a detailed prompt before drawing, and was later replaced by GPT Image.

Consumer appsGenerative modelsCreative tools

Stable Audio, launched by Stability AI on 13 September 2023, is a text-to-music and sound generator that Stability describes as its first audio product, later joined by open and enterprise versions.

EnterpriseConsumer appsGenerative models

Phi-1.5 is a 1.3-billion-parameter language model from Microsoft Research, trained on curated synthetic "textbook" text rather than web crawls; its report claims natural-language performance comparable to models five times larger.

Large language modelsOpen sourceReasoning

Hunyuan is Tencent's first proprietary large foundation model, unveiled in September 2023 and offered to enterprises through Tencent Cloud. The line was later branded Hy.

Large language modelsChinaEnterprise

Baichuan 2 is the second-generation open model family from Baichuan, released on 6 September 2023 in 7B and 13B sizes. Commercial use required an application and was limited by user numbers.

Large language modelsOpen sourceChina

Qwen-VL is a family of vision-language models released in August 2023 that builds on the Qwen language model to caption images, answer questions about them, locate objects and read text, with open Base and Chat versions.

Open sourceChinaMultimodal

Code Llama is a family of coding models that Meta released in August 2023 by further training Llama 2 on code. It ranges from 7 billion to 70 billion parameters and uses the Llama 2 community license.

Large language modelsOpen sourceDeveloper tools

SparkDesk V2.0 is the second version of iFlytek's large language model, launched on 15 August 2023 with upgraded coding and multimodal abilities, and released alongside the iFlyCode 1.0 programming assistant.

Large language modelsChinaFoundation models

Qwen, known in Chinese as Tongyi Qianwen (通义千问), is Alibaba's family of large language models. Its first open-weight model, Qwen-7B, was released on 3 August 2023, and the family has grown through many later versions.

Large language modelsOpen sourceChina

Skylark, or Yunque (云雀), is ByteDance's first large language model. Released in August 2023, it powered the Doubao chatbot and was relaunched in May 2024 as the Doubao model family.

Large language modelsChinaFoundation models

RT-2 is a vision-language-action model from Google DeepMind, announced on 28 July 2023, that turns images and text instructions into robot actions written as text tokens. In over 6,000 trials it reached 62% on unseen scenarios, up from 32% for RT-1.

MultimodalRoboticsComputer vision

SDXL is Stability AI's open text-to-image diffusion model, announced in July 2023 with a 3.5B-parameter base model and a refiner stage, generating natively at 1024×1024. A distilled version, SDXL Turbo, cut generation down to a single step.

Open sourceGenerative modelsCreative tools

Claude 2 is the second major version of Anthropic's assistant model, released on 11 July 2023 with better performance and longer responses. It was the first Claude model open to the general public.

Large language modelsEnterpriseConsumer apps

Pangu-Weather is a three-dimensional deep-learning model for medium-range global weather forecasting, published in Nature in 2023; on reanalysis data it produced stronger forecasts than ECMWF's operational system across all tested variables.

ChinaDeep learningScience

An open-source 13-billion-parameter language model from Baichuan, released in Base and Chat versions in July 2023, trained on 1.4 trillion tokens and benchmarked against Meta's LLaMA-13B.

Large language modelsOpen sourceChina

Phi-1 is a 1.3-billion-parameter Transformer language model for Python from Microsoft Research, which showed that filtered and synthetic "textbook quality" training data can partly substitute for model and data scale.

Large language modelsOpen sourceData & datasets

ERNIE 3.5 is a Baidu large language model announced in June 2023 as the upgrade behind the ERNIE Bot chatbot, adding a plugin architecture and, according to Baidu, outperforming ChatGPT on several benchmarked abilities.

Large language modelsChinaConsumer apps

Baichuan-7B is an open-source, 7-billion-parameter language model for Chinese and English released in June 2023, the first model from Baichuan, trained on about 1.2 trillion tokens and evaluated on Chinese and English benchmarks.

Large language modelsOpen sourceChina

PaLM 2 is Google's second-generation Pathways language model, announced on 10 May 2023 in four sizes and used across more than 25 Google products, including Bard.

Large language modelsEnterpriseConsumer apps

SparkDesk is iFlytek's cognitive large model, unveiled on 6 May 2023 as the company's answer to ChatGPT in education and enterprise uses, built on Huawei Ascend chips and followed by rapid version updates through 2024.

Large language modelsChinaEnterprise

StarCoder is an open-access code language model of about 15.5 billion parameters, released on 4 May 2023 by the BigCode project led by Hugging Face and ServiceNow.

Large language modelsOpen sourceData & datasets

Stable LM is Stability AI's family of open language models, first released in April 2023 as 3B- and 7B-parameter alpha versions under licenses that allow commercial use of the base models and research-only use of the instruction-tuned ones.

Large language modelsOpen sourceFoundation models

Amazon Titan is a family of foundation models built by Amazon for Amazon Bedrock, covering text generation, embeddings and image generation. It was announced in 2023 and later succeeded by Amazon Nova.

Large language modelsEnterpriseCloud

SenseNova is SenseTime's family of foundation models, unveiled on 10 April 2023 with a chatbot, an image generator and an avatar video generator, first offered to government and corporate clients rather than the public.

Large language modelsChinaEnterprise