Models

SenseNova 4.0, announced on 8 February 2024, upgraded SenseTime's model family with 4K, 32K and 128K context versions, specialised models and a first multimodal tool-calling API.

Large language modelsChinaEnterprise

DeepSeekMath is a 7B-parameter open language model built for mathematical reasoning and released in 2024. It reached 51.7% on the competition-level MATH benchmark without external tools, and introduced GRPO, a reinforcement-learning algorithm that uses less memory than PPO.

Large language modelsOpen sourceChina

Yi-VL-34B and Yi-VL-6B are open vision-language models from 01.AI, released on 23 January 2024. They read images and text together and ranked first among open models on the MMMU and CMMMU benchmarks.

Open sourceChinaMultimodal

AlphaGeometry is a Google DeepMind system that pairs a neural language model with a symbolic deduction engine to solve olympiad geometry problems, reaching near gold-medal level on a benchmark of 30 problems.

Open sourceReasoningScience

FunSearch is a method that uses a pretrained large language model inside an evolutionary loop to search for programs that solve mathematical and computational problems, rather than for answers directly. It produced new results on the cap set problem and on online bin packing.

Deep learningReasoningScience

GNoME is a Google DeepMind deep-learning tool, announced on 29 November 2023, that predicts new inorganic crystals; it produced 2.2 million candidate structures, of which 380,000 were predicted to be stable.

Deep learningData & datasetsScience

Stable Video Diffusion is Stability AI's image-to-video model, released on 21 November 2023 as a research preview that turns a single still image into a clip of a few seconds.

Open sourceMultimodalGenerative models

GraphCast is a Google DeepMind machine-learning model that makes global weather forecasts up to 10 days ahead, producing a 10-day forecast in under a minute on a single TPU and outperforming ECMWF's HRES on most tested variables.

Open sourceDeep learningScience

GPT-4 Turbo is a cheaper, more capable version of OpenAI's GPT-4, announced on 6 November 2023 with a 128,000-token context window and lower API prices.

Large language modelsEnterpriseMultimodal

DeepSeek's first model release: a family of open-source code models from 1.3B to 33B parameters, trained from scratch on 2 trillion tokens and reported to beat Codex and GPT-3.5 on several benchmarks.

Large language modelsOpen sourceChina

Fuyu-8B is a decoder-only multimodal model that Adept open-sourced in October 2023; it drops the image encoder, accepts arbitrary resolutions, and reads screens and charts.

Open sourceAgents & tool useMultimodal

GPT-4V is a version of GPT-4 that accepts image input alongside text, documented in OpenAI's system card of 25 September 2023 and released to developers through preview API models; image understanding later became native in GPT-4o.

Large language modelsMultimodalSafety & governance

Hunyuan is Tencent's first proprietary large foundation model, unveiled in September 2023 and offered to enterprises through Tencent Cloud. The line was later branded Hy.

Large language modelsChinaEnterprise

Qwen-VL is a family of vision-language models released in August 2023 that builds on the Qwen language model to caption images, answer questions about them, locate objects and read text, with open Base and Chat versions.

Open sourceChinaMultimodal

Code Llama is a family of coding models that Meta released in August 2023 by further training Llama 2 on code. It ranges from 7 billion to 70 billion parameters and uses the Llama 2 community license.

Large language modelsOpen sourceDeveloper tools

SparkDesk V2.0 is the second version of iFlytek's large language model, launched on 15 August 2023 with upgraded coding and multimodal abilities, and released alongside the iFlyCode 1.0 programming assistant.

Large language modelsChinaFoundation models

RT-2 is a vision-language-action model from Google DeepMind, announced on 28 July 2023, that turns images and text instructions into robot actions written as text tokens. In over 6,000 trials it reached 62% on unseen scenarios, up from 32% for RT-1.

MultimodalRoboticsComputer vision

Pangu-Weather is a three-dimensional deep-learning model for medium-range global weather forecasting, published in Nature in 2023; on reanalysis data it produced stronger forecasts than ECMWF's operational system across all tested variables.

ChinaDeep learningScience

Phi-1 is a 1.3-billion-parameter Transformer language model for Python from Microsoft Research, which showed that filtered and synthetic "textbook quality" training data can partly substitute for model and data scale.

Large language modelsOpen sourceData & datasets

StarCoder is an open-access code language model of about 15.5 billion parameters, released on 4 May 2023 by the BigCode project led by Hugging Face and ServiceNow.

Large language modelsOpen sourceData & datasets

Amazon Titan is a family of foundation models built by Amazon for Amazon Bedrock, covering text generation, embeddings and image generation. It was announced in 2023 and later succeeded by Amazon Nova.

Large language modelsEnterpriseCloud

SenseNova is SenseTime's family of foundation models, unveiled on 10 April 2023 with a chatbot, an image generator and an avatar video generator, first offered to government and corporate clients rather than the public.

Large language modelsChinaEnterprise

Pythia is a suite of 16 open language models from EleutherAI, ranging from 70 million to 12 billion parameters, all trained on the same data in the same order, with 154 public checkpoints from each training run.

Large language modelsResearch historyOpen source

Runway Gen-2 is a multimodal video generation system announced in March 2023 that turns text, images or video clips into new video, and was among the first commercially available text-to-video models.

MultimodalGenerative modelsCreative tools

Runway Gen-1 is a video-to-video diffusion model released in February 2023 that restyles existing footage from text or image prompts while keeping the source video's structure. It was among the first commercially available video-generation models.

MultimodalGenerative modelsCreative tools

A pair of medical question-answering language models described in arXiv papers of 26 December 2022 and 16 May 2023; the first introduced the MultiMedQA benchmark, and Med-PaLM 2 reached up to 86.5% on MedQA.

Large language modelsSafety & governanceScience

RT-1 is a transformer-based model for real-world robot control, trained on over 130,000 episodes collected with 13 robots and reported to perform more than 700 language instructions at a 97% success rate.

Research historyFoundation modelsMultimodal

Galactica is a large language model for science, unveiled by Meta AI and Papers with Code in November 2022. Its public demo was taken down about three days later, after users found it produced fake papers.

Large language modelsResearch historyOpen source

Gato is a generalist agent from DeepMind, announced on 12 May 2022. A single network with one set of weights handles text, images, Atari games and robot control, aiming at multi-task, multi-embodiment learning.

Research historyAgents & tool useMultimodal

Flamingo is a DeepMind visual language model announced in April 2022. It takes prompts that mix images, videos and text and replies in language, learning new tasks from only a few examples.

Large language modelsResearch historyMultimodal

GPT-3.5 is the family of OpenAI language models between GPT-3 and GPT-4, released through API models such as text-davinci-002 and text-davinci-003 and underlying the first version of ChatGPT.

Large language modelsFoundation modelsProduct history

AlphaCode is a DeepMind code-generation system for competitive programming, announced in February 2022. On Codeforces contests held after its training data, it reached an estimated rank around the median participant. A Gemini-based AlphaCode 2 followed in December 2023.

Large language modelsResearch historyCode

RoseTTAFold is a three-track neural network for protein structure prediction, published by the Baker lab in 2021; its accuracy approached AlphaFold2's at CASP14, it models protein–protein complexes from sequence alone, and it is distributed as open code with a public web server.

Research historyOpen sourceDeep learning

An image-text model from OpenAI that learns to match pictures with their captions. Trained on about 400 million image-caption pairs, it can classify images by comparing them against written prompts, with no task-specific training.

Open sourceFoundation modelsMultimodal

AlphaFold2 is DeepMind's protein structure prediction system, announced in 2020. It reached accuracy competitive with experimental methods in many cases, and work in this area received half of the 2024 Nobel Prize in Chemistry.

Research historyDeep learningScience

DeepMind's first protein-structure prediction system, which placed first overall in the 2018 CASP13 blind assessment by estimating probability distributions of distances between residues.

Research historyDeep learningScience