Models

An open-source mixture-of-experts code model from DeepSeek, released in June 2024, that widened language coverage and context length over its predecessor and reported benchmark results above several closed models.

Large language modelsOpen sourceChina

OpenVLA is a 7-billion-parameter open-source vision-language-action model trained on 970,000 real robot demonstrations, released with checkpoints and code so that other groups can fine-tune and run it on their own robots.

Open sourceFoundation modelsMultimodal

Codestral is Mistral AI's family of code models, first released in May 2024 as an open-weight 22B-parameter model with a 32K context window, followed by faster and longer-context versions aimed at IDE code completion.

Large language modelsDeveloper toolsCode

Octo is an open-source generalist robot policy: a transformer-based diffusion model trained on 800,000 robot trajectories that can drive a range of robots out of the box and be fine-tuned to new setups.

Open sourceDeep learningFoundation models

Snowflake's open-weight model with 480 billion total and 17 billion active parameters, built as a dense-MoE hybrid, released in April 2024 under Apache 2.0 and trained for under 2 million dollars.

Large language modelsOpen sourceEnterprise

Cohere's 104-billion-parameter language model, announced in April 2024, is tuned for retrieval-augmented generation and multi-step tool use in business settings; it launched first on Microsoft Azure and was also released as open weights.

Large language modelsEnterpriseAgents & tool use

DBRX is Databricks' openly licensed large language model, a mixture-of-experts transformer with 132 billion total parameters and 36 billion active per token, announced on 27 March 2024.

Large language modelsOpen sourceEnterprise

NVIDIA's project for a general-purpose foundation model for humanoid robots, announced in March 2024 and followed in March 2025 by Isaac GR00T N1, an open, customizable model released with training data and evaluation scenarios.

Foundation modelsRoboticsHumanoid robots

StarCoder2 is a family of open code models in 3B, 7B and 15B sizes, released in February 2024 by BigCode (Hugging Face and ServiceNow) with NVIDIA and trained on The Stack v2, published together with its dataset and training code.

Large language modelsOpen sourceData & datasets

Mistral Large is the French company Mistral AI's first flagship proprietary large language model, released on 26 February 2024 with a 32K-token context window, native fluency in five languages, and built-in function calling and JSON output.

Large language modelsEnterpriseCloud

Spark V3.5 is a large language model that iFlytek released on 30 January 2024. It was the first Spark model trained entirely on the domestic FlyingStar One computing platform, and iFlytek compared it with GPT-4 Turbo.

Large language modelsChinaFoundation models

FunSearch is a method that uses a pretrained large language model inside an evolutionary loop to search for programs that solve mathematical and computational problems, rather than for answers directly. It produced new results on the cap set problem and on online bin packing.

Deep learningReasoningScience

DeepSeek's first model release: a family of open-source code models from 1.3B to 33B parameters, trained from scratch on 2 trillion tokens and reported to beat Codex and GPT-3.5 on several benchmarks.

Large language modelsOpen sourceChina

Hunyuan is Tencent's first proprietary large foundation model, unveiled in September 2023 and offered to enterprises through Tencent Cloud. The line was later branded Hy.

Large language modelsChinaEnterprise

Code Llama is a family of coding models that Meta released in August 2023 by further training Llama 2 on code. It ranges from 7 billion to 70 billion parameters and uses the Llama 2 community license.

Large language modelsOpen sourceDeveloper tools

SparkDesk V2.0 is the second version of iFlytek's large language model, launched on 15 August 2023 with upgraded coding and multimodal abilities, and released alongside the iFlyCode 1.0 programming assistant.

Large language modelsChinaFoundation models

RT-2 is a vision-language-action model from Google DeepMind, announced on 28 July 2023, that turns images and text instructions into robot actions written as text tokens. In over 6,000 trials it reached 62% on unseen scenarios, up from 32% for RT-1.

MultimodalRoboticsComputer vision

Phi-1 is a 1.3-billion-parameter Transformer language model for Python from Microsoft Research, which showed that filtered and synthetic "textbook quality" training data can partly substitute for model and data scale.

Large language modelsOpen sourceData & datasets

StarCoder is an open-access code language model of about 15.5 billion parameters, released on 4 May 2023 by the BigCode project led by Hugging Face and ServiceNow.

Large language modelsOpen sourceData & datasets

Amazon Titan is a family of foundation models built by Amazon for Amazon Bedrock, covering text generation, embeddings and image generation. It was announced in 2023 and later succeeded by Amazon Nova.

Large language modelsEnterpriseCloud

RT-1 is a transformer-based model for real-world robot control, trained on over 130,000 episodes collected with 13 robots and reported to perform more than 700 language instructions at a 97% success rate.

Research historyFoundation modelsMultimodal

Gato is a generalist agent from DeepMind, announced on 12 May 2022. A single network with one set of weights handles text, images, Atari games and robot control, aiming at multi-task, multi-embodiment learning.

Research historyAgents & tool useMultimodal

GPT-3.5 is the family of OpenAI language models between GPT-3 and GPT-4, released through API models such as text-davinci-002 and text-davinci-003 and underlying the first version of ChatGPT.

Large language modelsFoundation modelsProduct history

AlphaCode is a DeepMind code-generation system for competitive programming, announced in February 2022. On Codeforces contests held after its training data, it reached an estimated rank around the median participant. A Gemini-based AlphaCode 2 followed in December 2023.

Large language modelsResearch historyCode

Megatron-Turing NLG 530B is a 530-billion-parameter language model announced by NVIDIA and Microsoft on 11 October 2021, then the largest monolithic transformer language model, trained on NVIDIA's Selene supercomputer with Megatron-LM and DeepSpeed combined.

Large language modelsFoundation modelsHardware & compute

IBM's chess computer that in May 1997 became the first computer system to defeat a reigning world chess champion in a match under standard tournament time controls.

Research historyProduct historyHardware & compute