Models

OpenVLA is a 7-billion-parameter open-source vision-language-action model trained on 970,000 real robot demonstrations, released with checkpoints and code so that other groups can fine-tune and run it on their own robots.

Open sourceFoundation modelsMultimodal

Codestral is Mistral AI's family of code models, first released in May 2024 as an open-weight 22B-parameter model with a 32K context window, followed by faster and longer-context versions aimed at IDE code completion.

Large language modelsDeveloper toolsCode

Veo is a generative video model from Google DeepMind, announced at Google I/O on 14 May 2024. Google described it as its most capable video model, able to produce 1080p clips longer than a minute and later succeeded by Veo 2.

MultimodalGenerative modelsCreative tools

Google's text-to-image model announced at I/O in May 2024, which Google described as its highest-quality image generator, with fewer visual artifacts and improved text rendering.

Generative modelsCreative toolsImage generation

Octo is an open-source generalist robot policy: a transformer-based diffusion model trained on 800,000 robot trajectories that can drive a range of robots out of the box and be fine-tuned to new setups.

Open sourceDeep learningFoundation models

Snowflake's open-weight model with 480 billion total and 17 billion active parameters, built as a dense-MoE hybrid, released in April 2024 under Apache 2.0 and trained for under 2 million dollars.

Large language modelsOpen sourceEnterprise

Grok-1.5 is xAI's upgrade to Grok-1, with better reasoning and a 128,000-token context window. Its companion Grok-1.5V was xAI's first multimodal model. Neither model's weights were released publicly.

Large language modelsMultimodalReasoning

DBRX is Databricks' openly licensed large language model, a mixture-of-experts transformer with 132 billion total parameters and 36 billion active per token, announced on 27 March 2024.

Large language modelsOpen sourceEnterprise

Step-1V is a roughly 100-billion-parameter multimodal model from StepFun, unveiled in March 2024, that reads text, data and charts in images and supports video understanding; it ranked first on OpenCompass at launch and was succeeded by Step-1.5V.

Large language modelsChinaMultimodal

NVIDIA's project for a general-purpose foundation model for humanoid robots, announced in March 2024 and followed in March 2025 by Isaac GR00T N1, an open, customizable model released with training data and evaluation scenarios.

Foundation modelsRoboticsHumanoid robots

Claude 3 Haiku is the smallest and fastest model in Anthropic's Claude 3 family, announced in March 2024 with low per-token pricing, a 200K-token context window and image input; retired in April 2026.

Large language modelsEnterpriseMultimodal

Claude 3 Sonnet was the middle model of Anthropic's Claude 3 family, announced on 4 March 2024. It powered the free tier of claude.ai, offered a 200K-token context window, and was retired on 21 July 2025.

Large language modelsEnterpriseConsumer apps

Claude 3 Opus, announced on 4 March 2024, was the most capable model in the Claude 3 family. It added vision and launched with a 200K-token context window and a Needle In A Haystack recall above 99%.

Large language modelsEnterpriseMultimodal

StarCoder2 is a family of open code models in 3B, 7B and 15B sizes, released in February 2024 by BigCode (Hugging Face and ServiceNow) with NVIDIA and trained on The Stack v2, published together with its dataset and training code.

Large language modelsOpen sourceData & datasets

Stable Diffusion 3, announced by Stability AI on 22 February 2024, is a suite of 800 million to 8 billion parameter models that pairs a diffusion transformer with flow matching.

Open sourceGenerative modelsCreative tools

Yi-VL-34B and Yi-VL-6B are open vision-language models from 01.AI, released on 23 January 2024. They read images and text together and ranked first among open models on the MMMU and CMMMU benchmarks.

Open sourceChinaMultimodal

Midjourney V6 is a version of Midjourney's image generation model, released in alpha on 21 December 2023 and trained from scratch over nine months; its 6.1 update followed in July 2024.

Consumer appsGenerative modelsCreative tools

FunSearch is a method that uses a pretrained large language model inside an evolutionary loop to search for programs that solve mathematical and computational problems, rather than for answers directly. It produced new results on the cap set problem and on online bin packing.

Deep learningReasoningScience

Google's second-generation text-to-image model, released in December 2023, whose standout feature was rendering legible text and logos inside generated images.

EnterpriseGenerative modelsCreative tools

Stable Video Diffusion is Stability AI's image-to-video model, released on 21 November 2023 as a research preview that turns a single still image into a clip of a few seconds.

Open sourceMultimodalGenerative models

Lyria is Google DeepMind's family of music-generation models, first announced in November 2023. It writes instrumental and vocal music from prompts, carries inaudible SynthID watermarks, and has reached users through YouTube Shorts, Vertex AI and the Gemini API.

Consumer appsGenerative modelsCreative tools

DeepSeek's first model release: a family of open-source code models from 1.3B to 33B parameters, trained from scratch on 2 trillion tokens and reported to beat Codex and GPT-3.5 on several benchmarks.

Large language modelsOpen sourceChina

Fuyu-8B is a decoder-only multimodal model that Adept open-sourced in October 2023; it drops the image encoder, accepts arbitrary resolutions, and reads screens and charts.

Open sourceAgents & tool useMultimodal

GPT-4V is a version of GPT-4 that accepts image input alongside text, documented in OpenAI's system card of 25 September 2023 and released to developers through preview API models; image understanding later became native in GPT-4o.

Large language modelsMultimodalSafety & governance

DALL·E 3 is OpenAI's image generation model announced on 20 September 2023 and released inside ChatGPT that October. It turned a user's idea into a detailed prompt before drawing, and was later replaced by GPT Image.

Consumer appsGenerative modelsCreative tools

Stable Audio, launched by Stability AI on 13 September 2023, is a text-to-music and sound generator that Stability describes as its first audio product, later joined by open and enterprise versions.

EnterpriseConsumer appsGenerative models

Qwen-VL is a family of vision-language models released in August 2023 that builds on the Qwen language model to caption images, answer questions about them, locate objects and read text, with open Base and Chat versions.

Open sourceChinaMultimodal

Code Llama is a family of coding models that Meta released in August 2023 by further training Llama 2 on code. It ranges from 7 billion to 70 billion parameters and uses the Llama 2 community license.

Large language modelsOpen sourceDeveloper tools

SparkDesk V2.0 is the second version of iFlytek's large language model, launched on 15 August 2023 with upgraded coding and multimodal abilities, and released alongside the iFlyCode 1.0 programming assistant.

Large language modelsChinaFoundation models

RT-2 is a vision-language-action model from Google DeepMind, announced on 28 July 2023, that turns images and text instructions into robot actions written as text tokens. In over 6,000 trials it reached 62% on unseen scenarios, up from 32% for RT-1.

MultimodalRoboticsComputer vision

SDXL is Stability AI's open text-to-image diffusion model, announced in July 2023 with a 3.5B-parameter base model and a refiner stage, generating natively at 1024×1024. A distilled version, SDXL Turbo, cut generation down to a single step.

Open sourceGenerative modelsCreative tools

Phi-1 is a 1.3-billion-parameter Transformer language model for Python from Microsoft Research, which showed that filtered and synthetic "textbook quality" training data can partly substitute for model and data scale.

Large language modelsOpen sourceData & datasets

StarCoder is an open-access code language model of about 15.5 billion parameters, released on 4 May 2023 by the BigCode project led by Hugging Face and ServiceNow.

Large language modelsOpen sourceData & datasets

Midjourney V5 is a version of the Midjourney text-to-image model, released in alpha on 15 March 2023 and refined through the 5.x line before being succeeded by V6 in December 2023.

Consumer appsGenerative modelsCreative tools

Runway Gen-2 is a multimodal video generation system announced in March 2023 that turns text, images or video clips into new video, and was among the first commercially available text-to-video models.

MultimodalGenerative modelsCreative tools

Runway Gen-1 is a video-to-video diffusion model released in February 2023 that restyles existing footage from text or image prompts while keeping the source video's structure. It was among the first commercially available video-generation models.

MultimodalGenerative modelsCreative tools

RT-1 is a transformer-based model for real-world robot control, trained on over 130,000 episodes collected with 13 robots and reported to perform more than 700 language instructions at a 97% success rate.

Research historyFoundation modelsMultimodal

Stable Diffusion 2 is an open-source text-to-image model family released by Stability AI on 24 November 2022, built on a new OpenCLIP text encoder and shipped with upscaling, depth-guided and inpainting models; version 2.1 followed weeks later.

Open sourceGenerative modelsCreative tools

Midjourney V4 is the fourth-generation image generation model released in alpha on 5 November 2022. It was the first Midjourney model trained on Google TPUs, and reviewers described it as a large step up from V3.

Consumer appsGenerative modelsCreative tools

Midjourney V3, released on 25 July 2022, was the third model version of Midjourney; it raised image quality sharply by learning from how users behaved, and it produced the image that won a Colorado State Fair digital-art prize.

Consumer appsGenerative modelsCreative tools

Imagen is a text-to-image diffusion model announced by Google Research in May 2022, known for pairing a frozen large language model with diffusion and for the DrawBench benchmark; Google did not release it publicly.

Research historyGenerative modelsCreative tools

Gato is a generalist agent from DeepMind, announced on 12 May 2022. A single network with one set of weights handles text, images, Atari games and robot control, aiming at multi-task, multi-embodiment learning.

Research historyAgents & tool useMultimodal

Flamingo is a DeepMind visual language model announced in April 2022. It takes prompts that mix images, videos and text and replies in language, learning new tasks from only a few examples.

Large language modelsResearch historyMultimodal

Midjourney V2 was the second model version of Midjourney's image generation model, released on 12 April 2022 and the default model until V3 arrived that July. Midjourney later described it as colorful and painterly but low in coherency.

Consumer appsGenerative modelsCreative tools

GPT-3.5 is the family of OpenAI language models between GPT-3 and GPT-4, released through API models such as text-davinci-002 and text-davinci-003 and underlying the first version of ChatGPT.

Large language modelsFoundation modelsProduct history

AlphaCode is a DeepMind code-generation system for competitive programming, announced in February 2022. On Codeforces contests held after its training data, it reached an estimated rank around the median participant. A Gemini-based AlphaCode 2 followed in December 2023.

Large language modelsResearch historyCode

Midjourney V1 was Midjourney's first image-generation model, released in February 2022 and used through a bot on the company's Discord server. It produced abstract, painterly images and was replaced by V2 and V3 within months.

Consumer appsGenerative modelsCreative tools

An image-text model from OpenAI that learns to match pictures with their captions. Trained on about 400 million image-caption pairs, it can classify images by comparing them against written prompts, with no task-specific training.

Open sourceFoundation modelsMultimodal

AlexNet is the eight-layer convolutional network that won the ILSVRC2012 image classification task by a wide margin, showing that a large network trained on a large labelled dataset with GPUs could beat hand-designed features.

Research historyDeep learningComputer vision