Models

Lyria is Google DeepMind's family of music-generation models, first announced in November 2023. It writes instrumental and vocal music from prompts, carries inaudible SynthID watermarks, and has reached users through YouTube Shorts, Vertex AI and the Gemini API.

Consumer appsGenerative modelsCreative tools

DALL·E 3 is OpenAI's image generation model announced on 20 September 2023 and released inside ChatGPT that October. It turned a user's idea into a detailed prompt before drawing, and was later replaced by GPT Image.

Consumer appsGenerative modelsCreative tools

Stable Audio, launched by Stability AI on 13 September 2023, is a text-to-music and sound generator that Stability describes as its first audio product, later joined by open and enterprise versions.

EnterpriseConsumer appsGenerative models

Phi-1.5 is a 1.3-billion-parameter language model from Microsoft Research, trained on curated synthetic "textbook" text rather than web crawls; its report claims natural-language performance comparable to models five times larger.

Large language modelsOpen sourceReasoning

RT-2 is a vision-language-action model from Google DeepMind, announced on 28 July 2023, that turns images and text instructions into robot actions written as text tokens. In over 6,000 trials it reached 62% on unseen scenarios, up from 32% for RT-1.

MultimodalRoboticsComputer vision

SDXL is Stability AI's open text-to-image diffusion model, announced in July 2023 with a 3.5B-parameter base model and a refiner stage, generating natively at 1024×1024. A distilled version, SDXL Turbo, cut generation down to a single step.

Open sourceGenerative modelsCreative tools

Phi-1 is a 1.3-billion-parameter Transformer language model for Python from Microsoft Research, which showed that filtered and synthetic "textbook quality" training data can partly substitute for model and data scale.

Large language modelsOpen sourceData & datasets

StarCoder is an open-access code language model of about 15.5 billion parameters, released on 4 May 2023 by the BigCode project led by Hugging Face and ServiceNow.

Large language modelsOpen sourceData & datasets

Midjourney V5 is a version of the Midjourney text-to-image model, released in alpha on 15 March 2023 and refined through the 5.x line before being succeeded by V6 in December 2023.

Consumer appsGenerative modelsCreative tools

Runway Gen-2 is a multimodal video generation system announced in March 2023 that turns text, images or video clips into new video, and was among the first commercially available text-to-video models.

MultimodalGenerative modelsCreative tools

Runway Gen-1 is a video-to-video diffusion model released in February 2023 that restyles existing footage from text or image prompts while keeping the source video's structure. It was among the first commercially available video-generation models.

MultimodalGenerative modelsCreative tools

RT-1 is a transformer-based model for real-world robot control, trained on over 130,000 episodes collected with 13 robots and reported to perform more than 700 language instructions at a 97% success rate.

Research historyFoundation modelsMultimodal

Stable Diffusion 2 is an open-source text-to-image model family released by Stability AI on 24 November 2022, built on a new OpenCLIP text encoder and shipped with upscaling, depth-guided and inpainting models; version 2.1 followed weeks later.

Open sourceGenerative modelsCreative tools

Midjourney V4 is the fourth-generation image generation model released in alpha on 5 November 2022. It was the first Midjourney model trained on Google TPUs, and reviewers described it as a large step up from V3.

Consumer appsGenerative modelsCreative tools

Midjourney V3, released on 25 July 2022, was the third model version of Midjourney; it raised image quality sharply by learning from how users behaved, and it produced the image that won a Colorado State Fair digital-art prize.

Consumer appsGenerative modelsCreative tools

Imagen is a text-to-image diffusion model announced by Google Research in May 2022, known for pairing a frozen large language model with diffusion and for the DrawBench benchmark; Google did not release it publicly.

Research historyGenerative modelsCreative tools

Gato is a generalist agent from DeepMind, announced on 12 May 2022. A single network with one set of weights handles text, images, Atari games and robot control, aiming at multi-task, multi-embodiment learning.

Research historyAgents & tool useMultimodal

Midjourney V2 was the second model version of Midjourney's image generation model, released on 12 April 2022 and the default model until V3 arrived that July. Midjourney later described it as colorful and painterly but low in coherency.

Consumer appsGenerative modelsCreative tools

Midjourney V1 was Midjourney's first image-generation model, released in February 2022 and used through a bot on the company's Discord server. It produced abstract, painterly images and was replaced by V2 and V3 within months.

Consumer appsGenerative modelsCreative tools

T5 is a family of Google Transformer models that recasts every language task as text in, text out. Its 11-billion-parameter version set state of the art on several benchmarks, and the code, models and C4 dataset were released openly.

Large language modelsOpen sourceFoundation models

A DeepMind generative model that predicts raw audio one sample at a time, bringing neural text-to-speech close to human quality and later powering Google Assistant and Cloud Text-to-Speech voices.

Research historyDeep learningConsumer apps

IBM Watson is a question-answering computer system built by an IBM research team led by David Ferrucci; in February 2011 it defeated the two foremost all-time champions of the televised quiz show Jeopardy!

Research historyEnterpriseReasoning