Models

A family of text-to-image models from Stability AI, announced in October 2024: the 8.1-billion-parameter Large, a 4-step Turbo variant and the 2.5-billion-parameter Medium, released under a community licence.

Open sourceGenerative modelsCreative tools

Movie Gen is a set of media foundation models Meta premiered on 4 October 2024. It covers video generation, personalised video, precise video editing and audio generation, and was not released publicly.

Foundation modelsGenerative modelsCreative tools

A closed text-to-image model from Black Forest Labs, released on 2 October 2024 and available only through an API. Black Forest Labs said it generates six times faster than its predecessor, and it reached the top of the Artificial Analysis image arena leaderboard.

Generative modelsCreative toolsImage generation

Kling 1.5 is a September 2024 version of Kuaishou's video generation model, adding 1080p output, a Motion Brush, and quality improvements before being succeeded by Kling 1.6 in December 2024.

ChinaMultimodalGenerative models

CogVideoX is an open-source family of text-to-video models from Zhipu AI and Tsinghua University, released starting in August 2024 and derived from the earlier open-source CogVideo.

Open sourceChinaGenerative models

FLUX.1 is a family of 12-billion-parameter text-to-image models released by Black Forest Labs on 1 August 2024 in pro, dev and schnell variants. The dev version is open-weight, and the variants carry different licenses.

Open sourceGenerative modelsCreative tools

Kolors is Kuaishou's open-weight text-to-image model, released on 6 July 2024, built on latent diffusion and tuned for both Chinese and English prompts.

Open sourceChinaGenerative models

ESM3 is a protein generative model announced by EvolutionaryScale in June 2024 that reasons over sequence, structure and function together, and generated a fluorescent protein estimated to sit over 500 million years of evolution away from known ones.

Open sourceFoundation modelsGenerative models

Runway's 2024 video generation model, trained jointly on video and images, with finer temporal control such as keyframing; later extended with an API, video-to-video and Act-One performance capture.

MultimodalGenerative modelsCreative tools

Veo is a generative video model from Google DeepMind, announced at Google I/O on 14 May 2024. Google described it as its most capable video model, able to produce 1080p clips longer than a minute and later succeeded by Veo 2.

MultimodalGenerative modelsCreative tools

Google's text-to-image model announced at I/O in May 2024, which Google described as its highest-quality image generator, with fewer visual artifacts and improved text rendering.

Generative modelsCreative toolsImage generation

Hunyuan-DiT is Tencent's open text-to-image diffusion transformer, built for fine-grained English and Chinese prompt understanding. Its 2024 report and weights were released publicly, and human evaluations placed it ahead of several open models but behind leading closed ones.

Open sourceChinaGenerative models

A Google DeepMind generative world model with 11 billion parameters that turns text, images or sketches into controllable virtual worlds, described as the first generative interactive environment trained on unlabelled internet videos without action labels.

Research historyGenerative modelsSimulation

Stable Diffusion 3, announced by Stability AI on 22 February 2024, is a suite of 800 million to 8 billion parameter models that pairs a diffusion transformer with flow matching.

Open sourceGenerative modelsCreative tools

Midjourney V6 is a version of Midjourney's image generation model, released in alpha on 21 December 2023 and trained from scratch over nine months; its 6.1 update followed in July 2024.

Consumer appsGenerative modelsCreative tools

Google's second-generation text-to-image model, released in December 2023, whose standout feature was rendering legible text and logos inside generated images.

EnterpriseGenerative modelsCreative tools

Stable Video Diffusion is Stability AI's image-to-video model, released on 21 November 2023 as a research preview that turns a single still image into a clip of a few seconds.

Open sourceMultimodalGenerative models

Lyria is Google DeepMind's family of music-generation models, first announced in November 2023. It writes instrumental and vocal music from prompts, carries inaudible SynthID watermarks, and has reached users through YouTube Shorts, Vertex AI and the Gemini API.

Consumer appsGenerative modelsCreative tools

DALL·E 3 is OpenAI's image generation model announced on 20 September 2023 and released inside ChatGPT that October. It turned a user's idea into a detailed prompt before drawing, and was later replaced by GPT Image.

Consumer appsGenerative modelsCreative tools

Stable Audio, launched by Stability AI on 13 September 2023, is a text-to-music and sound generator that Stability describes as its first audio product, later joined by open and enterprise versions.

EnterpriseConsumer appsGenerative models

SDXL is Stability AI's open text-to-image diffusion model, announced in July 2023 with a 3.5B-parameter base model and a refiner stage, generating natively at 1024×1024. A distilled version, SDXL Turbo, cut generation down to a single step.

Open sourceGenerative modelsCreative tools

Midjourney V5 is a version of the Midjourney text-to-image model, released in alpha on 15 March 2023 and refined through the 5.x line before being succeeded by V6 in December 2023.

Consumer appsGenerative modelsCreative tools

Runway Gen-2 is a multimodal video generation system announced in March 2023 that turns text, images or video clips into new video, and was among the first commercially available text-to-video models.

MultimodalGenerative modelsCreative tools

Runway Gen-1 is a video-to-video diffusion model released in February 2023 that restyles existing footage from text or image prompts while keeping the source video's structure. It was among the first commercially available video-generation models.

MultimodalGenerative modelsCreative tools

Stable Diffusion 2 is an open-source text-to-image model family released by Stability AI on 24 November 2022, built on a new OpenCLIP text encoder and shipped with upscaling, depth-guided and inpainting models; version 2.1 followed weeks later.

Open sourceGenerative modelsCreative tools

Midjourney V4 is the fourth-generation image generation model released in alpha on 5 November 2022. It was the first Midjourney model trained on Google TPUs, and reviewers described it as a large step up from V3.

Consumer appsGenerative modelsCreative tools

Midjourney V3, released on 25 July 2022, was the third model version of Midjourney; it raised image quality sharply by learning from how users behaved, and it produced the image that won a Colorado State Fair digital-art prize.

Consumer appsGenerative modelsCreative tools

Imagen is a text-to-image diffusion model announced by Google Research in May 2022, known for pairing a frozen large language model with diffusion and for the DrawBench benchmark; Google did not release it publicly.

Research historyGenerative modelsCreative tools

Midjourney V2 was the second model version of Midjourney's image generation model, released on 12 April 2022 and the default model until V3 arrived that July. Midjourney later described it as colorful and painterly but low in coherency.

Consumer appsGenerative modelsCreative tools

Midjourney V1 was Midjourney's first image-generation model, released in February 2022 and used through a bot on the company's Discord server. It produced abstract, painterly images and was replaced by V2 and V3 within months.

Consumer appsGenerative modelsCreative tools

A DeepMind generative model that predicts raw audio one sample at a time, bringing neural text-to-speech close to human quality and later powering Google Assistant and Cloud Text-to-Speech voices.

Research historyDeep learningConsumer apps