Models

Mistral OCR is a document-understanding API released by Mistral AI on 6 March 2025 that reads text, tables, equations and embedded media across thousands of scripts and languages, and was later superseded by newer OCR versions.

EnterpriseData & datasetsComputer vision

Wan2.1 is Alibaba's open-source video generation model family, released on 25 February 2025 under Apache 2.0. It creates videos from text or images and can render Chinese and English text.

Open sourceChinaGenerative models

Step-Audio is an open family of speech-interaction models released by StepFun on 17 February 2025. It includes Step-Audio-Chat, with 130 billion parameters, and Step-Audio-TTS-3B.

Open sourceChinaMultimodal

Step-Video-T2V is an open text-to-video model with 30 billion parameters. StepFun released its weights, code, a Turbo variant and a technical report under the MIT license on 17 February 2025.

Open sourceChinaGenerative models

Hunyuan3D 2.0 is Tencent's large-scale system for generating high-resolution textured 3D assets: a shape diffusion transformer plus a texture model, released with code and pretrained models on 21 January 2025 alongside its technical report.

Open sourceChinaGenerative models

NVIDIA Cosmos is a platform of world foundation models that generate physics-based video to train robots and autonomous vehicles, released as open-weight models in January 2025.

Open sourceFoundation modelsRobotics

Veo 2 is a video-generation model Google announced on 16 December 2024, emphasising real-world physics and human movement, with outputs up to 4K that can extend to minutes.

MultimodalGenerative modelsCreative tools

Phi-4 is Microsoft's 14-billion-parameter dense decoder-only language model, built with a data-quality-first recipe heavy on synthetic data and released with full weights under the MIT licence in January 2025.

Large language modelsOpen sourceReasoning

Genie 2 is a foundation world model from Google DeepMind, announced on 4 December 2024, that turns a single prompt image into a playable 3D environment that a person or an AI agent can explore with keyboard and mouse controls.

Agents & tool useGenerative modelsSimulation

HunyuanVideo is Tencent's open-source text-to-video generation model, with over 13 billion parameters, released in December 2024. Running it locally needs at least 60GB of GPU memory.

Open sourceChinaMultimodal

Amazon Nova is Amazon's family of foundation models, introduced on 3 December 2024 and offered exclusively in Amazon Bedrock. It spans text understanding models from Micro to Pro, plus Canvas for images and Reel for video, and was succeeded by Nova 2 in December 2025.

Large language modelsEnterpriseMultimodal

Kling 1.6 is a December 2024 upgrade to Kuaishou's Kling video generation model, with better handling of motion and camera instructions in prompts and improved visual quality; it was succeeded by Kling 2.0 in April 2025.

ChinaMultimodalGenerative models

OLMo 2 is the second generation of the Allen Institute for AI's fully open language model family, released in 7B and 13B sizes with weights, data, code and training recipes all public.

Large language modelsOpen sourceData & datasets

SmolLM2 is Hugging Face's second family of small language models, released in November 2024 at 135M, 360M and 1.7B parameters, with open weights and a data-centric training recipe.

Large language modelsOpen sourceConsumer apps

π0 is a generalist robot policy from Physical Intelligence, built by adapting a 3-billion-parameter vision-language model with flow matching so one model can output fast, continuous motor commands for dexterous manipulation.

Deep learningFoundation modelsMultimodal

A family of text-to-image models from Stability AI, announced in October 2024: the 8.1-billion-parameter Large, a 4-step Turbo variant and the 2.5-billion-parameter Medium, released under a community licence.

Open sourceGenerative modelsCreative tools

Movie Gen is a set of media foundation models Meta premiered on 4 October 2024. It covers video generation, personalised video, precise video editing and audio generation, and was not released publicly.

Foundation modelsGenerative modelsCreative tools

A closed text-to-image model from Black Forest Labs, released on 2 October 2024 and available only through an API. Black Forest Labs said it generates six times faster than its predecessor, and it reached the top of the Artificial Analysis image arena leaderboard.

Generative modelsCreative toolsImage generation

Molmo is a family of open vision-language models released by Ai2 on 25 September 2024 that can point at objects in images, with weights, code, data and evaluations published openly.

Open sourceMultimodalData & datasets

Kling 1.5 is a September 2024 version of Kuaishou's video generation model, adding 1080p output, a Motion Brush, and quality improvements before being succeeded by Kling 1.6 in December 2024.

ChinaMultimodalGenerative models

CogVideoX is an open-source family of text-to-video models from Zhipu AI and Tsinghua University, released starting in August 2024 and derived from the earlier open-source CogVideo.

Open sourceChinaGenerative models

FLUX.1 is a family of 12-billion-parameter text-to-image models released by Black Forest Labs on 1 August 2024 in pro, dev and schnell variants. The dev version is open-weight, and the variants carry different licenses.

Open sourceGenerative modelsCreative tools

SAM 2 is Meta's 2024 successor to the Segment Anything Model. It segments objects in both images and videos in real time, and its release included the SA-V video dataset.

Open sourceFoundation modelsData & datasets

SmolLM is a family of small language models with 135M, 360M and 1.7B parameters, released openly by Hugging Face in July 2024 for on-device use and trained on a purpose-built corpus of generated textbooks, code and filtered web text.

Large language modelsOpen sourceConsumer apps

Kolors is Kuaishou's open-weight text-to-image model, released on 6 July 2024, built on latent diffusion and tuned for both Chinese and English prompts.

Open sourceChinaGenerative models

ESM3 is a protein generative model announced by EvolutionaryScale in June 2024 that reasons over sequence, structure and function together, and generated a fluorescent protein estimated to sit over 500 million years of evolution away from known ones.

Open sourceFoundation modelsGenerative models

Runway's 2024 video generation model, trained jointly on video and images, with finer temporal control such as keyframing; later extended with an API, video-to-video and Act-One performance capture.

MultimodalGenerative modelsCreative tools

Nemotron-4 340B is a family of open models from NVIDIA, released on 14 June 2024 as base, instruct and reward models. It was built to generate synthetic data for training other language models, and it fits on a single eight-GPU DGX H100.

Large language modelsOpen sourceEnterprise

OpenVLA is a 7-billion-parameter open-source vision-language-action model trained on 970,000 real robot demonstrations, released with checkpoints and code so that other groups can fine-tune and run it on their own robots.

Open sourceFoundation modelsMultimodal

Veo is a generative video model from Google DeepMind, announced at Google I/O on 14 May 2024. Google described it as its most capable video model, able to produce 1080p clips longer than a minute and later succeeded by Veo 2.

MultimodalGenerative modelsCreative tools

Google's text-to-image model announced at I/O in May 2024, which Google described as its highest-quality image generator, with fewer visual artifacts and improved text rendering.

Generative modelsCreative toolsImage generation

Hunyuan-DiT is Tencent's open text-to-image diffusion transformer, built for fine-grained English and Chinese prompt understanding. Its 2024 report and weights were released publicly, and human evaluations placed it ahead of several open models but behind leading closed ones.

Open sourceChinaGenerative models

Octo is an open-source generalist robot policy: a transformer-based diffusion model trained on 800,000 robot trajectories that can drive a range of robots out of the box and be fine-tuned to new setups.

Open sourceDeep learningFoundation models

OpenELM is a family of small open language models from Apple, published in four sizes from 270M to 3B parameters with its training framework, logs, checkpoints and MLX conversion code.

Large language modelsResearch historyOpen source

StarCoder2 is a family of open code models in 3B, 7B and 15B sizes, released in February 2024 by BigCode (Hugging Face and ServiceNow) with NVIDIA and trained on The Stack v2, published together with its dataset and training code.

Large language modelsOpen sourceData & datasets

A Google DeepMind generative world model with 11 billion parameters that turns text, images or sketches into controllable virtual worlds, described as the first generative interactive environment trained on unlabelled internet videos without action labels.

Research historyGenerative modelsSimulation

Stable Diffusion 3, announced by Stability AI on 22 February 2024, is a suite of 800 million to 8 billion parameter models that pairs a diffusion transformer with flow matching.

Open sourceGenerative modelsCreative tools

Aya 101 is a 13-billion-parameter, instruction-tuned language model from Cohere For AI that follows instructions in 101 languages. It was released under Apache 2.0 in February 2024.

Large language modelsOpen sourceFoundation models

Midjourney V6 is a version of Midjourney's image generation model, released in alpha on 21 December 2023 and trained from scratch over nine months; its 6.1 update followed in July 2024.

Consumer appsGenerative modelsCreative tools

Phi-2 is a 2.7-billion-parameter base language model from Microsoft Research, announced on 12 December 2023. Microsoft reported that it matched or beat models up to 25 times larger on complex benchmarks, making it a reference point for small-model training.

Large language modelsOpen sourceReasoning

Google's second-generation text-to-image model, released in December 2023, whose standout feature was rendering legible text and logos inside generated images.

EnterpriseGenerative modelsCreative tools

GNoME is a Google DeepMind deep-learning tool, announced on 29 November 2023, that predicts new inorganic crystals; it produced 2.2 million candidate structures, of which 380,000 were predicted to be stable.

Deep learningData & datasetsScience

Stable Video Diffusion is Stability AI's image-to-video model, released on 21 November 2023 as a research preview that turns a single still image into a clip of a few seconds.

Open sourceMultimodalGenerative models

Lyria is Google DeepMind's family of music-generation models, first announced in November 2023. It writes instrumental and vocal music from prompts, carries inaudible SynthID watermarks, and has reached users through YouTube Shorts, Vertex AI and the Gemini API.

Consumer appsGenerative modelsCreative tools

GraphCast is a Google DeepMind machine-learning model that makes global weather forecasts up to 10 days ahead, producing a 10-day forecast in under a minute on a single TPU and outperforming ECMWF's HRES on most tested variables.

Open sourceDeep learningScience

Grok-1 is xAI's first large language model, announced on 3 November 2023 as the engine of the Grok chatbot. Its 314-billion-parameter weights were released openly in March 2024.

Large language modelsOpen sourceFoundation models

DALL·E 3 is OpenAI's image generation model announced on 20 September 2023 and released inside ChatGPT that October. It turned a user's idea into a detailed prompt before drawing, and was later replaced by GPT Image.

Consumer appsGenerative modelsCreative tools

Stable Audio, launched by Stability AI on 13 September 2023, is a text-to-music and sound generator that Stability describes as its first audio product, later joined by open and enterprise versions.

EnterpriseConsumer appsGenerative models

Phi-1.5 is a 1.3-billion-parameter language model from Microsoft Research, trained on curated synthetic "textbook" text rather than web crawls; its report claims natural-language performance comparable to models five times larger.

Large language modelsOpen sourceReasoning

RT-2 is a vision-language-action model from Google DeepMind, announced on 28 July 2023, that turns images and text instructions into robot actions written as text tokens. In over 6,000 trials it reached 62% on unseen scenarios, up from 32% for RT-1.

MultimodalRoboticsComputer vision

SDXL is Stability AI's open text-to-image diffusion model, announced in July 2023 with a 3.5B-parameter base model and a refiner stage, generating natively at 1024×1024. A distilled version, SDXL Turbo, cut generation down to a single step.

Open sourceGenerative modelsCreative tools

Pangu-Weather is a three-dimensional deep-learning model for medium-range global weather forecasting, published in Nature in 2023; on reanalysis data it produced stronger forecasts than ECMWF's operational system across all tested variables.

ChinaDeep learningScience