Models

Robostral Navigate is Mistral AI's first embodied navigation model: an 8-billion-parameter system that steers wheeled, legged or flying robots from RGB images and a plain-language instruction, using a single ordinary camera and no depth sensor.

RoboticsComputer visionEurope

Released on 16 April 2026 at the same price as Opus 4.6, Claude Opus 4.7 added an xhigh effort level and accepted much larger images. It was the first model to test automatic blocking of high-risk cybersecurity requests.

Large language modelsAgents & tool useSafety & governance

EXAONE 4.5 is LG AI Research's first open-weight vision language model: a 33-billion-parameter model with a 1.2-billion-parameter vision encoder, trained on documents and text, with a 256K-token context window, released in April 2026.

Large language modelsOpen sourceFoundation models

Reka Edge is a 7-billion-parameter vision-language model from Reka AI, released on 11 March 2026, built to take images, video and text and to run locally on laptops, phones and small edge devices.

Open sourceMultimodalRobotics

Phi-4-reasoning-vision-15B is Microsoft's 15-billion-parameter open-weight vision-language model, released on 4 March 2026 under the MIT licence, built to switch between step-by-step reasoning for math and science and direct answers for image perception tasks.

Open sourceMultimodalReasoning

Molmo 2 is the second generation of Ai2's open vision-language models, released on 11 December 2025, which extends the Molmo line from still images to video with pointing, tracking and timestamped answers.

Open sourceMultimodalComputer vision

GWM-1 is Runway's first general world model: an autoregressive system that generates 720p video frame by frame in real time and can be steered with camera pose, robot commands or audio.

MultimodalRoboticsGenerative models

SAM 3 is Meta's segmentation model from November 2025. It finds, segments and tracks every instance of a concept named by a short text prompt or an example image, and Meta reported it doubles the accuracy of existing systems on this task.

Open sourceFoundation modelsData & datasets

Baidu's open-weight multimodal reasoning model from November 2025: 28B total parameters with 3B active per token, "Thinking with Images" zoom-and-tool reasoning, and Apache 2.0 weights.

Open sourceChinaMultimodal

DeepSeek-OCR is an open-source model of about 3B parameters that renders long text as 2D images and reads it back from a small number of vision tokens, testing whether optical compression can stand in for very long text contexts.

Open sourceChinaMultimodal

UI-TARS-2 is a GUI agent trained with multi-turn reinforcement learning and released in September 2025 as an all-in-one upgrade to UI-TARS-1.5, with benchmark scores across web, desktop, Android, games and software-engineering tasks.

ChinaAgents & tool useComputer vision

Qwen3-VL is Alibaba's open vision-language model family, released in September 2025 under Apache 2.0. Its 235B flagship handles long video, GUI operation and 2D and 3D grounding.

Open sourceChinaAgents & tool use

A vision-language model released by Zhipu on 11 August 2025, built on GLM-4.5-Air and covering image, video, long-document and GUI tasks; Zhipu reports state-of-the-art results at its scale on 42 benchmarks.

Open sourceChinaMultimodal

Genie 3 is Google DeepMind's general-purpose world model, announced on 5 August 2025. It turns text prompts into interactive 720p environments that can be navigated in real time at 24 frames per second, and was released as a limited research preview.

Agents & tool useGenerative modelsSimulation

Command A Vision is Cohere's first vision-language model in the Command family, released in July 2025. It pairs a 112-billion-parameter Command A language model with a SigLIP2 image encoder to read images, charts and documents and answer in text.

Large language modelsEnterpriseMultimodal

HunyuanWorld 1.0 is Tencent's open-source model for generating explorable, mesh-exportable 3D worlds from text or images. Released in July 2025, it was followed by a series of lighter and faster versions.

Open sourceChinaGenerative models

Skild Brain is Skild AI's general-purpose foundation model for robots, trained in a universe of 100,000 different machines and meant to be fitted to existing hardware rather than built for one task.

EnterpriseDeep learningFoundation models

Aurora is a foundation model for the Earth system, trained on more than a million hours of geophysical data. It outperforms operational forecasts for weather, air quality, ocean waves and tropical cyclone tracks at far lower computational cost.

Deep learningFoundation modelsScience

Falcon-H1 is a family of open-weight language models that runs Transformer attention and state space layers in parallel, released in sizes from 0.5B to 34B parameters under the Falcon-LLM Licence.

Large language modelsOpen sourceFoundation models

ByteDance Seed's GUI agent model from April 2025 and the successor to UI-TARS. Its 7B version is open-source under Apache-2.0, and the family reports state-of-the-art results on several screen-control benchmarks.

Open sourceChinaAgents & tool use

Kimi-VL is an open-source vision-language model from Moonshot AI, released in April 2025. It pairs a 16B-parameter mixture-of-experts language model with a native-resolution vision encoder, so only about 3B parameters are active at a time.

Open sourceChinaMultimodal

Isaac GR00T N1 is an open foundation model for humanoid robots that NVIDIA announced on 18 March 2025. It is designed to be post-trained for a specific robot or task, and it pairs a planning model with quick motion control.

Open sourceFoundation modelsRobotics

Gemini Robotics is a vision-language-action model from Google DeepMind, built on Gemini 2.0, that outputs physical actions to control robots. It was announced on 12 March 2025 alongside Gemini Robotics-ER.

MultimodalRoboticsComputer vision

Mistral OCR is a document-understanding API released by Mistral AI on 6 March 2025 that reads text, tables, equations and embedded media across thousands of scripts and languages, and was later superseded by newer OCR versions.

EnterpriseData & datasetsComputer vision

Cohere's first vision-language model, released in March 2025 as open-weight 8B and 32B versions. It handles images and text in 23 languages and, in Cohere's comparisons, beats several much larger models, under a non-commercial licence.

Large language modelsOpen sourceMultimodal

Hunyuan3D 2.0 is Tencent's large-scale system for generating high-resolution textured 3D assets: a shape diffusion transformer plus a texture model, released with code and pretrained models on 21 January 2025 alongside its technical report.

Open sourceChinaGenerative models

UI-TARS is a GUI agent model from ByteDance Seed: it takes only screenshots as input and outputs keyboard and mouse actions, reported state-of-the-art results on more than 10 benchmarks, and was released with open weights under Apache-2.0.

Open sourceChinaAgents & tool use

NVIDIA Cosmos is a platform of world foundation models that generate physics-based video to train robots and autonomous vehicles, released as open-weight models in January 2025.

Open sourceFoundation modelsRobotics

Qwen2.5-VL is Alibaba's vision-language model family released in January 2025 in 3B, 7B, 32B and 72B sizes. It reads charts and documents, localises objects, works as a visual agent and understands videos over an hour long.

Open sourceChinaAgents & tool use

A family of open mixture-of-experts vision-language models from DeepSeek, released in three sizes from 1.0B to 4.5B activated parameters for document, chart and OCR understanding, succeeding DeepSeek-VL.

Open sourceChinaMultimodal

Genie 2 is a foundation world model from Google DeepMind, announced on 4 December 2024, that turns a single prompt image into a playable 3D environment that a person or an AI agent can explore with keyboard and mouse controls.

Agents & tool useGenerative modelsSimulation

Pixtral Large is Mistral AI's open-weight multimodal model announced on 18 November 2024, built on Mistral Large 2, combining a 123B-parameter decoder with a 1B vision encoder and a 128K-token context window. It was retired in May 2026.

EnterpriseMultimodalComputer vision

A family of text-to-image models from Stability AI, announced in October 2024: the 8.1-billion-parameter Large, a 4-step Turbo variant and the 2.5-billion-parameter Medium, released under a community licence.

Open sourceGenerative modelsCreative tools

Molmo is a family of open vision-language models released by Ai2 on 25 September 2024 that can point at objects in images, with weights, code, data and evaluations published openly.

Open sourceMultimodalData & datasets

Llama 3.2, announced on 25 September 2024, added vision models at 11 billion and 90 billion parameters and small text-only models at 1 billion and 3 billion for edge and mobile devices.

Large language modelsOpen sourceMultimodal

Pixtral 12B is Mistral AI's first multimodal model, pairing a 12B language decoder with a 400M vision encoder. Released openly under Apache 2.0 in September 2024, it reads images at native resolution and was retired at the end of 2025.

Open sourceMultimodalComputer vision

NVLM is a family of multimodal large language models from NVIDIA, described in a paper posted to arXiv in September 2024; its flagship NVLM-D-72B was later released as open weights for non-commercial use.

Large language modelsOpen sourceMultimodal

Qwen2-VL is Alibaba's vision-language model released on 29 August 2024. It understands videos longer than 20 minutes, reads text in many languages, and can act as an agent on phones and robots.

Open sourceChinaAgents & tool use

SAM 2 is Meta's 2024 successor to the Segment Anything Model. It segments objects in both images and videos in real time, and its release included the SA-V video dataset.

Open sourceFoundation modelsData & datasets

Claude 3.5 Sonnet, released on 20 June 2024, was the first model of the Claude 3.5 family. It ran twice as fast as Claude 3 Opus at the mid-tier price and powered the new Artifacts and Projects features.

Large language modelsEnterpriseConsumer apps

OpenVLA is a 7-billion-parameter open-source vision-language-action model trained on 970,000 real robot demonstrations, released with checkpoints and code so that other groups can fine-tune and run it on their own robots.

Open sourceFoundation modelsMultimodal

Octo is an open-source generalist robot policy: a transformer-based diffusion model trained on 800,000 robot trajectories that can drive a range of robots out of the box and be fine-tuned to new setups.

Open sourceDeep learningFoundation models

Grok-1.5 is xAI's upgrade to Grok-1, with better reasoning and a 128,000-token context window. Its companion Grok-1.5V was xAI's first multimodal model. Neither model's weights were released publicly.

Large language modelsMultimodalReasoning

Step-1V is a roughly 100-billion-parameter multimodal model from StepFun, unveiled in March 2024, that reads text, data and charts in images and supports video understanding; it ranked first on OpenCompass at launch and was succeeded by Step-1.5V.

Large language modelsChinaMultimodal

Claude 3 Haiku is the smallest and fastest model in Anthropic's Claude 3 family, announced in March 2024 with low per-token pricing, a 200K-token context window and image input; retired in April 2026.

Large language modelsEnterpriseMultimodal

Claude 3 Sonnet was the middle model of Anthropic's Claude 3 family, announced on 4 March 2024. It powered the free tier of claude.ai, offered a 200K-token context window, and was retired on 21 July 2025.

Large language modelsEnterpriseConsumer apps

Claude 3 Opus, announced on 4 March 2024, was the most capable model in the Claude 3 family. It added vision and launched with a 200K-token context window and a Needle In A Haystack recall above 99%.

Large language modelsEnterpriseMultimodal

A Google DeepMind generative world model with 11 billion parameters that turns text, images or sketches into controllable virtual worlds, described as the first generative interactive environment trained on unlabelled internet videos without action labels.

Research historyGenerative modelsSimulation

Stable Diffusion 3, announced by Stability AI on 22 February 2024, is a suite of 800 million to 8 billion parameter models that pairs a diffusion transformer with flow matching.

Open sourceGenerative modelsCreative tools

Yi-VL-34B and Yi-VL-6B are open vision-language models from 01.AI, released on 23 January 2024. They read images and text together and ranked first among open models on the MMMU and CMMMU benchmarks.

Open sourceChinaMultimodal

GraphCast is a Google DeepMind machine-learning model that makes global weather forecasts up to 10 days ahead, producing a 10-day forecast in under a minute on a single TPU and outperforming ECMWF's HRES on most tested variables.

Open sourceDeep learningScience

Grok-1 is xAI's first large language model, announced on 3 November 2023 as the engine of the Grok chatbot. Its 314-billion-parameter weights were released openly in March 2024.

Large language modelsOpen sourceFoundation models

Fuyu-8B is a decoder-only multimodal model that Adept open-sourced in October 2023; it drops the image encoder, accepts arbitrary resolutions, and reads screens and charts.

Open sourceAgents & tool useMultimodal

GPT-4V is a version of GPT-4 that accepts image input alongside text, documented in OpenAI's system card of 25 September 2023 and released to developers through preview API models; image understanding later became native in GPT-4o.

Large language modelsMultimodalSafety & governance

Qwen-VL is a family of vision-language models released in August 2023 that builds on the Qwen language model to caption images, answer questions about them, locate objects and read text, with open Base and Chat versions.

Open sourceChinaMultimodal

RT-2 is a vision-language-action model from Google DeepMind, announced on 28 July 2023, that turns images and text instructions into robot actions written as text tokens. In over 6,000 trials it reached 62% on unseen scenarios, up from 32% for RT-1.

MultimodalRoboticsComputer vision