Models

Robostral Navigate is Mistral AI's first embodied navigation model: an 8-billion-parameter system that steers wheeled, legged or flying robots from RGB images and a plain-language instruction, using a single ordinary camera and no depth sensor.

RoboticsComputer visionEurope

Released on 16 April 2026 at the same price as Opus 4.6, Claude Opus 4.7 added an xhigh effort level and accepted much larger images. It was the first model to test automatic blocking of high-risk cybersecurity requests.

Large language modelsAgents & tool useSafety & governance

EXAONE 4.5 is LG AI Research's first open-weight vision language model: a 33-billion-parameter model with a 1.2-billion-parameter vision encoder, trained on documents and text, with a 256K-token context window, released in April 2026.

Large language modelsOpen sourceFoundation models

Reka Edge is a 7-billion-parameter vision-language model from Reka AI, released on 11 March 2026, built to take images, video and text and to run locally on laptops, phones and small edge devices.

Open sourceMultimodalRobotics

Ai2's fully open 7B model, which mixes Transformer attention with Gated DeltaNet linear recurrent layers and matches its predecessor's MMLU accuracy using 49% fewer training tokens.

Large language modelsOpen sourceDeep learning

Phi-4-reasoning-vision-15B is Microsoft's 15-billion-parameter open-weight vision-language model, released on 4 March 2026 under the MIT licence, built to switch between step-by-step reasoning for math and science and direct answers for image perception tasks.

Open sourceMultimodalReasoning

NVIDIA Nemotron 3 is an open family of hybrid mixture-of-experts language models, announced in December 2025 in Nano, Super and Ultra sizes, with up to one million tokens of context.

Large language modelsOpen sourceAgents & tool use

Molmo 2 is the second generation of Ai2's open vision-language models, released on 11 December 2025, which extends the Molmo line from still images to video with pointing, tracking and timestamped answers.

Open sourceMultimodalComputer vision

Olmo 3 is the third generation of the Allen Institute for AI's fully open language models, announced on 20 November 2025 in 7B and 32B dense Transformer sizes, with a 65,536-token context and all datasets openly available.

Large language modelsOpen sourceReasoning

SAM 3 is Meta's segmentation model from November 2025. It finds, segments and tracks every instance of a concept named by a short text prompt or an example image, and Meta reported it doubles the accuracy of existing systems on this task.

Open sourceFoundation modelsData & datasets

Baidu's open-weight multimodal reasoning model from November 2025: 28B total parameters with 3B active per token, "Thinking with Images" zoom-and-tool reasoning, and Apache 2.0 weights.

Open sourceChinaMultimodal

DeepSeek-OCR is an open-source model of about 3B parameters that renders long text as 2D images and reads it back from a small number of vision tokens, testing whether optical compression can stand in for very long text contexts.

Open sourceChinaMultimodal

UI-TARS-2 is a GUI agent trained with multi-turn reinforcement learning and released in September 2025 as an all-in-one upgrade to UI-TARS-1.5, with benchmark scores across web, desktop, Android, games and software-engineering tasks.

ChinaAgents & tool useComputer vision

Qwen3-VL is Alibaba's open vision-language model family, released in September 2025 under Apache 2.0. Its 235B flagship handles long video, GUI operation and 2D and 3D grounding.

Open sourceChinaAgents & tool use

Qwen3-Next is an open-weight model from Alibaba's Qwen team, released in September 2025 under Apache 2.0. It has 80B total parameters, only 3B active per token, and a hybrid attention design later used in Qwen3.5.

Large language modelsOpen sourceChina

Nemotron Nano 2 is NVIDIA's 9B reasoning model, built on a hybrid Mamba-Transformer design and released with open weights and most of its training data; NVIDIA reports much higher throughput than similar-sized models.

Large language modelsOpen sourceReasoning

A vision-language model released by Zhipu on 11 August 2025, built on GLM-4.5-Air and covering image, video, long-document and GUI tasks; Zhipu reports state-of-the-art results at its scale on 42 benchmarks.

Open sourceChinaMultimodal

Command A Vision is Cohere's first vision-language model in the Command family, released in July 2025. It pairs a 112-billion-parameter Command A language model with a SigLIP2 image encoder to read images, charts and documents and answer in text.

Large language modelsEnterpriseMultimodal

SmolLM3 is a 3-billion-parameter open model released by Hugging Face on 8 July 2025. It supports six languages and up to 128K tokens of context, with switchable reasoning, under Apache 2.0.

Large language modelsOpen sourceReasoning

Skild Brain is Skild AI's general-purpose foundation model for robots, trained in a universe of 100,000 different machines and meant to be fitted to existing hardware rather than built for one task.

EnterpriseDeep learningFoundation models

Aurora is a foundation model for the Earth system, trained on more than a million hours of geophysical data. It outperforms operational forecasts for weather, air quality, ocean waves and tropical cyclone tracks at far lower computational cost.

Deep learningFoundation modelsScience

Falcon-H1 is a family of open-weight language models that runs Transformer attention and state space layers in parallel, released in sizes from 0.5B to 34B parameters under the Falcon-LLM Licence.

Large language modelsOpen sourceFoundation models

π0.5 is a vision-language-action model from Physical Intelligence, released in April 2025, built to generalize to unfamiliar homes and trained by co-training on many kinds of robot and web data.

Deep learningFoundation modelsMultimodal

ByteDance Seed's GUI agent model from April 2025 and the successor to UI-TARS. Its 7B version is open-source under Apache-2.0, and the family reports state-of-the-art results on several screen-control benchmarks.

Open sourceChinaAgents & tool use

Kimi-VL is an open-source vision-language model from Moonshot AI, released in April 2025. It pairs a 16B-parameter mixture-of-experts language model with a native-resolution vision encoder, so only about 3B parameters are active at a time.

Open sourceChinaMultimodal

The largest model in Ai2's OLMo 2 family: a 32-billion-parameter language model released with its data, code, weights and training details, and reported to outperform GPT-3.5-Turbo and GPT-4o mini on academic benchmarks.

Large language modelsOpen sourceData & datasets

Gemini Robotics is a vision-language-action model from Google DeepMind, built on Gemini 2.0, that outputs physical actions to control robots. It was announced on 12 March 2025 alongside Gemini Robotics-ER.

MultimodalRoboticsComputer vision

Mistral OCR is a document-understanding API released by Mistral AI on 6 March 2025 that reads text, tables, equations and embedded media across thousands of scripts and languages, and was later superseded by newer OCR versions.

EnterpriseData & datasetsComputer vision

Cohere's first vision-language model, released in March 2025 as open-weight 8B and 32B versions. It handles images and text in 23 languages and, in Cohere's comparisons, beats several much larger models, under a non-commercial licence.

Large language modelsOpen sourceMultimodal

Helix is Figure's vision-language-action model for humanoid control, pairing a 7-billion-parameter vision-language model with a fast 80-million-parameter action policy, trained on about 500 hours of teleoperated data and run entirely on onboard GPUs.

Deep learningFoundation modelsMultimodal

Hunyuan3D 2.0 is Tencent's large-scale system for generating high-resolution textured 3D assets: a shape diffusion transformer plus a texture model, released with code and pretrained models on 21 January 2025 alongside its technical report.

Open sourceChinaGenerative models

UI-TARS is a GUI agent model from ByteDance Seed: it takes only screenshots as input and outputs keyboard and mouse actions, reported state-of-the-art results on more than 10 benchmarks, and was released with open weights under Apache-2.0.

Open sourceChinaAgents & tool use

Qwen2.5-VL is Alibaba's vision-language model family released in January 2025 in 3B, 7B, 32B and 72B sizes. It reads charts and documents, localises objects, works as a visual agent and understands videos over an hour long.

Open sourceChinaAgents & tool use

A family of open mixture-of-experts vision-language models from DeepSeek, released in three sizes from 1.0B to 4.5B activated parameters for document, chart and OCR understanding, succeeding DeepSeek-VL.

Open sourceChinaMultimodal

Phi-4 is Microsoft's 14-billion-parameter dense decoder-only language model, built with a data-quality-first recipe heavy on synthetic data and released with full weights under the MIT licence in January 2025.

Large language modelsOpen sourceReasoning

OLMo 2 is the second generation of the Allen Institute for AI's fully open language model family, released in 7B and 13B sizes with weights, data, code and training recipes all public.

Large language modelsOpen sourceData & datasets

Pixtral Large is Mistral AI's open-weight multimodal model announced on 18 November 2024, built on Mistral Large 2, combining a 123B-parameter decoder with a 1B vision encoder and a 128K-token context window. It was retired in May 2026.

EnterpriseMultimodalComputer vision

SmolLM2 is Hugging Face's second family of small language models, released in November 2024 at 135M, 360M and 1.7B parameters, with open weights and a data-centric training recipe.

Large language modelsOpen sourceConsumer apps

π0 is a generalist robot policy from Physical Intelligence, built by adapting a 3-billion-parameter vision-language model with flow matching so one model can output fast, continuous motor commands for dexterous manipulation.

Deep learningFoundation modelsMultimodal

A family of text-to-image models from Stability AI, announced in October 2024: the 8.1-billion-parameter Large, a 4-step Turbo variant and the 2.5-billion-parameter Medium, released under a community licence.

Open sourceGenerative modelsCreative tools

Molmo is a family of open vision-language models released by Ai2 on 25 September 2024 that can point at objects in images, with weights, code, data and evaluations published openly.

Open sourceMultimodalData & datasets

Llama 3.2, announced on 25 September 2024, added vision models at 11 billion and 90 billion parameters and small text-only models at 1 billion and 3 billion for edge and mobile devices.

Large language modelsOpen sourceMultimodal

Pixtral 12B is Mistral AI's first multimodal model, pairing a 12B language decoder with a 400M vision encoder. Released openly under Apache 2.0 in September 2024, it reads images at native resolution and was retired at the end of 2025.

Open sourceMultimodalComputer vision

NVLM is a family of multimodal large language models from NVIDIA, described in a paper posted to arXiv in September 2024; its flagship NVLM-D-72B was later released as open weights for non-commercial use.

Large language modelsOpen sourceMultimodal

Qwen2-VL is Alibaba's vision-language model released on 29 August 2024. It understands videos longer than 20 minutes, reads text in many languages, and can act as an agent on phones and robots.

Open sourceChinaAgents & tool use

SAM 2 is Meta's 2024 successor to the Segment Anything Model. It segments objects in both images and videos in real time, and its release included the SA-V video dataset.

Open sourceFoundation modelsData & datasets

SmolLM is a family of small language models with 135M, 360M and 1.7B parameters, released openly by Hugging Face in July 2024 for on-device use and trained on a purpose-built corpus of generated textbooks, code and filtered web text.

Large language modelsOpen sourceConsumer apps

Claude 3.5 Sonnet, released on 20 June 2024, was the first model of the Claude 3.5 family. It ran twice as fast as Claude 3 Opus at the mid-tier price and powered the new Artifacts and Projects features.

Large language modelsEnterpriseConsumer apps

Nemotron-4 340B is a family of open models from NVIDIA, released on 14 June 2024 as base, instruct and reward models. It was built to generate synthetic data for training other language models, and it fits on a single eight-GPU DGX H100.

Large language modelsOpen sourceEnterprise

OpenVLA is a 7-billion-parameter open-source vision-language-action model trained on 970,000 real robot demonstrations, released with checkpoints and code so that other groups can fine-tune and run it on their own robots.

Open sourceFoundation modelsMultimodal

Octo is an open-source generalist robot policy: a transformer-based diffusion model trained on 800,000 robot trajectories that can drive a range of robots out of the box and be fine-tuned to new setups.

Open sourceDeep learningFoundation models

OpenELM is a family of small open language models from Apple, published in four sizes from 270M to 3B parameters with its training framework, logs, checkpoints and MLX conversion code.

Large language modelsResearch historyOpen source

Grok-1.5 is xAI's upgrade to Grok-1, with better reasoning and a 128,000-token context window. Its companion Grok-1.5V was xAI's first multimodal model. Neither model's weights were released publicly.

Large language modelsMultimodalReasoning

Step-1V is a roughly 100-billion-parameter multimodal model from StepFun, unveiled in March 2024, that reads text, data and charts in images and supports video understanding; it ranked first on OpenCompass at launch and was succeeded by Step-1.5V.

Large language modelsChinaMultimodal

Claude 3 Haiku is the smallest and fastest model in Anthropic's Claude 3 family, announced in March 2024 with low per-token pricing, a 200K-token context window and image input; retired in April 2026.

Large language modelsEnterpriseMultimodal

Claude 3 Sonnet was the middle model of Anthropic's Claude 3 family, announced on 4 March 2024. It powered the free tier of claude.ai, offered a 200K-token context window, and was retired on 21 July 2025.

Large language modelsEnterpriseConsumer apps

Claude 3 Opus, announced on 4 March 2024, was the most capable model in the Claude 3 family. It added vision and launched with a 200K-token context window and a Needle In A Haystack recall above 99%.

Large language modelsEnterpriseMultimodal