Computer vision Models

Claude 3 Opus, announced on 4 March 2024, was the most capable model in the Claude 3 family. It added vision and launched with a 200K-token context window and a Needle In A Haystack recall above 99%.

Claude 3.5 Sonnet, released on 20 June 2024, was the first model of the Claude 3.5 family. It ran twice as fast as Claude 3 Opus at the mid-tier price and powered the new Artifacts and Projects features.

AlexNet is the eight-layer convolutional network that won the ILSVRC2012 image classification task by a wide margin, showing that a large network trained on a large labelled dataset with GPUs could beat hand-designed features.

An image-text model from OpenAI that learns to match pictures with their captions. Trained on about 400 million image-caption pairs, it can classify images by comparing them against written prompts, with no task-specific training.

The Segment Anything Model (SAM) is a promptable image segmentation model Meta AI released in April 2023. Given a point, a box or a mask, it outlines the object the prompt refers to.

GPT-4V is a version of GPT-4 that accepts image input alongside text, documented in OpenAI's system card of 25 September 2023 and released to developers through preview API models; image understanding later became native in GPT-4o.

Fuyu-8B is a decoder-only multimodal model that Adept open-sourced in October 2023; it drops the image encoder, accepts arbitrary resolutions, and reads screens and charts.

Claude 3 Sonnet was the middle model of Anthropic's Claude 3 family, announced on 4 March 2024. It powered the free tier of claude.ai, offered a 200K-token context window, and was retired on 21 July 2025.

Claude 3 Haiku is the smallest and fastest model in Anthropic's Claude 3 family, announced in March 2024 with low per-token pricing, a 200K-token context window and image input; retired in April 2026.

Llama 3.2, announced on 25 September 2024, added vision models at 11 billion and 90 billion parameters and small text-only models at 1 billion and 3 billion for edge and mobile devices.

Gemini Robotics is a vision-language-action model from Google DeepMind, built on Gemini 2.0, that outputs physical actions to control robots. It was announced on 12 March 2025 alongside Gemini Robotics-ER.

Qwen3-VL is Alibaba's open vision-language model family, released in September 2025 under Apache 2.0. Its 235B flagship handles long video, GUI operation and 2D and 3D grounding.

Reka Edge is a 7-billion-parameter vision-language model from Reka AI, released on 11 March 2026, built to take images, video and text and to run locally on laptops, phones and small edge devices.

EXAONE 4.5 is LG AI Research's first open-weight vision language model: a 33-billion-parameter model with a 1.2-billion-parameter vision encoder, trained on documents and text, with a 256K-token context window, released in April 2026.

Released on 16 April 2026 at the same price as Opus 4.6, Claude Opus 4.7 added an xhigh effort level and accepted much larger images. It was the first model to test automatic blocking of high-risk cybersecurity requests.

Flamingo is a DeepMind visual language model announced in April 2022. It takes prompts that mix images, videos and text and replies in language, learning new tasks from only a few examples.

RT-2 is a vision-language-action model from Google DeepMind, announced on 28 July 2023, that turns images and text instructions into robot actions written as text tokens. In over 6,000 trials it reached 62% on unseen scenarios, up from 32% for RT-1.

Qwen-VL is a family of vision-language models released in August 2023 that builds on the Qwen language model to caption images, answer questions about them, locate objects and read text, with open Base and Chat versions.

Yi-VL-34B and Yi-VL-6B are open vision-language models from 01.AI, released on 23 January 2024. They read images and text together and ranked first among open models on the MMMU and CMMMU benchmarks.

Step-1V is a roughly 100-billion-parameter multimodal model from StepFun, unveiled in March 2024, that reads text, data and charts in images and supports video understanding; it ranked first on OpenCompass at launch and was succeeded by Step-1.5V.

Grok-1.5 is xAI's upgrade to Grok-1, with better reasoning and a 128,000-token context window. Its companion Grok-1.5V was xAI's first multimodal model. Neither model's weights were released publicly.

SAM 2 is Meta's 2024 successor to the Segment Anything Model. It segments objects in both images and videos in real time, and its release included the SA-V video dataset.

Qwen2-VL is Alibaba's vision-language model released on 29 August 2024. It understands videos longer than 20 minutes, reads text in many languages, and can act as an agent on phones and robots.

Pixtral 12B is Mistral AI's first multimodal model, pairing a 12B language decoder with a 400M vision encoder. Released openly under Apache 2.0 in September 2024, it reads images at native resolution and was retired at the end of 2025.

Molmo is a family of open vision-language models released by Ai2 on 25 September 2024 that can point at objects in images, with weights, code, data and evaluations published openly.

Pixtral Large is Mistral AI's open-weight multimodal model announced on 18 November 2024, built on Mistral Large 2, combining a 123B-parameter decoder with a 1B vision encoder and a 128K-token context window. It was retired in May 2026.

A family of open mixture-of-experts vision-language models from DeepSeek, released in three sizes from 1.0B to 4.5B activated parameters for document, chart and OCR understanding, succeeding DeepSeek-VL.

Qwen2.5-VL is Alibaba's vision-language model family released in January 2025 in 3B, 7B, 32B and 72B sizes. It reads charts and documents, localises objects, works as a visual agent and understands videos over an hour long.

Hunyuan3D 2.0 is Tencent's large-scale system for generating high-resolution textured 3D assets: a shape diffusion transformer plus a texture model, released with code and pretrained models on 21 January 2025 alongside its technical report.

UI-TARS is a GUI agent model from ByteDance Seed: it takes only screenshots as input and outputs keyboard and mouse actions, reported state-of-the-art results on more than 10 benchmarks, and was released with open weights under Apache-2.0.

Cohere's first vision-language model, released in March 2025 as open-weight 8B and 32B versions. It handles images and text in 23 languages and, in Cohere's comparisons, beats several much larger models, under a non-commercial licence.

Kimi-VL is an open-source vision-language model from Moonshot AI, released in April 2025. It pairs a 16B-parameter mixture-of-experts language model with a native-resolution vision encoder, so only about 3B parameters are active at a time.

ByteDance Seed's GUI agent model from April 2025 and the successor to UI-TARS. Its 7B version is open-source under Apache-2.0, and the family reports state-of-the-art results on several screen-control benchmarks.

Command A Vision is Cohere's first vision-language model in the Command family, released in July 2025. It pairs a 112-billion-parameter Command A language model with a SigLIP2 image encoder to read images, charts and documents and answer in text.

A vision-language model released by Zhipu on 11 August 2025, built on GLM-4.5-Air and covering image, video, long-document and GUI tasks; Zhipu reports state-of-the-art results at its scale on 42 benchmarks.

UI-TARS-2 is a GUI agent trained with multi-turn reinforcement learning and released in September 2025 as an all-in-one upgrade to UI-TARS-1.5, with benchmark scores across web, desktop, Android, games and software-engineering tasks.

DeepSeek-OCR is an open-source model of about 3B parameters that renders long text as 2D images and reads it back from a small number of vision tokens, testing whether optical compression can stand in for very long text contexts.

Baidu's open-weight multimodal reasoning model from November 2025: 28B total parameters with 3B active per token, "Thinking with Images" zoom-and-tool reasoning, and Apache 2.0 weights.

SAM 3 is Meta's segmentation model from November 2025. It finds, segments and tracks every instance of a concept named by a short text prompt or an example image, and Meta reported it doubles the accuracy of existing systems on this task.

Molmo 2 is the second generation of Ai2's open vision-language models, released on 11 December 2025, which extends the Molmo line from still images to video with pointing, tracking and timestamped answers.

Phi-4-reasoning-vision-15B is Microsoft's 15-billion-parameter open-weight vision-language model, released on 4 March 2026 under the MIT licence, built to switch between step-by-step reasoning for math and science and direct answers for image perception tasks.

NVLM is a family of multimodal large language models from NVIDIA, described in a paper posted to arXiv in September 2024; its flagship NVLM-D-72B was later released as open weights for non-commercial use.

Mistral OCR is a document-understanding API released by Mistral AI on 6 March 2025 that reads text, tables, equations and embedded media across thousands of scripts and languages, and was later superseded by newer OCR versions.

Robostral Navigate is Mistral AI's first embodied navigation model: an 8-billion-parameter system that steers wheeled, legged or flying robots from RGB images and a plain-language instruction, using a single ordinary camera and no depth sensor.