Models

Nemotron 3.5 Transcribe is Nvidia's free, open-weight speech transcription model, released on 28 October 2026. It handles recordings up to an hour long, transcribes up to 40 languages and can separate up to eight speakers.

Open sourceMultimodalHardware & compute

Robostral Navigate is Mistral AI's first embodied navigation model: an 8-billion-parameter system that steers wheeled, legged or flying robots from RGB images and a plain-language instruction, using a single ordinary camera and no depth sensor.

RoboticsComputer visionEurope

Released on 16 April 2026 at the same price as Opus 4.6, Claude Opus 4.7 added an xhigh effort level and accepted much larger images. It was the first model to test automatic blocking of high-risk cybersecurity requests.

Large language modelsAgents & tool useSafety & governance

EXAONE 4.5 is LG AI Research's first open-weight vision language model: a 33-billion-parameter model with a 1.2-billion-parameter vision encoder, trained on documents and text, with a 256K-token context window, released in April 2026.

Large language modelsOpen sourceFoundation models

Reka Edge is a 7-billion-parameter vision-language model from Reka AI, released on 11 March 2026, built to take images, video and text and to run locally on laptops, phones and small edge devices.

Open sourceMultimodalRobotics

Phi-4-reasoning-vision-15B is Microsoft's 15-billion-parameter open-weight vision-language model, released on 4 March 2026 under the MIT licence, built to switch between step-by-step reasoning for math and science and direct answers for image perception tasks.

Open sourceMultimodalReasoning

A large language model released by iFlytek on 11 February 2026, trained entirely on domestic computing power and aimed at practical use in education, healthcare, automotive and agents.

Large language modelsChinaEnterprise

Molmo 2 is the second generation of Ai2's open vision-language models, released on 11 December 2025, which extends the Molmo line from still images to video with pointing, tracking and timestamped answers.

Open sourceMultimodalComputer vision

GWM-1 is Runway's first general world model: an autoregressive system that generates 720p video frame by frame in real time and can be steered with camera pose, robot commands or audio.

MultimodalRoboticsGenerative models

Three small dense models from Mistral AI — 3B, 8B and 14B — released in December 2025 under Apache 2.0, each in base, instruct and reasoning variants with image understanding.

Large language modelsOpen sourceMultimodal

SAM 3 is Meta's segmentation model from November 2025. It finds, segments and tracks every instance of a concept named by a short text prompt or an example image, and Meta reported it doubles the accuracy of existing systems on this task.

Open sourceFoundation modelsData & datasets

iFlytek's Spark X1.5 is a deep reasoning model released in November 2025 that runs on a domestic computing platform built with Huawei, using a 293-billion-parameter mixture-of-experts design.

Large language modelsChinaReasoning

Baidu's open-weight multimodal reasoning model from November 2025: 28B total parameters with 3B active per token, "Thinking with Images" zoom-and-tool reasoning, and Apache 2.0 weights.

Open sourceChinaMultimodal

DeepSeek-OCR is an open-source model of about 3B parameters that renders long text as 2D images and reads it back from a small number of vision tokens, testing whether optical compression can stand in for very long text contexts.

Open sourceChinaMultimodal

An experimental DeepSeek model released on 29 September 2025 that introduced DeepSeek Sparse Attention to make long-context training and inference cheaper, shipped with open weights and an immediate API price cut.

Large language modelsOpen sourceChina

UI-TARS-2 is a GUI agent trained with multi-turn reinforcement learning and released in September 2025 as an all-in-one upgrade to UI-TARS-1.5, with benchmark scores across web, desktop, Android, games and software-engineering tasks.

ChinaAgents & tool useComputer vision

GLM-4.6 is an open-weights large language model released by Zhipu in late September 2025, with a 200K-token context window, about 357 billion parameters and an MIT licence, aimed at coding, reasoning and agent work.

Large language modelsOpen sourceChina

Qwen3-VL is Alibaba's open vision-language model family, released in September 2025 under Apache 2.0. Its 235B flagship handles long video, GUI operation and 2D and 3D grounding.

Open sourceChinaAgents & tool use

A vision-language model released by Zhipu on 11 August 2025, built on GLM-4.5-Air and covering image, video, long-document and GUI tasks; Zhipu reports state-of-the-art results at its scale on 42 benchmarks.

Open sourceChinaMultimodal

Genie 3 is Google DeepMind's general-purpose world model, announced on 5 August 2025. It turns text prompts into interactive 720p environments that can be navigated in real time at 24 frames per second, and was released as a limited research preview.

Agents & tool useGenerative modelsSimulation

Command A Vision is Cohere's first vision-language model in the Command family, released in July 2025. It pairs a 112-billion-parameter Command A language model with a SigLIP2 image encoder to read images, charts and documents and answer in text.

Large language modelsEnterpriseMultimodal

HunyuanWorld 1.0 is Tencent's open-source model for generating explorable, mesh-exportable 3D worlds from text or images. Released in July 2025, it was followed by a series of lighter and faster versions.

Open sourceChinaGenerative models

Step 3 is StepFun's open multimodal reasoning model, with 321 billion total parameters and 38 billion active per token. It was released in July 2025 and uses Apache 2.0.

Open sourceChinaMultimodal

Skild Brain is Skild AI's general-purpose foundation model for robots, trained in a universe of 100,000 different machines and meant to be fitted to existing hardware rather than built for one task.

EnterpriseDeep learningFoundation models

Aurora is a foundation model for the Earth system, trained on more than a million hours of geophysical data. It outperforms operational forecasts for weather, air quality, ocean waves and tropical cyclone tracks at far lower computational cost.

Deep learningFoundation modelsScience

ByteDance Seed's GUI agent model from April 2025 and the successor to UI-TARS. Its 7B version is open-source under Apache-2.0, and the family reports state-of-the-art results on several screen-control benchmarks.

Open sourceChinaAgents & tool use

Kimi-VL is an open-source vision-language model from Moonshot AI, released in April 2025. It pairs a 16B-parameter mixture-of-experts language model with a native-resolution vision encoder, so only about 3B parameters are active at a time.

Open sourceChinaMultimodal

Isaac GR00T N1 is an open foundation model for humanoid robots that NVIDIA announced on 18 March 2025. It is designed to be post-trained for a specific robot or task, and it pairs a planning model with quick motion control.

Open sourceFoundation modelsRobotics

Gemini Robotics is a vision-language-action model from Google DeepMind, built on Gemini 2.0, that outputs physical actions to control robots. It was announced on 12 March 2025 alongside Gemini Robotics-ER.

MultimodalRoboticsComputer vision

Mistral OCR is a document-understanding API released by Mistral AI on 6 March 2025 that reads text, tables, equations and embedded media across thousands of scripts and languages, and was later superseded by newer OCR versions.

EnterpriseData & datasetsComputer vision

Cohere's first vision-language model, released in March 2025 as open-weight 8B and 32B versions. It handles images and text in 23 languages and, in Cohere's comparisons, beats several much larger models, under a non-commercial licence.

Large language modelsOpen sourceMultimodal

Hunyuan3D 2.0 is Tencent's large-scale system for generating high-resolution textured 3D assets: a shape diffusion transformer plus a texture model, released with code and pretrained models on 21 January 2025 alongside its technical report.

Open sourceChinaGenerative models

UI-TARS is a GUI agent model from ByteDance Seed: it takes only screenshots as input and outputs keyboard and mouse actions, reported state-of-the-art results on more than 10 benchmarks, and was released with open weights under Apache-2.0.

Open sourceChinaAgents & tool use

iFlytek Spark X1 is a Chinese deep-reasoning model released in January 2025 and trained entirely on domestic computing hardware, with later upgrades benchmarked against OpenAI's reasoning models.

Large language modelsChinaReasoning

NVIDIA Cosmos is a platform of world foundation models that generate physics-based video to train robots and autonomous vehicles, released as open-weight models in January 2025.

Open sourceFoundation modelsRobotics

Qwen2.5-VL is Alibaba's vision-language model family released in January 2025 in 3B, 7B, 32B and 72B sizes. It reads charts and documents, localises objects, works as a visual agent and understands videos over an hour long.

Open sourceChinaAgents & tool use

A family of open mixture-of-experts vision-language models from DeepSeek, released in three sizes from 1.0B to 4.5B activated parameters for document, chart and OCR understanding, succeeding DeepSeek-VL.

Open sourceChinaMultimodal

Genie 2 is a foundation world model from Google DeepMind, announced on 4 December 2024, that turns a single prompt image into a playable 3D environment that a person or an AI agent can explore with keyboard and mouse controls.

Agents & tool useGenerative modelsSimulation

Pixtral Large is Mistral AI's open-weight multimodal model announced on 18 November 2024, built on Mistral Large 2, combining a 123B-parameter decoder with a 1B vision encoder and a 128K-token context window. It was retired in May 2026.

EnterpriseMultimodalComputer vision

Ministral 3B and Ministral 8B are two small Mistral AI language models released on 16 October 2024 for on-device and edge use, offering long context, low API prices and, for the 3B, performance Mistral claimed beat its earlier 7B model.

Large language modelsEnterpriseHardware & compute

Molmo is a family of open vision-language models released by Ai2 on 25 September 2024 that can point at objects in images, with weights, code, data and evaluations published openly.

Open sourceMultimodalData & datasets

Llama 3.2, announced on 25 September 2024, added vision models at 11 billion and 90 billion parameters and small text-only models at 1 billion and 3 billion for edge and mobile devices.

Large language modelsOpen sourceMultimodal

Pixtral 12B is Mistral AI's first multimodal model, pairing a 12B language decoder with a 400M vision encoder. Released openly under Apache 2.0 in September 2024, it reads images at native resolution and was retired at the end of 2025.

Open sourceMultimodalComputer vision

NVLM is a family of multimodal large language models from NVIDIA, described in a paper posted to arXiv in September 2024; its flagship NVLM-D-72B was later released as open weights for non-commercial use.

Large language modelsOpen sourceMultimodal

Qwen2-VL is Alibaba's vision-language model released on 29 August 2024. It understands videos longer than 20 minutes, reads text in many languages, and can act as an agent on phones and robots.

Open sourceChinaAgents & tool use

SAM 2 is Meta's 2024 successor to the Segment Anything Model. It segments objects in both images and videos in real time, and its release included the SA-V video dataset.

Open sourceFoundation modelsData & datasets

Mistral NeMo is a 12-billion-parameter language model released by Mistral AI with NVIDIA in July 2024, notable for a 128K-token context window, a new multilingual tokenizer called Tekken, and an Apache 2.0 release.

Large language modelsOpen sourceHardware & compute

iFlytek's large language model released on 27 June 2024 and trained entirely on a domestic platform co-built with Huawei; iFlytek presented it as reaching GPT-4 level while acknowledging weaker coding and multimodal abilities.

Large language modelsChinaFoundation models

Claude 3.5 Sonnet, released on 20 June 2024, was the first model of the Claude 3.5 family. It ran twice as fast as Claude 3 Opus at the mid-tier price and powered the new Artifacts and Projects features.

Large language modelsEnterpriseConsumer apps

Octo is an open-source generalist robot policy: a transformer-based diffusion model trained on 800,000 robot trajectories that can drive a range of robots out of the box and be fine-tuned to new setups.

Open sourceDeep learningFoundation models

Grok-1.5 is xAI's upgrade to Grok-1, with better reasoning and a 128,000-token context window. Its companion Grok-1.5V was xAI's first multimodal model. Neither model's weights were released publicly.

Large language modelsMultimodalReasoning

Step-1V is a roughly 100-billion-parameter multimodal model from StepFun, unveiled in March 2024, that reads text, data and charts in images and supports video understanding; it ranked first on OpenCompass at launch and was succeeded by Step-1.5V.

Large language modelsChinaMultimodal

Claude 3 Haiku is the smallest and fastest model in Anthropic's Claude 3 family, announced in March 2024 with low per-token pricing, a 200K-token context window and image input; retired in April 2026.

Large language modelsEnterpriseMultimodal

Claude 3 Sonnet was the middle model of Anthropic's Claude 3 family, announced on 4 March 2024. It powered the free tier of claude.ai, offered a 200K-token context window, and was retired on 21 July 2025.

Large language modelsEnterpriseConsumer apps

Claude 3 Opus, announced on 4 March 2024, was the most capable model in the Claude 3 family. It added vision and launched with a 200K-token context window and a Needle In A Haystack recall above 99%.

Large language modelsEnterpriseMultimodal

A Google DeepMind generative world model with 11 billion parameters that turns text, images or sketches into controllable virtual worlds, described as the first generative interactive environment trained on unlabelled internet videos without action labels.

Research historyGenerative modelsSimulation

Spark V3.5 is a large language model that iFlytek released on 30 January 2024. It was the first Spark model trained entirely on the domestic FlyingStar One computing platform, and iFlytek compared it with GPT-4 Turbo.

Large language modelsChinaFoundation models

Yi-VL-34B and Yi-VL-6B are open vision-language models from 01.AI, released on 23 January 2024. They read images and text together and ranked first among open models on the MMMU and CMMMU benchmarks.

Open sourceChinaMultimodal