Code

A 2021 paper from OpenAI introduces Codex, a GPT model fine-tuned on public GitHub code, and HumanEval, an evaluation set that judges generated Python programs by whether they work rather than by how closely they match a reference.

A benchmark of 2,294 real software engineering problems taken from GitHub issues and the pull requests that resolved them, in which a model must edit a codebase to fix an issue; on release the best model solved under 2% of them.

Claude 3.5 Sonnet, released on 20 June 2024, was the first model of the Claude 3.5 family. It ran twice as fast as Claude 3 Opus at the mid-tier price and powered the new Artifacts and Projects features.

Claude Code is Anthropic's agentic coding tool. It was announced on 24 February 2025 as a research preview that works in the terminal, and it now runs in many places, from the terminal and IDEs to the web and Slack.

Gemini 2.5 Pro is Google's first model in the Gemini 2.5 family, released in March 2025 as a "thinking model" with a 1-million-token context window, debuting at number one on LMArena.

Codex is OpenAI's software-engineering agent. It started in 2025 as an open-source terminal tool and a cloud agent inside ChatGPT, and later grew into a desktop app with millions of weekly users.

Kimi K2 is an open-weight mixture-of-experts language model from Moonshot AI, released in July 2025 with 1 trillion total parameters, 32 billion active per token and a 128K-token context.

Gemini 3 Pro is the first model of Google's Gemini 3 generation, released in preview in November 2025 with a 1-million-token context window and top-ranked results on arena leaderboards and reasoning, coding and multimodal benchmarks.

Zhipu's GLM-5 report describes a 744-billion-parameter mixture-of-experts model built on sparse attention and asynchronous reinforcement learning, aimed at moving AI-assisted programming from vibe coding toward agentic engineering.

Claude Mythos Preview, announced on 7 April 2026, is an unreleased frontier model that Anthropic made available only to restricted partners through Project Glasswing, a programme for securing critical software.

Claude Fable 5 is Anthropic's Mythos-class model for general use, released on 9 June 2026. Its sibling Claude Mythos 5 is the same model with some safeguards lifted for vetted users.

Gemini 4 Argon is the first model in Google's Gemini 4 family, announced on 30 September 2026 and made generally available on 13 October 2026, built for long multi-step work and shipped with a one-million-token output limit.

An AI coding collaborator covering public use cases such as completion, explanation, and software-development workflows.

OpenAI Codex is a 2021 GPT language model fine-tuned on public code from GitHub. It translates natural language into code, and was introduced alongside the HumanEval benchmark for testing code correctness.

A 2021 arXiv paper by Austin, Odena, Nye and eight other authors that introduced MBPP, a benchmark of 974 short Python programming tasks, and measured how language models from 244M to 137B parameters turn natural-language descriptions into working code.

GPT-3.5 is the family of OpenAI language models between GPT-3 and GPT-4, released through API models such as text-davinci-002 and text-davinci-003 and underlying the first version of ChatGPT.

Code Llama is a family of coding models that Meta released in August 2023 by further training Llama 2 on code. It ranges from 7 billion to 70 billion parameters and uses the Llama 2 community license.

FunSearch is a method that uses a pretrained large language model inside an evolutionary loop to search for programs that solve mathematical and computational problems, rather than for answers directly. It produced new results on the cap set problem and on online bin packing.

A benchmark for code LLMs that keeps collecting fresh contest problems from LeetCode, AtCoder and CodeForces, so that scores reflect ability rather than memorised test data, and that also tests code repair and execution reasoning.

DBRX is Databricks' openly licensed large language model, a mixture-of-experts transformer with 132 billion total parameters and 36 billion active per token, announced on 27 March 2024.

Snowflake's open-weight model with 480 billion total and 17 billion active parameters, built as a dense-MoE hybrid, released in April 2024 under Apache 2.0 and trained for under 2 million dollars.

Mistral AI's second-generation flagship model, released in July 2024 with 123 billion parameters, a 128K-token context window, wide language and code coverage, and weights published under a research license.

Qwen2.5 is the Qwen family's September 2024 generation. Its launch included 13 open-weight models, with up to 18 trillion pretraining tokens, 128K context and most models under Apache 2.0.

The upgraded Claude 3.5 Sonnet, announced on 22 October 2024, raised coding and agentic scores and introduced computer use in public beta, the first such offer from a frontier AI model.

TRAE is ByteDance's AI coding product, launched in January 2025 with an IDE, a plugin and the SOLO agent. Its SOLO agent was renamed TRAE Work in June 2026.[^1][^9]

OpenAI's small reasoning model released on 31 January 2025, offered to all ChatGPT users including the free tier, with three reasoning-effort levels and developer features such as function calling and Structured Outputs; succeeded by o4-mini in April 2025.

Claude 3.7 Sonnet, released on 24 February 2025, was described by Anthropic as the first hybrid reasoning model on the market, able to answer quickly or think step by step at length. It launched with Claude Code.

OpenAI's April 2025 family of three API models — GPT-4.1, GPT-4.1 mini and GPT-4.1 nano — offering a context window of over a million tokens, low prices per token and stronger coding scores. It was succeeded by GPT-5.

A small reasoning model released by OpenAI in April 2025 alongside o3, built for fast, low-cost reasoning; with a Python interpreter it reached 99.5% pass@1 on AIME 2025, and it was later succeeded by GPT-5 mini.

AlphaEvolve is a Google DeepMind coding agent announced on 14 May 2025 that pairs Gemini models with automated evaluators to evolve algorithms, yielding a Borg scheduling heuristic, faster kernels and new mathematical results.

Claude Opus 4 and Claude Sonnet 4, announced on 22 May 2025, were hybrid models with extended thinking. Anthropic called Opus 4 the best coding model in the world, and Claude Code became generally available the same day.

Qwen3-Coder is an open-weight family of coding models from the Qwen team; its flagship 480B-parameter model, announced in July 2025, was built and trained specifically for agentic coding tasks.

Claude Sonnet 4.5, released on 29 September 2025, was a drop-in replacement for Sonnet 4 at the same price. Anthropic reported that it could stay focused on complex tasks for more than 30 hours.

MiniMax-M2 is an open-weights mixture-of-experts language model released by MiniMax in October 2025, with 230B total and 10B active parameters, aimed at coding and agentic workflows.

Google Antigravity is a free, agent-first software development platform released by Google on 18 November 2025 for macOS, Windows and Linux, which runs Gemini models alongside rival models and later expanded into a CLI, SDK and managed API agent.

Claude Opus 4.5, released on 24 November 2025, cost a third as much as Opus 4.1 per token and introduced an effort parameter that lets developers trade capability for time and cost. Claude Opus 4.6 succeeded it.

GLM-4.7 is Zhipu's open-weights language model released in December 2025, aimed at multilingual agentic coding and terminal tasks. It reports clear gains over GLM-4.6 on software-engineering benchmarks and ships under the MIT license.

GPT-5.2 is a model family OpenAI released on 11 December 2025, with Instant, Thinking and Pro versions and a coding variant. It was aimed at professional work such as spreadsheets and presentations.

Gemini 3 Flash is a fast, lower-cost model in Google's Gemini 3 family, released on 17 December 2025. It scored close to Gemini 3 Pro on several benchmarks while using fewer tokens and costing far less per token.

Terminal-Bench 2.0 is a curated benchmark of 89 hard tasks carried out in computer terminal environments, built to measure how well AI agents handle realistic command-line work; frontier models and agents score below 65% on it.

Released on 5 February 2026, Claude Opus 4.6 was an upgrade to Anthropic's smartest model. It was the first Opus-class model with a 1M-token context window, in beta at launch, and it introduced agent teams in Claude Code.

GPT-5.3-Codex is a coding model OpenAI released on 5 February 2026, which the company called its first model that was instrumental in creating itself and pitched for repository search, terminal commands and debugging as well as writing code.

MiniMax-M2.5 is an open-weight 229B-parameter language model released in February 2026 for agentic coding and office work, shipped alongside a faster Lightning variant and reported at the top of software-engineering benchmarks.

Released on 17 February 2026 with a 1M-token context window in beta, Claude Sonnet 4.6 kept the price of Sonnet 4.5 and became the default model for Free and Pro users on claude.ai.

Gemini 3.1 Pro is Google's preview upgrade to Gemini 3 Pro, released on 19 February 2026, scoring a verified 77.1% on ARC-AGI-2 and shipped through the Gemini API, the Gemini app and NotebookLM.

A generation of Alibaba's Qwen models released in April 2026, spanning proprietary Plus and Max versions aimed at agentic coding and open-weight models such as Qwen3.6-35B-A3B, a 35B-parameter mixture-of-experts with 3B active parameters.

GLM-5.1 is Zhipu AI's open-source large language model released in April 2026, built for coding and long-running agent tasks and notable for topping SWE-Bench Pro ahead of competing frontier models in Zhipu's own comparison.

Released on 16 April 2026 at the same price as Opus 4.6, Claude Opus 4.7 added an xhigh effort level and accepted much larger images. It was the first model to test automatic blocking of high-risk cybersecurity requests.

GPT-5.5 is an OpenAI model released on 23 April 2026 as GPT-5.5 Thinking and Pro, with an API version the next day. It succeeded GPT-5.4 and had a cybersecurity variant in limited preview.

Laguna XS.2 is Poolside's first open-weight coding model: 33 billion total parameters with 3 billion active per token, released under Apache 2.0 and trained on 30 trillion tokens.

Laguna M.1 is Poolside's 225-billion-parameter mixture-of-experts model for long-horizon agentic coding, activating 23 billion parameters per token. Its weights reached Hugging Face seven weeks after launch.

Gemini 3.5 Flash is Google's first Gemini 3.5 model, announced on 19 May 2026 and built for agentic and coding work; it became the default model in the Gemini app and in AI Mode in Search.

ByteDance Seed's Seed2.1, released in June 2026 in Pro and Turbo versions, is a Doubao-family model aimed at real productivity work, with reported gains in agent ability, coding, knowledge, reasoning and multimodal understanding.

Claude Sonnet 5, released on 30 June 2026, is Anthropic's most agentic Sonnet model. It can make plans, use browsers and terminals, and run autonomously, at an introductory price of $2 and $10 per million tokens.

OpenAI's three-model family released on 9 July 2026 — Luna, Terra and Sol, ordered from least to most capable — with Sol pitched as the company's strongest coding and agent model.

Claude Opus 5, released on 24 July 2026 at $5 and $25 per million tokens, is Anthropic's most aligned model to date and its most capable generally available model for scientific research.

GLM-5.3 is Zhipu's open-weight language model released on 14 August 2026. It keeps the GLM-5.2 base model and gains its improvements from post-training, with reported state-of-the-art open results on agentic coding and cybersecurity benchmarks.

Tencent Hy4 preview is an open-weight mixture-of-experts model released on 28 August 2026 with 770 billion total parameters, 49 billion active and a context of over one million tokens.

Claude Fable 5.1, released on 1 September 2026, keeps the $10 and $50 per million token price of Fable 5, with cache reads 75% cheaper. Its sibling Claude Mythos 5.1 is limited to trusted-access programmes.

Gemini 3.8 Flash is Google's fast, low-cost model released on 2 September 2026, alongside a cybersecurity variant, Gemini 3.8 Flash Cyber, with introductory pricing that doubles at the start of 2027.

Claude Opus 5.5, released on 22 September 2026, is the first model in Anthropic's Claude 5.5 family. Anthropic said it performs at the level of Fable 5.1 on most work, at about 40% lower cost than Opus 5.

Claude Sonnet 5.5, released on 28 September 2026, is the second model in the Claude 5.5 family and Anthropic's fastest Sonnet to date. It costs $2 and $10 per million tokens, with cache reads halved in October 2026.

Mistral Large 4 is Mistral AI's flagship open-weight model, with about 1 trillion total parameters, a 1M-token context window and native multimodality. It was previewed on 6 October 2026, and an improved version's weights followed on 29 October 2026.

Muse Spark Open is Meta's open-weight large language model, announced on 15 October 2026. With 816 billion total parameters, it is built for coding and agentic work, and its weights can be downloaded, unlike the closed Muse Spark that started the family.

iFlytek's Spark X2.6 is a device-cloud model family unveiled in October 2026, pairing a 293-billion-parameter mixture-of-experts cloud model with smaller on-device models and a router that decides where each task runs.

Gemini 4 Carbon is a Google DeepMind frontier model announced on 28 October 2026, two weeks after Gemini 4 Argon, with Google claiming state-of-the-art cybersecurity and long-horizon capabilities.

OpenAI's cybersecurity-focused model, released on 5 November 2026 and limited to the top tier of its Daybreak Red programme; OpenAI says it surfaced 948 potential Linux kernel issues and 81 novel Firefox vulnerabilities.

Poolside is an AI company building models for software work; in April 2026 it released the Laguna M.1 and Laguna XS.2 models and pool, the agent runtime behind its reinforcement learning.

Synthetic data is training material written by a model rather than collected from people or the web. In the phi-1 experiments a small code model trained partly on model-generated "textbooks" reached competitive benchmark scores, suggesting data quality itself shapes capability.

GitHub is a code hosting and collaboration platform used by more than 225 million developers, acquired by Microsoft in 2018 and the birthplace of the GitHub Copilot coding assistant.

Wojciech Zaremba is a Polish computer scientist who co-founded OpenAI in 2015. He later led teams working on GPT models, GitHub Copilot and Codex.

AlphaCode is a DeepMind code-generation system for competitive programming, announced in February 2022. On Codeforces contests held after its training data, it reached an estimated rank around the median participant. A Gemini-based AlphaCode 2 followed in December 2023.

StarCoder is an open-access code language model of about 15.5 billion parameters, released on 4 May 2023 by the BigCode project led by Hugging Face and ServiceNow.

Phi-1 is a 1.3-billion-parameter Transformer language model for Python from Microsoft Research, which showed that filtered and synthetic "textbook quality" training data can partly substitute for model and data scale.

SparkDesk V2.0 is the second version of iFlytek's large language model, launched on 15 August 2023 with upgraded coding and multimodal abilities, and released alongside the iFlyCode 1.0 programming assistant.

DeepSeek's first model release: a family of open-source code models from 1.3B to 33B parameters, trained from scratch on 2 trillion tokens and reported to beat Codex and GPT-3.5 on several benchmarks.

SenseTime Raccoon (商汤小浣熊) is a family of AI tools for office work, data analysis and coding. It was first presented in February 2024 and upgraded with SenseNova V6.5 in July 2025.

StarCoder2 is a family of open code models in 3B, 7B and 15B sizes, released in February 2024 by BigCode (Hugging Face and ServiceNow) with NVIDIA and trained on The Stack v2, published together with its dataset and training code.

Codestral is Mistral AI's family of code models, first released in May 2024 as an open-weight 22B-parameter model with a 32K context window, followed by faster and longer-context versions aimed at IDE code completion.

An open-source mixture-of-experts code model from DeepSeek, released in June 2024, that widened language coverage and context length over its predecessor and reported benchmark results above several closed models.

DeepSeek-V2.5 is a model released on 5 September 2024 that merged DeepSeek's chat and code models into one, keeping both conversational and coding ability while improving safety scores.

Yi-Coder is a family of open-source code models from 01.AI, released in September 2024 in 1.5B and 9B sizes, each with base and chat versions, covering 52 programming languages with context up to 128K tokens.

o1-mini is a smaller, faster and cheaper reasoning model that OpenAI released on 12 September 2024 alongside o1-preview, trained with reinforcement learning to reason step by step and rated particularly effective at coding.

Anthropic's small, fast language model announced in October 2024 as the successor to Claude 3 Haiku, claimed to reach the intelligence of the previous flagship at Haiku-like speed and to be especially strong at coding.

Jules is Google's asynchronous AI coding agent: it takes a task such as a GitHub issue, works in a secure cloud virtual machine, and returns a diff for review. It was previewed in December 2024 and reached general availability in August 2025.

An experimental Google model released in February 2025 as part of the Gemini 2.0 family, described by Google as its best yet for coding and complex prompts, with a 2-million-token context window and tool use.

DeepSeek-V3-0324 is a March 2025 update to DeepSeek-V3 that keeps the same model structure while raising benchmark scores and moving to the MIT License.

Mistral Medium 3 is a proprietary model released by Mistral AI on 7 May 2025, marketed as a mid-sized system that nears larger competitors at a much lower price and can be self-hosted on four GPUs.

Seed-Coder is a family of open code models released by ByteDance Seed in May 2025, with 8B-parameter Base, Instruct and Reasoning variants trained on data filtered by language models rather than hand-written rules.

Devstral is Mistral AI's family of open-weight models for agentic coding, first released in May 2025 with All Hands AI; the first version scored 46.8% on SWE-Bench Verified and could run on a single consumer GPU.

Gemini CLI is an open-source AI agent released by Google on 25 June 2025 that brings Gemini models into the terminal, with a free personal-account tier and support for the Model Context Protocol.

Claude Opus 4.1, released on 5 August 2025, upgraded Claude Opus 4 for agentic tasks, real-world coding and reasoning, at the same price. Anthropic later succeeded it with Claude Opus 4.5.

A fast reasoning model from xAI for agentic coding, released in August 2025 with low per-token pricing, a 70.8% score on SWE-bench Verified, and integrations with GitHub Copilot, Cursor, Cline and other coding tools.

GLM-4.6 is an open-weights large language model released by Zhipu in late September 2025, with a 200K-token context window, about 357 billion parameters and an MIT licence, aimed at coding, reasoning and agent work.

An OpenAI model released in September 2025 that adapted GPT-5 for agentic coding, served as the default model in Codex, and was shut down in July 2026.

Claude Haiku 4.5, released on 15 October 2025 and available to all users, offered coding performance close to Sonnet 4 at one-third of the cost and more than twice the speed.

An agentic coding model in OpenAI's GPT-5.1 family, released in November 2025. It was the first OpenAI model trained to work across multiple context windows and in Windows environments, and served as the default model in Codex until its retirement in 2026.

MiniMax-M2.1 is an open-weight language model released in December 2025 as the successor to M2, aimed at software engineering and multilingual coding, with a 229B-parameter checkpoint and large reported gains on coding benchmarks.

Devstral 2 is Mistral AI's 123B-parameter agentic coding model, released in December 2025 alongside the Mistral Vibe CLI and scoring 72.2% on SWE-bench Verified. It was deprecated in May 2026 and retired that July, replaced by Mistral Medium 3.5.

Mistral Vibe is Mistral AI's open-source command-line coding agent, announced in December 2025 with Devstral 2; it later grew into a broader agent product with cloud sandbox sessions, a VS Code extension and monthly plans.

MiniMax-M2.7 is a 229B-parameter language model released by MiniMax in March 2026, built for agentic work and presented by the company as its first model to take part in its own improvement.

Mistral Small 4 is an open-weight mixture-of-experts model released in March 2026 that folds instruction-following, step-by-step reasoning and agentic coding into one model, with a switch that controls how much reasoning it does.

Kimi K2.6 is an open-weight Moonshot AI model released in April 2026, focused on long-horizon coding, with a 262,144-token context, text and image input, and Agent Swarm scaled to 300 sub-agents.

A 128B-parameter open-weights multimodal model from Mistral AI, listed in April 2026 for agentic and coding work, briefly the default in Le Chat before being superseded by Mistral Large 4.

Released on 28 May 2026 at the same price as Opus 4.7, Claude Opus 4.8 added a fast mode at 2.5 times the speed, with fewer unnoticed flaws in its own code. Anthropic called it a modest but tangible improvement.

Step 3.7 Flash is a StepFun open-weights model released on 29 May 2026. It adds native image input to Step 3.5 Flash, supports a 256K context, and is licensed under Apache 2.0.

Grok 4.5 is an xAI model built for coding, agentic and knowledge work, announced on 16 July 2026. It was trained with Cursor on tens of thousands of NVIDIA GB300 GPUs and shipped as the default model in the Grok Build coding tool.

Gemini 3.6 Flash is the Gemini model Google released on 21 July 2026 and called its workhorse: better coding, knowledge work and multimodal results than 3.5 Flash, fewer output tokens, built-in computer use and tiered pricing.

Grok 4.6 is an xAI language model released on 12 August 2026, built on Grok 4.5 and aimed at long-running agents and interactive, visual work, with a 500,000-token context window and text and image input.

A Google model released on 13 August 2026 as its most intelligent workhorse for coding and agents, priced with a scheduled increase and superseded three weeks later by 3.8 Flash.

iFlytek Spark X2.5 is a 293B-A30B mixture-of-experts language model released on 7 September 2026, trained and served entirely on domestic computing power, with a 256K context window and support for more than 200 languages.

Grok 4.7 is xAI's September 2026 flagship model for coding and knowledge work, built on a larger base model than Grok 4.6 with longer reinforcement learning and a new safeguard stack, at unchanged token prices.

Codestral Mamba is a 7B open code model from Mistral AI, released in July 2024, that swaps the Transformer for the Mamba state-space architecture to get linear-time inference.