Models

OpenELM is a family of small open language models from Apple, published in four sizes from 270M to 3B parameters with its training framework, logs, checkpoints and MLX conversion code.

Large language modelsResearch historyOpen source

StarCoder2 is a family of open code models in 3B, 7B and 15B sizes, released in February 2024 by BigCode (Hugging Face and ServiceNow) with NVIDIA and trained on The Stack v2, published together with its dataset and training code.

Large language modelsOpen sourceData & datasets

Qwen1.5 is the Qwen family's open model release of February 2024, with base and chat models from 0.5B to 72B parameters, later extended to 110B, and a mixture-of-experts model.

Large language modelsOpen sourceChina

Aya 101 is a 13-billion-parameter, instruction-tuned language model from Cohere For AI that follows instructions in 101 languages. It was released under Apache 2.0 in February 2024.

Large language modelsOpen sourceFoundation models

Phi-2 is a 2.7-billion-parameter base language model from Microsoft Research, announced on 12 December 2023. Microsoft reported that it matched or beat models up to 25 times larger on complex benchmarks, making it a reference point for small-model training.

Large language modelsOpen sourceReasoning

GNoME is a Google DeepMind deep-learning tool, announced on 29 November 2023, that predicts new inorganic crystals; it produced 2.2 million candidate structures, of which 380,000 were predicted to be stable.

Deep learningData & datasetsScience

GPT-4 Turbo is a cheaper, more capable version of OpenAI's GPT-4, announced on 6 November 2023 with a 128,000-token context window and lower API prices.

Large language modelsEnterpriseMultimodal

GPT-4V is a version of GPT-4 that accepts image input alongside text, documented in OpenAI's system card of 25 September 2023 and released to developers through preview API models; image understanding later became native in GPT-4o.

Large language modelsMultimodalSafety & governance

Phi-1.5 is a 1.3-billion-parameter language model from Microsoft Research, trained on curated synthetic "textbook" text rather than web crawls; its report claims natural-language performance comparable to models five times larger.

Large language modelsOpen sourceReasoning

Code Llama is a family of coding models that Meta released in August 2023 by further training Llama 2 on code. It ranges from 7 billion to 70 billion parameters and uses the Llama 2 community license.

Large language modelsOpen sourceDeveloper tools

Phi-1 is a 1.3-billion-parameter Transformer language model for Python from Microsoft Research, which showed that filtered and synthetic "textbook quality" training data can partly substitute for model and data scale.

Large language modelsOpen sourceData & datasets

StarCoder is an open-access code language model of about 15.5 billion parameters, released on 4 May 2023 by the BigCode project led by Hugging Face and ServiceNow.

Large language modelsOpen sourceData & datasets

Claude is the AI assistant Anthropic announced on 14 March 2023, its first publicly available assistant. It was built around training AI to be helpful, honest and harmless, and it started the Claude model line.

Large language modelsEnterpriseConsumer apps

Jurassic-2 is a family of large language models released by AI21 Labs in March 2023 as the successor to Jurassic-1, offered in three sizes with instruction-tuned variants, multilingual support and task-specific APIs; it was succeeded by Jamba in 2024.

Large language modelsFoundation modelsDeveloper tools

GPT-3.5 Turbo was the chat-optimised GPT-3.5 model OpenAI released through its API on 1 March 2023, priced at a tenth of the cost of earlier models and later replaced in ChatGPT by GPT-4o mini.

Large language modelsConsumer appsProduct history

A pair of medical question-answering language models described in arXiv papers of 26 December 2022 and 16 May 2023; the first introduced the MultiMedQA benchmark, and Med-PaLM 2 reached up to 86.5% on MedQA.

Large language modelsSafety & governanceScience

Galactica is a large language model for science, unveiled by Meta AI and Papers with Code in November 2022. Its public demo was taken down about three days later, after users found it produced fake papers.

Large language modelsResearch historyOpen source

Jurassic-1 is the first family of large language models from AI21 Labs, announced with the AI21 Studio developer platform in August 2021. Its largest model, Jumbo, has 178 billion parameters.

Large language modelsFoundation modelsDeveloper tools

LaMDA is a family of conversational language models that Google announced in 2021 and described in a 2022 paper, notable for its work on safety and factual grounding in dialogue and for later powering Bard.

Large language modelsResearch historyConsumer apps

T5 is a family of Google Transformer models that recasts every language task as text in, text out. Its 11-billion-parameter version set state of the art on several benchmarks, and the code, models and C4 dataset were released openly.

Large language modelsOpen sourceFoundation models

IBM Watson is a question-answering computer system built by an IBM research team led by David Ferrucci; in February 2011 it defeated the two foremost all-time champions of the televised quiz show Jeopardy!

Research historyEnterpriseReasoning