Models

Code Llama is a family of coding models that Meta released in August 2023 by further training Llama 2 on code. It ranges from 7 billion to 70 billion parameters and uses the Llama 2 community license.

Large language modelsOpen sourceDeveloper tools

SparkDesk V2.0 is the second version of iFlytek's large language model, launched on 15 August 2023 with upgraded coding and multimodal abilities, and released alongside the iFlyCode 1.0 programming assistant.

Large language modelsChinaFoundation models

Pangu-Weather is a three-dimensional deep-learning model for medium-range global weather forecasting, published in Nature in 2023; on reanalysis data it produced stronger forecasts than ECMWF's operational system across all tested variables.

ChinaDeep learningScience

Phi-1 is a 1.3-billion-parameter Transformer language model for Python from Microsoft Research, which showed that filtered and synthetic "textbook quality" training data can partly substitute for model and data scale.

Large language modelsOpen sourceData & datasets

StarCoder is an open-access code language model of about 15.5 billion parameters, released on 4 May 2023 by the BigCode project led by Hugging Face and ServiceNow.

Large language modelsOpen sourceData & datasets

Claude is the AI assistant Anthropic announced on 14 March 2023, its first publicly available assistant. It was built around training AI to be helpful, honest and harmless, and it started the Claude model line.

Large language modelsEnterpriseConsumer apps

A pair of medical question-answering language models described in arXiv papers of 26 December 2022 and 16 May 2023; the first introduced the MultiMedQA benchmark, and Med-PaLM 2 reached up to 86.5% on MedQA.

Large language modelsSafety & governanceScience

Galactica is a large language model for science, unveiled by Meta AI and Papers with Code in November 2022. Its public demo was taken down about three days later, after users found it produced fake papers.

Large language modelsResearch historyOpen source

GPT-3.5 is the family of OpenAI language models between GPT-3 and GPT-4, released through API models such as text-davinci-002 and text-davinci-003 and underlying the first version of ChatGPT.

Large language modelsFoundation modelsProduct history

AlphaCode is a DeepMind code-generation system for competitive programming, announced in February 2022. On Codeforces contests held after its training data, it reached an estimated rank around the median participant. A Gemini-based AlphaCode 2 followed in December 2023.

Large language modelsResearch historyCode

Megatron-Turing NLG 530B is a 530-billion-parameter language model announced by NVIDIA and Microsoft on 11 October 2021, then the largest monolithic transformer language model, trained on NVIDIA's Selene supercomputer with Megatron-LM and DeepSpeed combined.

Large language modelsFoundation modelsHardware & compute

LaMDA is a family of conversational language models that Google announced in 2021 and described in a 2022 paper, notable for its work on safety and factual grounding in dialogue and for later powering Bard.

Large language modelsResearch historyConsumer apps

MuZero is a DeepMind reinforcement-learning algorithm that pairs tree-based search with a learned model. It reached superhuman play in Atari, Go, chess and shogi without being given the environment's rules.

Research historyDeep learningReasoning

AlphaStar is a DeepMind system that plays StarCraft II. In 2019 it reached Grandmaster level with all three races, ranking above 99.8% of active players on Battle.net.

Research historyDeep learningReasoning

IBM's chess computer that in May 1997 became the first computer system to defeat a reigning world chess champion in a match under standard tournament time controls.

Research historyProduct historyHardware & compute