Hugging Face announces Transformers v5
On 1 December 2025 Hugging Face released Transformers v5.0.0rc0, the first major version since v4 in November 2020. The library grew from about 40 architectures to more than 400.
Total 7 · Clear filters
Stability AI previews Stable Diffusion 3
On 22 February 2024 Stability AI announced an early preview of Stable Diffusion 3, a text-to-image suite from 800M to 8B parameters that combines a diffusion transformer with flow matching.
Google publishes RT-1
In December 2022, Google researchers posted RT-1, a Robotics Transformer trained on real robot data; they reported over 700 instructions at a 97% success rate and released the code.
NVIDIA announces the Hopper architecture and H100
At GTC on 22 March 2022, NVIDIA announced the Hopper architecture and its first Hopper GPU, the H100, headlined by a Transformer Engine and paired with new HBM3 memory and NVLink, with cloud instances planned from the third quarter of 2022.
Google researchers publish BERT on arXiv
On 11 October 2018 Google researchers posted the BERT paper to arXiv. BERT uses context from both directions in every layer, and a single added output layer is enough to adapt it to tasks such as question answering.
OpenAI publishes the first GPT paper on generative pre-training
On 11 June 2018 OpenAI published a paper on generative pre-training: a language model first learns from unlabeled text and is then adapted to specific tasks. The approach improved the state of the art on 9 of the 12 tasks studied.
“Attention Is All You Need” is posted to arXiv, introducing the Transformer
On 12 June 2017 a team of researchers, most of them at Google, posted the paper Attention Is All You Need to arXiv. It introduced the Transformer, a neural network built only on attention, which became the basis for most later large language models.