Home›Compute
Compute
Compute
The chips that train and run AI models: GPUs, TPUs and other accelerators, and which models were trained on them.
Total 9 · Clear filters
2023
-
Dec 6, 2023
AMD Instinct MI300X
AMD's data-center GPU for generative AI, released in December 2023. Built on the CDNA 3 architecture with a chiplet design, it leads with 192 GB of HBM3 memory, which AMD contrasted with the 80 GB on Nvidia's H100.
-
Mar 2023
NVIDIA H800
The H800 is a China-market version of NVIDIA's H100 data-center GPU, adapted to fit the US export rules of October 2022 by cutting chip-to-chip transfer speed. It was later used to train DeepSeek-V3 and was covered by tighter US controls in October 2023.
2020
-
May 14, 2020
NVIDIA A100
NVIDIA's A100 is a data-center GPU, the first built on the Ampere architecture. Announced on 14 May 2020, it introduced third-generation Tensor Cores, the TF32 format and Multi-Instance GPU, and became a standard building block for training large language models.
2019
-
Aug 19, 2019
Cerebras Wafer Scale Engine
An AI processor from Cerebras Systems that keeps an entire silicon wafer as one chip, holding more than 1.2 trillion transistors and 400,000 cores; the first of a line that reached WSE-3 in 2024.
2016
-
Apr 5, 2016
NVIDIA Tesla P100
The Tesla P100, announced by NVIDIA in April 2016, was the first data-center GPU on the Pascal architecture, and the first to combine stacked HBM2 memory, half-precision math aimed at deep learning and the NVLink interconnect.
2015
-
2015
Google TPU (first generation)
Google's first-generation Tensor Processing Unit is a custom chip built to speed up neural-network inference in its data centers. Deployed in 2015 and revealed in 2016, it showed that dedicated accelerators could beat CPUs and GPUs on cost-performance.
2014
-
Nov 2014
NVIDIA Tesla K80
NVIDIA's Tesla K80 is a dual-GPU data-center accelerator announced in November 2014, putting two GK210 chips, 24 GB of memory and up to 8.74 teraflops of single-precision performance on one 300 W board.
2010
-
Nov 9, 2010
NVIDIA GeForce GTX 580
A consumer graphics card NVIDIA released in November 2010 on its Fermi architecture. Two of them, each with 3 GB of memory, later trained AlexNet, the network that won ILSVRC-2012 and which NVIDIA's timeline credits with sparking the era of modern AI.
—
-
Tenstorrent Blackhole
Blackhole is Tenstorrent's AI accelerator chip; Galaxy Blackhole is a server holding 32 of them, rated at 23 PFLOPS of block FP8, with Ethernet links wiring chips and clusters together.