Google announces the 540-billion-parameter PaLM
On 4 April 2022, Google Research announced PaLM, a 540-billion-parameter language model trained on 6,144 TPU v4 chips with the Pathways system, and reported strong multi-step reasoning and above-average-human results on BIG-bench.