Total 3 · Clear filters
A February 2024 paper introduced DeepSeekMath 7B, a math-focused language model, and with it Group Relative Policy Optimization, a reinforcement-learning method that drops PPO's critic model.
On 5 July 2023 Nature published Pangu-Weather, a deep-learning global weather model that reported better deterministic forecasts than ECMWF's operational system on every variable it tested, in the same issue as a deep-learning precipitation nowcasting paper.
In October 2022 Tsinghua University's KEG group and Zhipu AI published GLM-130B, an open bilingual model with 130 billion parameters that was accepted to ICLR 2023.
