Mistral AI and NVIDIA release Mistral NeMo 12B
On 18 July 2024 Mistral AI released Mistral NeMo, a 12B language model built with NVIDIA, with a 128K-token context window, a new multilingual tokenizer called Tekken, FP8-aware training and Apache 2.0 weights.