A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length.
An improved version of Mistral 7B Instruct, with the following changes:
Modalities
Context
33K
Released
Dec 28, 2023
Knowledge Cutoff
Sep 2023
Token volume and request traffic to this model over time.
A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length. An improved version of Mistral 7B Instruct, with the following changes: - 32k context window (vs 8k context in v0.1) - Rope-theta = 1e6 - No Sliding-Window Attention
Mistral 7B Instruct v0.2 has a 32,768 token context window.
Mistral Medium 3.5, Mistral Small 4, Ministral 3 14B 2512 and 16 more are other text models from Mistral AI.
Mistral 7B Instruct v0.2 was released on December 28, 2023. Its knowledge cutoff is September 30, 2023.