Mixtral of Experts
- 2024-01-08 Paper
- https://arxiv.org/abs/2401.04088
https://www.reddit.com/r/LocalLLaMA/comments/18m6zjz/for_exllamav2_how_many_mixtral_experts_are/
DPO Mixtral https://twitter.com/jon_durbin/status/1743575483365699809
Here’s an interesting discussion/analysis on Mistral Medium: https://www.reddit.com/r/LocalLLaMA/comments/18m2t0z/deducing_mistral_medium_size_from_pricing_is_it_a/