Qwen 1.5 MoE forums
Highly efficient mixture-of-expert (MoE) model from Alibaba
•0 reviews•1 shoutout•51 followers
Subscribe
Sign in
51 followers
Qwen1.5-MoE-A2.7B is a small mixture-of-expert (MoE) model with only 2.7 billion activated parameters yet matches the performance of state-of-the-art 7B models like Mistral 7B and Qwen1.5-7B.
