Top 4 mixture-of-experts open source projects

Multi-Task Learning package built with tensorflow 2 (Multi-Gate Mixture of Experts, Cross-Stitch, Ucertainty Weighting)

Tutel MoE: An Optimized Mixture-of-Experts Implementation

"Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implementation

Hierarchical Mixture of Experts,Mixture Density Neural Network