view article Article makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch May 7, 2024 • 112
view article Article Distributed Training with JAX and Flax NNX: A Practical Guide to Sharding Mar 26, 2025 • 11