Model Parallelism

A technical note on Helix, a compiler-based graph scheduling system that overlaps communication and computation for n-D model parallel training and inference.

一篇关于 Helix 的技术笔记：它在编译期用图调度为 n-D 模型并行训练和推理自动重叠通信与计算。