大模型分布式 LLM pipeline parallelism 参考 The Ultra-Scale Playbook: Training LLMs on GPU Clusters 💥 Training Neural Nets on Larger Batches: Practical Tips for 1-GPU, Multi-GPU & Distributed setups | by Thomas Wolf | HuggingFace | Medium Training extremely large neural networks across thousands of GPUs.