Tags
8 个页面
大模型分布式
device_mesh
data_parallel
pipeline parallelism
tensor_parallel
zero
ring-all-reduce
ulysses_sequence_parallel
fsdp