Skip to content

Commit

Permalink
fix typo (PaddlePaddle#6783)
Browse files Browse the repository at this point in the history
  • Loading branch information
sunzhongkai588 authored Jul 24, 2024
1 parent f2a3145 commit bc26110
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/guides/paddle_v3_features/auto_parallel_cn.md
Original file line number Diff line number Diff line change
Expand Up @@ -129,7 +129,7 @@ dist_tensorD = relu(dist_tensorC)

接下来就会进入自动并行的第二个核心逻辑 **切分转换**
框架会根据 tensor 当前的切分状态(src_placement),和切分推导规则推导出的算子计算需要的切分状态(dst_placement),添加对应的通信/张量维度变换算子。
根据上图的切分推导,在计算 Matmul 添加 split 算子,在计算 Relue 添加 Allreduce,将输入 tensor 转换成需要的切分状态进行实际计算。
根据上图的切分推导,在计算 Matmul 添加 split 算子,在计算 Relu 添加 Allreduce,将输入 tensor 转换成需要的切分状态进行实际计算。

<p align="center">
<img src="https://raw.githubusercontent.com/PaddlePaddle/docs/develop/docs/guides/paddle_v3_features/images/auto_parallel/shard_convertion.png" width="40%"/>
Expand Down

0 comments on commit bc26110

Please sign in to comment.