Skip to content

Commit a8329f1

Browse files
authored
Update adadelta.md
1 parent 079d4fc commit a8329f1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

chapter_optimization/adadelta.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ $$\boldsymbol{x}_t \leftarrow \boldsymbol{x}_{t-1} - \boldsymbol{g}'_t. $$
2020

2121
$$\Delta\boldsymbol{x}_t \leftarrow \rho \Delta\boldsymbol{x}_{t-1} + (1 - \rho) \boldsymbol{g}'_t \odot \boldsymbol{g}'_t. $$
2222

23-
可以看到,如不考虑$\epsilon$的影响,AdaDelta算法跟RMSProp算法的不同之处在于使用$\sqrt{\Delta\boldsymbol{x}_{t-1}}$来替代超参数$\eta$。
23+
可以看到,如不考虑$\epsilon$的影响,AdaDelta算法与RMSProp算法的不同之处在于使用$\sqrt{\Delta\boldsymbol{x}_{t-1}}$来替代超参数$\eta$。
2424

2525

2626
## 从零开始实现

0 commit comments

Comments
 (0)