Skip to content

Commit

Permalink
Finished Attention
Browse files Browse the repository at this point in the history
  • Loading branch information
NLP-LOVE authored Aug 31, 2019
1 parent a55c670 commit eaf187c
Showing 1 changed file with 8 additions and 0 deletions.
8 changes: 8 additions & 0 deletions NLP/16.6 Attention/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,11 @@
## 目录
- [1. 什么是Attention机制](#1-什么是attention机制)
- [2. 计算背景变量](#2-计算背景变量)
- [3. 更新隐藏状态](#3-更新隐藏状态)
- [4. 发展](#4-发展)
- [5. 代码实现](#5-代码实现)
- [6. 参考文献](#6-参考文献)

## 1. 什么是Attention机制

在“编码器—解码器(seq2seq)”⼀节⾥,解码器在各个时间步依赖相同的背景变量来获取输⼊序列信息。当编码器为循环神经⽹络时,背景变量来⾃它最终时间步的隐藏状态。
Expand Down

0 comments on commit eaf187c

Please sign in to comment.