Skip to content

Commit

Permalink
Update multihead-attention.md (d2l-ai#2503)
Browse files Browse the repository at this point in the history
Typo and unnecessary new line in HTML and PDF version
  • Loading branch information
dpkpathak authored May 29, 2023
1 parent c051fdc commit 04488e8
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ combine knowledge from
different behaviors of the same attention mechanism,
such as capturing dependencies of various ranges
(e.g., shorter-range vs. longer-range) within a sequence.
Thus, it may be beneficial
Thus, it may be beneficial
to allow our attention mechanism
to jointly use different representation subspaces
of queries, keys, and values.
Expand Down

0 comments on commit 04488e8

Please sign in to comment.