Skip to content

Commit

Permalink
link to txl for RL paper
Browse files Browse the repository at this point in the history
  • Loading branch information
lucidrains committed Jan 16, 2021
1 parent 172985a commit 83fbd35
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -575,6 +575,8 @@ logits3, mems3 = model_xl(seg3, mems = mems2, return_mems = True)

<img src="./images/gating.png" width="500px"></img>

https://arxiv.org/abs/1910.06764

The authors propose gating the residual connections in the transformer network and demonstrate increased stability and performance for Transformer-XL in a variety of reinforcement learning tasks.

```python
Expand Down

0 comments on commit 83fbd35

Please sign in to comment.