Skip to content

Commit

Permalink
Add head_mask and decoder_head_mask to PyTorch LED (huggingface#9856)
Browse files Browse the repository at this point in the history 
* Add {decoder_,}head_mask to LED

* Fix create_custom_forward signatue in encoder

* Add head_mask to longformer

* Add head_mask to longformer to fix dependencies
of LED on Longformer.

* Not working yet

* Add mising one input in longofrmer_modeling.py

* make fix-copies
  • Loading branch information
@stancld
stancld authored Feb 2, 2021
1 parent d6217fb commit 71bdc07
Show file tree
Hide file tree
Showing 5 changed files with 238 additions and 7 deletions.
Loading

0 comments on commit 71bdc07

Please sign in to comment.