Skip to content

Pull requests: NVIDIA/FasterTransformer

New pull request New
Clear current search query, filters, and sorts
40 Open 129 Closed
40 Open 129 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: fix position_encoding_table memory error.
#791 opened Mar 27, 2024 by johnson-magic • Review required
1
Update README.md
#776 opened Oct 29, 2023 by eltociear • Review required
Fix shape mismatch on the masked_tokens param in decoder masked multi-head attention kernel.
#773 opened Oct 24, 2023 by FengDSP • Review required
Include stdio.h
#770 opened Oct 19, 2023 by JihaoXin • Review required
2
Ft llama opt
#762 opened Oct 2, 2023 by dypshong • Review required
Support Seq length up to 8K
#756 opened Sep 4, 2023 by zhen-jia • Review required
[BugFix] GPT inference error when pipeline_para_size > 1 and int8_mode != 0
#750 opened Aug 23, 2023 by 00why00 • Review required
[Bugfix] GptJ & GptNeoX batch inference error
#742 opened Aug 11, 2023 by YZP17121579 • Review required
1
Add fusion-for-decoder-only for llama
#733 opened Jul 28, 2023 by binxuan • Review required
Fix beam search output_log_prob index error
#732 opened Jul 25, 2023 by cpm0722 • Review required
[Doc] Add projects section in README which is developed based on FasterTransformer
#731 opened Jul 25, 2023 by lvhan028 • Review required
2
Add triton fastertransformer backend support for deberta
#725 opened Jul 19, 2023 by sfc-gh-zhwang • Review required
1
Add cuDNN include path as a common include dir
#724 opened Jul 18, 2023 by jacobkahn • Review required
fix: initialize tiled_prompt_lengths_buf_ to zero in gptneox
#716 opened Jul 13, 2023 by yandai • Review required
Remove parenthesis from asserts
#699 opened Jul 2, 2023 by miguelusque • Review required
Huggingface gptj convert script supports sharded checkpoint
#695 opened Jun 29, 2023 by skyser2003 • Review required
[Doc] Fix typo in gpt_guide.md
#682 opened Jun 26, 2023 by myry96 • Review required
swin-transformer quantization readme files changes
#675 opened Jun 16, 2023 by Mhhhaster • Review required
fix: fix Qk_vec_acum_fp32_ has already been declared
#659 opened Jun 9, 2023 by lkm2835 • Review required
gptneox & gptj int8 quantization & share context
#653 opened Jun 7, 2023 by rahuan • Review required
Add missing headers
#648 opened Jun 1, 2023 by brian14708 • Review required
Fix TOC of gptneox_guide.md
#633 opened May 23, 2023 by xu-song • Review required
Update gpt_guide.md: documentation link is invalid
#620 opened May 22, 2023 by treycheng • Review required
fix multi-gpu build
#616 opened May 17, 2023 by dskhudia • Review required
1
Fix mpi library linking issue
#612 opened May 16, 2023 by liangfu • Review required
ProTip! What’s not been updated in a month: updated:<2025-02-01.