Commits

Branch selector

 main

User selector

LucasWilkinson

Datepicker

All time

Commit History

Commits on Mar 9, 2025

• [Attention] Default to FlashMLA backend for MLA (#14451)

  Show description for b0d5419
  

  LucasWilkinson

  and

  tlrmchlsmth

  authored
  b0d5419

  Copy full SHA for b0d5419

Commits on Mar 8, 2025

• [Bugfix] DeepSeek Accuracy (#14476)

  Show description for db84f5e
  LucasWilkinson

  authored
  db84f5e

  Copy full SHA for db84f5e

• [Build/BugFix] Fix hopper 12.8 build (#14354)

  Show description for 7caff01
  

  LucasWilkinson

  and

  tlrmchlsmth

  authored
  7caff01

  Copy full SHA for 7caff01

Commits on Mar 7, 2025

• [BugFix] Illegal Memory Access in the blockwise cutlass fp8 GEMMs (#14396)

  LucasWilkinson

  authored
  e5e03c2

  Copy full SHA for e5e03c2

• [Perf] Reduce MLA CPU overheads in V1 (#14384)

  Show description for dae6896
  LucasWilkinson

  authored
  dae6896

  Copy full SHA for dae6896

Commits on Mar 6, 2025

• [BugFix] MLA + V1, illegal memory access and accuracy issues (#14253)

  Show description for f6bb18f
  LucasWilkinson

  authored
  f6bb18f

  Copy full SHA for f6bb18f

• [BugFix] Fix prefix caching V0 MLA (#14255)

  Show description for 4dacaa4
  

  LucasWilkinson

  and

  ZhongYingMatrix

  authored
  4dacaa4

  Copy full SHA for 4dacaa4

Commits on Feb 27, 2025

• [Attention] Flash MLA for V1 (#13867)

  Show description for 2e94b9c
  

  LucasWilkinson

  and

  chenyang78

  authored
  2e94b9c

  Copy full SHA for 2e94b9c

• [Kernel] FlashMLA integration (#13747)

  Show description for f959039
  LucasWilkinson

  authored
  f959039

  Copy full SHA for f959039

Commits on Feb 25, 2025

• [Bugfix] Fix deepseek-v2 error: "missing 1 required positional argument: 'residual'" (#13802)

  LucasWilkinson

  authored
  4a8cfc7

  Copy full SHA for 4a8cfc7

Commits on Feb 21, 2025

• [Attention] MLA with chunked prefill (#12639)

  Show description for 288cc6c
  

  4 peopleauthored
  288cc6c

  Copy full SHA for 288cc6c

Commits on Feb 7, 2025

• [Bugfix] FA2 illegal memory access (#12848)

  LucasWilkinson

  authored
  ef533d2

  Copy full SHA for ef533d2

Commits on Feb 6, 2025

• [Attention] Use FA3 for MLA on Hopper (#12807)

  Show description for c786e75
  LucasWilkinson

  authored
  c786e75

  Copy full SHA for c786e75

• [Bugfix] Better FP8 supported defaults

  LucasWilkinson

  authored
  76abd0c

  Copy full SHA for 76abd0c

Commits on Feb 5, 2025

• [Perf] Mem align KV caches for CUDA devices (MLA perf improvement) (#12676)

  Show description for 75e9430
  

  LucasWilkinson

  and

  simon-mo

  authored
  75e9430

  Copy full SHA for 75e9430

Commits on Feb 1, 2025

• [Attention] Deepseek v3 MLA support with FP8 compute (#12601)

  Show description for baeded2
  

  7 peopleauthored
  baeded2

  Copy full SHA for baeded2

Commits on Jan 31, 2025

• [Attention] MLA decode optimizations (#12528)

  Show description for cabaf4e
  

  7 peopleauthored
  cabaf4e

  Copy full SHA for cabaf4e

• [Kernel] Update cutlass_scaled_mm to support 2d group (blockwise) scaling (#11868)

  LucasWilkinson

  authored
  9798b2f

  Copy full SHA for 9798b2f

Commits on Jan 27, 2025

• [Build] Only build 9.0a for scaled_mm and sparse kernels (#12339)

  Show description for 103bd17
  LucasWilkinson

  authored
  103bd17

  Copy full SHA for 103bd17

Commits on Jan 26, 2025

• [Bugfix][Kernel] Fix perf regression caused by PR #12405 (#12434)

  Show description for 68f1114
  LucasWilkinson

  authored
  68f1114

  Copy full SHA for 68f1114

Commits on Jan 24, 2025

• [Bugfix][Kernel] FA3 Fix - RuntimeError: This flash attention build only supports pack_gqa (for build size reasons). (#12405)

  Show description for 3132a93
  LucasWilkinson

  authored
  3132a93

  Copy full SHA for 3132a93

• [Bugfix][Kernel] Fix CUDA 11.8 being broken by FA3 build (#12375)

  Show description for ab5bbf5
  LucasWilkinson

  authored
  ab5bbf5

  Copy full SHA for ab5bbf5

Commits on Jan 23, 2025

• [Kernel] Flash Attention 3 Support (#12093)

  Show description for 978b45f
  LucasWilkinson

  authored
  978b45f

  Copy full SHA for 978b45f

Commits on Nov 20, 2024

• [Bugfix] Marlin 2:4 temp fix for large M dim (>256) (#10464)

  Show description for d200972
  LucasWilkinson

  authored
  d200972

  Copy full SHA for d200972

Commits on Nov 18, 2024

• [Kernel] Initial Machete W4A8 support + Refactors (#9855)

  Show description for 96d999f
  LucasWilkinson

  authored
  96d999f

  Copy full SHA for 96d999f

Commits on Oct 22, 2024

• [Bugfix] Fix spurious "No compiled cutlass_scaled_mm ..." for W8A8 on Turing (#9487)

  LucasWilkinson

  authored
  d1e8240

  Copy full SHA for d1e8240

Commits on Oct 17, 2024

• [misc] CUDA Time Layerwise Profiler (#8337)

  Show description for 9d30a05
  

  3 peopleauthored
  9d30a05

  Copy full SHA for 9d30a05

• [Kernel] Add Exllama as a backend for compressed-tensors (#9395)

  LucasWilkinson

  authored
  e312e52

  Copy full SHA for e312e52

Commits on Oct 16, 2024

• [Bugfix][CI/Build] Fix CUDA 11.8 Build (#9386)

  LucasWilkinson

  authored
  717a5f8

  Copy full SHA for 717a5f8

Commits on Oct 11, 2024

• [Bugfix][CI/Build] Fix docker build where CUDA archs < 7.0 are being detected (#9254)

  LucasWilkinson

  authored
  de9fb4b

  Copy full SHA for de9fb4b

Commits on Oct 10, 2024

• [Bugfix] Fix Machete unittests failing with NotImplementedError (#9218)

  LucasWilkinson

  authored
  18511ae

  Copy full SHA for 18511ae

• [Bugfix] Machete garbage results for some models (large K dim) (#9212)

  LucasWilkinson

  authored
  a64e7b9

  Copy full SHA for a64e7b9

Commits on Oct 4, 2024

• [Bugfix] Flash attention arches not getting set properly (#9062)

  LucasWilkinson

  authored
  22482e4

  Copy full SHA for 22482e4

• [CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (#8845)

  LucasWilkinson

  authored
  aeb37c2

  Copy full SHA for aeb37c2

Commits on Sep 27, 2024

• [Bugfix] fix for deepseek w4a16 (#8906)

  Show description for c5d5535
  

  LucasWilkinson

  and

  mgoin

  authored
  c5d5535

  Copy full SHA for c5d5535

Pagination

Previous

Next