🎯
Focusing
A phD student at school of CS , Fudan University,Shanghai,China
Email:[email protected]
-
Fudan University
- Pu dong new area, Shanghai, China
Lists (2)
Sort Name ascending (A-Z)
Stars
4
stars
written in Cuda
Clear filter
📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, s…
From zero to hero CUDA for accelerating maths and machine learning on GPU.