使用SmoothQuant高性能实现llama2 openMP、AVX2
使用方法
编译方法
cmake build cd build make
运行方法
./main
-
Notifications
You must be signed in to change notification settings - Fork 0
lee20/llama_int8
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
纯手写高性能实现llama，本地推理
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published