Skip to content
forked from kolinko/effort

An implementation of bucketMul LLM inference

License

Notifications You must be signed in to change notification settings

aszc-dev/effort

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

The sources for Effort Engine are here.

They should run with XCode and the newest MacOS version.

You can also download binaries: https://github.com/kolinko/effort/releases/download/0.0.1/effort.0.0.1.zip

and they should work straight away (you'll need option-click them to get through the gatekeeper).

Upon a first run you will be asked to download the converted weights, and then a matrix multiplication benchmark will run.

Remember that this is a tech demo, it's not a chat, it's far from production ready.

For more info : http://kolinko.github.io/effort/

See it in action: https://asciinema.org/a/piP22yYwcaohu5cA2gyuv1W61

I'll fix the Readme.md tomorrow, just spent the whole day building the website, sorry :)

About

An implementation of bucketMul LLM inference

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Swift 71.7%
  • Metal 28.3%