This is a swift clone of examples/batched
.
$ make
$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]
Name | Name | Last commit date | ||
---|---|---|---|---|
parent directory.. | ||||
This is a swift clone of examples/batched
.
$ make
$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]