Skip to content

Commit

Permalink
README: Remove Llama2 aar + Center images (pytorch#960)
Browse files Browse the repository at this point in the history
  • Loading branch information
Jack-Khuu authored Jul 29, 2024
1 parent fe7e5b2 commit 2970f8e
Showing 1 changed file with 7 additions and 7 deletions.
14 changes: 7 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -402,9 +402,11 @@ The following assumes you've completed the steps for [Setting up ExecuTorch](#se
*Click the image below to see it in action!*
<p align="center">
<a href="https://pytorch.org/executorch/main/_static/img/llama_ios_app.mp4">
<img src="https://pytorch.org/executorch/main/_static/img/llama_ios_app.png" width="600" alt="iOS app running a LlaMA model">
</a>
</p>
</details>
Expand Down Expand Up @@ -446,15 +448,13 @@ The following assumes you've completed the steps for [Setting up ExecuTorch](#se

6. Follow the app's UI guidelines to pick the model and tokenizer files from the local filesystem. Then issue a prompt.
<img src="https://pytorch.org/executorch/main/_static/img/android_llama_app.png" width="600" alt="Android app running a LlaMA model">
**Note:** The AAR file listed above comes with tiktoken tokenizer, which is used for llama3 model. If you want to use a model with BPE tokenizer (llama2 model for example),
use this AAR
**Note:** The AAR file listed in Step 1 has the tiktoken tokenizer, which is used for Llama 3. To tweak or use a custom tokenizer and runtime, modify the ExecuTorch code
and use [this script](https://github.com/pytorch/executorch/blob/main/build/build_android_llm_demo.sh) to build the AAR library.
* [executorch-llama-bpe-rc3-0719.aar](https://ossci-android.s3.amazonaws.com/executorch/main/executorch-llama-bpe-rc3-0719.aar) (SHASUM: d5fe81d9a4700c36b50ae322e6bf34882134edb0)
* Since the tokenizer is built at compile time, to use a different tokenizer you need to re-build the app.
<p align="center">
<img src="https://pytorch.org/executorch/main/_static/img/android_llama_app.png" width="600" alt="Android app running a LlaMA model">
</p>
If you need to tweak or use your own tokenizer and runtime, modify the ExecuTorch code and use [this script](https://github.com/pytorch/executorch/blob/main/build/build_android_llm_demo.sh) to build the AAR library.
</details>
Expand Down

0 comments on commit 2970f8e

Please sign in to comment.