Update README.md

oztc · Feb 9, 2024 · 1a91fc2 · 1a91fc2
1 parent 28b96e2
commit 1a91fc2
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -212,6 +212,8 @@ CUDA_VISIBLE_DEVICES=0 python3 -m sglang.launch_server --model-path liuhaotian/l
 CUDA_VISIBLE_DEVICES=0,1 python3 -m sglang.launch_server --model-path liuhaotian/llava-v1.5-13b --tokenizer-path llava-hf/llava-1.5-13b-hf --port 30000 --tp 2
 ```
 
+Tokenizers (temporary): `llava-hf/llava-1.5-7b-hf`, `llava-hf/llava-1.5-13b-hf`, `liuhaotian/llava-v1.6-34b-tokenizer`.
+
 You'll then launch a LLaVA-SGLang worker that will communicate between LLaVA controller and SGLang backend to route the requests. Set `--sgl-endpoint` to `http://127.0.0.1:port` where `port` is the one you just set (default: 30000).
 
 ```Shell