Skip to content

Latest commit

 

History

History
121 lines (80 loc) · 3.71 KB

chat.md

File metadata and controls

121 lines (80 loc) · 3.71 KB

Chat with fine-tuned LLMs

Chat with InternLM

  • InternLM-7B, oasst1

    xtuner chat hf internlm/internlm-7b --adapter xtuner/internlm-7b-qlora-oasst1 --prompt-template openassistant

  • InternLM-7B, Arxiv Gentitle

    xtuner chat hf internlm/internlm-7b --adapter xtuner/internlm-7b-qlora-arxiv-gentitle --prompt-template title

  • InternLM-7B, Colorist

    xtuner chat hf internlm/internlm-7b --adapter xtuner/internlm-7b-qlora-colorist --prompt-template colorist

  • InternLM-7B, Coder

    xtuner chat hf internlm/internlm-7b --adapter xtuner/internlm-7b-qlora-coder --prompt-template code

  • InternLM-7B, SQL

    xtuner chat hf internlm/internlm-7b --adapter xtuner/internlm-7b-qlora-sql --prompt-template sql

  • InternLM-7B, Lawyer

    xtuner chat hf internlm/internlm-7b --adapter xtuner/internlm-7b-qlora-lawyer --prompt-template lawyer

  • InternLM-7B, Open-Platypus

    xtuner chat hf internlm/internlm-7b --adapter xtuner/internlm-7b-qlora-open-platypus --prompt-template alpaca

  • InternLM-7B, Alpaca-enzh

    xtuner chat hf internlm/internlm-7b --adapter xtuner/internlm-7b-qlora-alpaca-enzh --prompt-template alpaca

Chat with Llama2

Don't forget to use huggingface-cli login and input your access token first to access Llama2! See here to learn how to obtain your access token.

  • Llama2-7B, MOSS-003-SFT (plugins!)

    export SERPER_API_KEY="xxx"  # Please get the key from https://serper.dev to support google search!
xtuner chat hf meta-llama/Llama-2-7b-hf --adapter xtuner/Llama-2-7b-qlora-moss-003-sft --bot-name Llama2 --prompt-template moss_sft --with-plugins calculate solve search --command-stop-word "<eoc>" --answer-stop-word "<eom>" --no-streamer

  • Llama2-7B, Arxiv Gentitle

    xtuner chat hf meta-llama/Llama-2-7b-hf --adapter xtuner/Llama-2-7b-qlora-arxiv-gentitle --prompt-template title

  • Llama2-7B, Colorist

    xtuner chat hf meta-llama/Llama-2-7b-hf --adapter xtuner/Llama-2-7b-qlora-colorist --prompt-template colorist

Chat with Qwen

  • Qwen-7B, MOSS-003-SFT (plugins!)

    export SERPER_API_KEY="xxx"  # Please get the key from https://serper.dev to support google search!
xtuner chat hf Qwen/Qwen-7B --adapter xtuner/Qwen-7B-qlora-moss-003-sft --bot-name Qwen --prompt-template moss_sft --with-plugins calculate solve search --command-stop-word "<eoc>" --answer-stop-word "<eom>"

  • Qwen-7B, oasst1

    xtuner chat hf Qwen/Qwen-7B --adapter xtuner/Qwen-7B-qlora-oasst1 --prompt-template openassistant --answer-stop-word '<|endoftext|>'

  • Qwen-7B, Arxiv Gentitle

    xtuner chat hf Qwen/Qwen-7B --adapter xtuner/Qwen-7B-qlora-arxiv-gentitle --prompt-template title --answer-stop-word '<|endoftext|>'

  • Qwen-7B, Alpaca-enzh

    xtuner chat hf Qwen/Qwen-7B --adapter xtuner/Qwen-7B-qlora-alpaca-enzh --prompt-template alpaca --answer-stop-word '<|endoftext|>'

Chat with Baichuan

  • Baichuan-7B, oasst1

    xtuner chat hf baichuan-inc/Baichuan-7B --adapter xtuner/Baichuan-7B-qlora-oasst1 --prompt-template openassistant

  • Baichuan-7B, Arxiv Gentitle

    xtuner chat hf baichuan-inc/Baichuan-7B --adapter xtuner/Baichuan-7B-qlora-arxiv-gentitle --prompt-template title --no-streamer

  • Baichuan-7B, Alpaca-enzh

    xtuner chat hf baichuan-inc/Baichuan-7B --adapter xtuner/Baichuan-7B-qlora-alpaca-enzh --prompt-template alpaca