doublefx / gpt4all Public

forked from nomic-ai/gpt4all

Notifications You must be signed in to change notification settings
Fork 0
Star 0

gpt4all: an ecosystem of open-source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue

MIT license

0 stars 7.8k forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 11 Commits
configs		configs
peft @ 098962f		peft @ 098962f
transformers @ cae78c4		transformers @ cae78c4
.gitignore		.gitignore
.gitmodules		.gitmodules
README.md		README.md
clean.py		clean.py
data.py		data.py
env.yaml		env.yaml
generate.py		generate.py
read.py		read.py
requirements.txt		requirements.txt
train.py		train.py

Repository files navigation

gpt4all

Setup

Clone the repo

git clone --recurse-submodules [email protected]:nomic-ai/gpt4all.git

Setup the environment

python -m pip install -r requirements.txt

cd transformers
pip install -e . 

cd ../peft
pip install -e .

Generate

python generate.py --config configs/generate/generate.yaml --prompt "Write a script to reverse a string in Python

Train

accelerate launch --dynamo_backend=inductor --num_processes=8 --num_machines=1 --machine_rank=0 --deepspeed_multinode_launcher standard --mixed_precision=bf16 --use_deepspeed --deepspeed_config_file=configs/deepspeed/ds_config.json train.py --config configs/train/finetune-7b.yaml