fix: update to how to train

cryptobarbossa · Mar 25, 2023 · 2ac9395 · 2ac9395
1 parent 134d566
commit 2ac9395
Showing 1 changed file with 6 additions and 1 deletion.
diff --git a/README.md b/README.md
@@ -23,4 +23,9 @@ pip install -e .
 
 ## Generate
 
-`python generate.py --config configs/generate/generate.yaml --prompt "Write a script to reverse a string in Python`
+`python generate.py --config configs/generate/generate.yaml --prompt "Write a script to reverse a string in Python`
+
+
+## Train
+
+`accelerate launch --dynamo_backend=inductor --num_processes=8 --num_machines=1 --machine_rank=0 --deepspeed_multinode_launcher standard --mixed_precision=bf16  --use_deepspeed --deepspeed_config_file=configs/deepspeed/ds_config.json train.py --config configs/train/finetune-7b.yaml`