GPTJ.md

Inference on Training Data

Run Inference

torchrun --master_port=29085 --nproc-per-node 8 inference.py --config=configs/inference/gptj.yaml

Visualizations

python build_map.py

will build a map in Atlas, one using the internal clustering algorithm provided by Nomic and one using the embeddings generated by the finetuned model.