Skip to content
forked from harubaru/convogpt

Conversational Language model toolkit for training against human preferences.

License

Notifications You must be signed in to change notification settings

JacobFV/convogpt

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

convogpt

This repo contains pretrained models and tools that are to be used for modelling human-aligned dialog.

⚙️ Pretrained Models

Model ID Parameter Count Training Method
convogpt-125m-uft 125 Million Unsupervised Finetuning
convogpt-1.3b-uft 1.3 Billion Unsupervised Finetuning
convogpt-2.7b-uft 2.7 Billion Unsupervised Finetuning
convogpt-6b-uft 6 Billion Unsupervised Finetuning

🔑 Setup

git clone [email protected]:harubaru/convogpt.git
cd convogpt
python -m pip install -r requirements

🤖 Inference

About

Conversational Language model toolkit for training against human preferences.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 95.0%
  • Shell 5.0%