Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 20, 2023

• fix(ppo_trainer): compute mean KL sequence-wise (CarperAI#441)

  Show description for 6e655a4
  maxreciprocate

  authored
  6e655a4

Commits on Apr 17, 2023

• fix(offline_pipeline): ILQL negative indexing under truncation (CarperAI#435)

  Show description for 9bc0836
  maxreciprocate

  authored
  9bc0836

Commits on Apr 13, 2023

• fix(base_trainer): gather weights in save_pretrained under zero3 (CarperAI#429)

  Show description for 2318d04
  maxreciprocate

  authored
  2318d04

• fix(sft_trainer): total_steps calculation when distributed (CarperAI#432)

  maxreciprocate

  authored
  92b68e4

Commits on Apr 11, 2023

• [fix] update pairwise dataloader. (CarperAI#395)

  Show description for adb3be2
  Chen9154

  authored
  adb3be2

• feat(examples): revamp simulacra example (CarperAI#430)

  Show description for 62354b5
  maxreciprocate

  authored
  62354b5

Commits on Apr 10, 2023

• [feat] Support tying metadata to each prompt (CarperAI#421)

  Show description for a66a7da
  maxreciprocate

  authored
  a66a7da

Commits on Apr 6, 2023

• Minibatch impl (CarperAI#364)

  Show description for 565c316
  

  Dahoas

  and

  eluzhnica

  authored
  565c316

Commits on Apr 5, 2023

• fix(CI): use pinned deps for CI testing (CarperAI#423)

  Show description for 9fd1f0a
  jon-tow

  authored
  9fd1f0a

• fix(llama): add position_ids to LlamaModelBranch (CarperAI#418)

  jon-tow

  authored
  656f66c

• Add Supervised Fine-Tuning (SFT) support for NeMo backend (CarperAI#353)

  Show description for 3021f5d
  jon-tow

  authored
  3021f5d

Commits on Apr 4, 2023

• set torch dependency to version 2.0.0 for CUDA in installation instructions (CarperAI#409)

  cauyxy

  authored
  d7225c2

• Add Translation Finetuning Example with T5 (CarperAI#392)

  Show description for 1050813
  

  alexandremuzio

  and

  Alex Muzio

  authored
  1050813

• Convert tensors in stats dict into scalers (CarperAI#417)

  ZHAOTING

  authored
  d3d1cef

• Set pad_token for all tokenizers in tests (CarperAI#414)

  Show description for fdf4c16
  

  cat-state

  and

  cat-state

  authored
  fdf4c16

Commits on Mar 31, 2023

• Release: v0.6.0 (CarperAI#407)

  jon-tow

  authored
  b7db6f9

• Add some synchronization to the db download in the simulacra example (CarperAI#406)

  Show description for b64b798
  dakinggg

  authored
  b64b798

• [feat] Ray train integration (CarperAI#312)

  Show description for c9ab683
  

  maxreciprocate

  and

  Yard1

  authored
  c9ab683

Commits on Mar 30, 2023

• Nemo ILQL fixes (CarperAI#404)

  Show description for c77e304
  

  cat-state

  and

  cat-state

  authored
  c77e304

Commits on Mar 29, 2023

• [fix] Preserve <eos> token and in-place it after trimming (CarperAI#401)

  Show description for a369dad
  maxreciprocate

  authored
  a369dad

• Add Alpaca (CarperAI#400)

  Show description for f63f4bf
  cat-state

  authored
  f63f4bf

Commits on Mar 28, 2023

• [feat] Add benchmark tools (CarperAI#357)

  Show description for 114998b
  maxreciprocate

  authored
  114998b

• Add hypothesis tests for ILQL and fix edge cases (CarperAI#370)

  Show description for 9d85215
  

  cat-state

  and

  cat-state

  authored
  9d85215

Commits on Mar 27, 2023

• [fix] Fix ILQL head sync under ZeRO3 (CarperAI#387)

  Show description for 223ef0f
  maxreciprocate

  authored
  223ef0f

Commits on Mar 26, 2023

• [feat] Add LLaMa Model support for PPO (CarperAI#375)

  Show description for 086a905
  

  3 peopleauthored
  086a905

Commits on Mar 21, 2023

• feat: add requirements.txt from the most recent pip freeze (CarperAI#381)

  maxreciprocate

  authored
  b0c4ea9

• Enable infinite dataloader for prompt_dataloader in PPO Trainer (CarperAI#358)

  Show description for cc52edb
  alexandremuzio

  authored
  cc52edb

Commits on Mar 20, 2023

• feat(modeling_base): add a revision argument for hf_hub_download (CarperAI#382)

  maxreciprocate

  authored
  d5a0634

• fixes half exp not implemented error (CarperAI#363)

  Show description for a920cbc
  

  Dahoas

  and

  maxreciprocate

  authored
  a920cbc

Commits on Mar 17, 2023

• fix(docs): Update incorrect PPORLElement logprob tensor shape hint (CarperAI#377)

  jon-tow

  authored
  79bfc6b

• Fix split for validation (CarperAI#369)

  hzwer

  authored
  2f90ba0

• fix(ilql_trainer): total_steps calculation if running distributed (CarperAI#374)

  Show description for cb85a9e
  maxreciprocate

  authored
  cb85a9e

Commits on Mar 13, 2023

• [fix] Drop <eos> from ILQL sample's phrases (CarperAI#362)

  Show description for 4623105
  maxreciprocate

  authored
  4623105

• fix(ppo_trainer): update AdaptiveKLController with correct KL (CarperAI#361)

  maxreciprocate

  authored
  ded2e5e

Commits on Mar 8, 2023

• Add intermediate checkpointing to accelerate trainers (CarperAI#349)

  Show description for adbf8fc
  jon-tow

  authored
  adbf8fc

Pagination

PreviousNext