Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 12, 2023

• Mixtral official (axolotl-ai-cloud#942)

  Show description for 7fabc4d
  winglian

  authored
  7fabc4d

  Copy full SHA for 7fabc4d

• Update requirements.txt (axolotl-ai-cloud#940)

  tokestermw

  authored
  9a5eb39

  Copy full SHA for 9a5eb39

Commits on Dec 10, 2023

• Mixtral: More correct MoE, lower loss (axolotl-ai-cloud#932)

  Show description for 86487c2
  casper-hansen

  authored
  86487c2

  Copy full SHA for 86487c2

• update to latest transformers for mixstral support (axolotl-ai-cloud#929)

  Show description for 35f9b0f
  winglian

  authored
  35f9b0f

  Copy full SHA for 35f9b0f

• Mixtral multipack (axolotl-ai-cloud#928)

  Show description for 68b227a
  winglian

  authored
  68b227a

  Copy full SHA for 68b227a

Commits on Dec 9, 2023

• fixing prompt template of chatml by removal of linebreak (axolotl-ai-cloud#922)

  Show description for 03c6318
  

  timothylimyl

  and

  Timothy Lim

  authored
  03c6318

  Copy full SHA for 03c6318

• support for mamba (axolotl-ai-cloud#915)

  Show description for 40a6362
  winglian

  authored
  40a6362

  Copy full SHA for 40a6362

Commits on Dec 8, 2023

• chore: clarify Readme on sharegpt system role

  NanoCode012

  authored
  d339beb

  Copy full SHA for d339beb

• fix(tokenizer): handle fast tokenizer properly for bos/eos (axolotl-ai-cloud#914)

  NanoCode012

  authored
  fde091c

  Copy full SHA for fde091c

Commits on Dec 7, 2023

• Pin flash-attn to 2.3.3 (axolotl-ai-cloud#919)

  casper-hansen

  authored
  06ae392

  Copy full SHA for 06ae392

Commits on Dec 4, 2023

• feat: add check for quantized model (axolotl-ai-cloud#913)

  Show description for a581e9f
  

  NanoCode012

  and

  winglian

  authored
  a581e9f

  Copy full SHA for a581e9f

• Support device_map=sequential & max_memory config parameters (axolotl-ai-cloud#903)

  Show description for 992e742
  

  brthor

  and

  winglian

  authored
  992e742

  Copy full SHA for 992e742

• Feat(wandb): Refactor to be more flexible (axolotl-ai-cloud#767)

  Show description for a1da39c
  NanoCode012

  authored
  a1da39c

  Copy full SHA for a1da39c

• feature: loss watchdog for terminating training runs that are failing (axolotl-ai-cloud#899)

  Show description for 58ec8b1
  

  kallewoof

  and

  Karl-Johan Alm

  authored
  58ec8b1

  Copy full SHA for 58ec8b1

• Remove learning rate scheduler in deepspeed config to avoid conflict (axolotl-ai-cloud#909)

  Haoxiang-Wang

  authored
  476a205

  Copy full SHA for 476a205

Commits on Nov 30, 2023

• fix for qwen w lora (axolotl-ai-cloud#906)

  winglian

  authored
  3e3229e

  Copy full SHA for 3e3229e

Commits on Nov 29, 2023

• ensure merged model matches the training dtype (axolotl-ai-cloud#902)

  Show description for 1d21aa6
  winglian

  authored
  1d21aa6

  Copy full SHA for 1d21aa6

• Determine FSDP/deepspeed settings on device select. (axolotl-ai-cloud#883)

  Show description for 71b7ea3
  

  3 peopleauthored
  71b7ea3

  Copy full SHA for 71b7ea3

Commits on Nov 27, 2023

• fix: remove FA for qwen examples (axolotl-ai-cloud#900)

  Show description for a48dbf6
  NanoCode012

  authored
  a48dbf6

  Copy full SHA for a48dbf6

Commits on Nov 25, 2023

• update datasets version to cut down the warnings due to pyarrow arg change (axolotl-ai-cloud#897)

  Show description for 6a4562a
  winglian

  authored
  6a4562a

  Copy full SHA for 6a4562a

• Feat: Add Qwen (axolotl-ai-cloud#894)

  Show description for 1115c50
  NanoCode012

  authored
  1115c50

  Copy full SHA for 1115c50

• fix: warning should not show if eval_batch_size not provided (axolotl-ai-cloud#896)

  NanoCode012

  authored
  7ee3c4c

  Copy full SHA for 7ee3c4c

• Feat: Add warmup_ratio (axolotl-ai-cloud#893)

  Show description for fb12895
  NanoCode012

  authored
  fb12895

  Copy full SHA for fb12895

Commits on Nov 22, 2023

• chore(doc): Add info on changing role in sharegpt (axolotl-ai-cloud#886)

  NanoCode012

  authored
  9fc29e0

  Copy full SHA for 9fc29e0

Commits on Nov 18, 2023

• fix: revert local dir dataset load (axolotl-ai-cloud#878)

  NanoCode012

  authored
  575a082

  Copy full SHA for 575a082

Commits on Nov 17, 2023

• Install from git url (axolotl-ai-cloud#874)

  Show description for ddf8150
  msaroufim

  authored
  ddf8150

  Copy full SHA for ddf8150

• Phi update 202311 (axolotl-ai-cloud#876)

  Show description for 9bf854e
  winglian

  authored
  9bf854e

  Copy full SHA for 9bf854e

Commits on Nov 16, 2023

• don't train if eval split is too small (axolotl-ai-cloud#873)

  Show description for 797f3dd
  winglian

  authored
  797f3dd

  Copy full SHA for 797f3dd

• try axolotl-ai-cloud#2: pin hf transformers and accelerate to latest release, don't reinstall pytorch (axolotl-ai-cloud#867)

  Show description for 0de1457
  winglian

  authored
  0de1457

  Copy full SHA for 0de1457

• Feat: Add dataset loading from S3, GCS (axolotl-ai-cloud#765)

  Show description for 3cc67d2
  NanoCode012

  authored
  3cc67d2

  Copy full SHA for 3cc67d2

• allow overriding of model_config parameters from the YML (axolotl-ai-cloud#853)

  Show description for 1bc1186
  winglian

  authored
  1bc1186

  Copy full SHA for 1bc1186

• add e2e tests for checking functionality of resume from checkpoint (axolotl-ai-cloud#865)

  Show description for b3a61e8
  winglian

  authored
  b3a61e8

  Copy full SHA for b3a61e8

• make docker command more robust (axolotl-ai-cloud#861)

  Show description for 8a8d1c4
  winglian

  authored
  8a8d1c4

  Copy full SHA for 8a8d1c4

Commits on Nov 15, 2023

• lint fix that didn't get caught by linter (axolotl-ai-cloud#866)

  winglian

  authored
  332984d

  Copy full SHA for 332984d

• Update data.py for signature generation (axolotl-ai-cloud#851)

  Show description for 48630f5
  

  MilesQLi

  and

  winglian

  authored
  48630f5

  Copy full SHA for 48630f5

Pagination

Previous

Next