Skip to content

Issues: axolotl-ai-cloud/axolotl

Improve Adapter/LoRA handling
#1095 opened Jan 11, 2024 by winglian
Open 4
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

203 Open 533 Closed
203 Open 533 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Cloud running with Modal is broken due to mount issue bug Something isn't working
#2346 opened Feb 19, 2025 by reissbaker
6 of 8 tasks
1
4
Model is not getting saved after fine-tuning with weights and biases config: wandb_log_model bug Something isn't working
#2337 opened Feb 17, 2025 by HeenaRajan
6 of 8 tasks
1
no pad_token or eos_token in wandb eval table "Eval - Predictions vs Ground Truth" bug Something isn't working
#2330 opened Feb 13, 2025 by BaiMoHan
6 of 8 tasks
Can't use Llama3 default chat template with ORPO bug Something isn't working waiting for reporter
#2325 opened Feb 11, 2025 by dannnnthemannnn
6 of 8 tasks
2
Mistral-Small-3 support enhancement New feature or request
#2308 opened Feb 3, 2025 by win4r
5 tasks done
1
axolotl CLI autocomplete enhancement New feature or request
#2297 opened Jan 29, 2025 by winglian
5 tasks done
Refactor training_args_cls logic in trainer_builder.py into a utility function. enhancement New feature or request
#2288 opened Jan 27, 2025 by SalmanMohammadi
@SalmanMohammadi
Adapter mismatch when merging bug Something isn't working
#2277 opened Jan 22, 2025 by teachsheryl
6 of 8 tasks
3
>=4-nodes（4*4gpu） training hangs at zero_first bug Something isn't working
#2275 opened Jan 22, 2025 by sankexin
6 of 8 tasks
3
Refactor Dataset Configuration for Modular Typing, Discriminated Unions, and Backward Compatibility enhancement New feature or request
#2271 opened Jan 21, 2025 by NJordan72
5 tasks done
Unable to run Multi-GPU ORPO training on Gemma model bug Something isn't working
#2267 opened Jan 17, 2025 by chimezie
6 of 8 tasks
1
FSDP+LORA on multiple gpu(A100 80gb*4) ValueError: Cannot flatten integer dtype tensors bug Something isn't working
#2250 opened Jan 10, 2025 by Paxwell-Paxwell
6 of 8 tasks
3
Add an example for reward model chat template in docs documentation Improvements or additions to documentation good first issue Good for newcomers
#2240 opened Jan 6, 2025 by SalmanMohammadi
3 tasks done
[Bug] Resuming training on a pretraining loop does not continue data loading from where it left off bug Something isn't working
#2229 opened Jan 2, 2025 by NanoCode012
6 of 8 tasks
when will add training of deepseek v3？ it`s a big update of llamas enhancement New feature or request
#2228 opened Dec 31, 2024 by sankexin
5 tasks done
1
2
Accelerate v1.2.1 Causes Consistent Errors bug Something isn't working
#2215 opened Dec 23, 2024 by williambarberjr
6 of 8 tasks
2
max_grad_norm doesn't appear to be clipping gradients bug Something isn't working waiting for reporter waiting on upstream
#2214 opened Dec 22, 2024 by DevonPeroutky
6 of 8 tasks
1
"RuntimeError: Invalid device argument : did you call init? "When setting CUDA_VISIBLE_DEVICES bug Something isn't working waiting for reporter
#2199 opened Dec 18, 2024 by zhanghanxing2022
6 of 8 tasks
4
load_from_disk for rl tpye training enhancement New feature or request
#2192 opened Dec 15, 2024 by leeparkuky
5 tasks done
1
APOLLO optimizer enhancement New feature or request
#2175 opened Dec 11, 2024 by fblgit
5 tasks done
7
When starting with DPO datasets, failed error with TypeError. bug Something isn't working waiting for reporter
#2174 opened Dec 11, 2024 by Yuto-24
6 of 8 tasks
7
Show sample batch content enhancement New feature or request
#2145 opened Dec 7, 2024 by fzyzcjy
5 tasks done
2
Support ORPO/DPO Liger losses (and LigerORPOTrainer) enhancement New feature or request wip
#2141 opened Dec 6, 2024 by ccdv-ai
5 tasks done
@NanoCode012
Poential memory leak for axolotl v0.5.2 pretrain streaming datasets with liger kernel bug Something isn't working waiting for reporter
#2108 opened Nov 30, 2024 by deter3
6 of 8 tasks
@bursteratom
5
Various bugs with ORPO bug Something isn't working
#2105 opened Nov 26, 2024 by ccdv-ai
6 of 8 tasks
2
ProTip! Mix and match filters to narrow down what you’re looking for.