[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

[NeurIPS 2022] Implementation of "AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition"

Official implementation of "Towards Efficient Visual Adaption via Structural Re-parameterization".

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation