Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request for Fine-tuning Data for Continued Pre-training #73

Open
pupumao opened this issue Sep 5, 2024 · 0 comments
Open

Request for Fine-tuning Data for Continued Pre-training #73

pupumao opened this issue Sep 5, 2024 · 0 comments

Comments

@pupumao
Copy link

pupumao commented Sep 5, 2024

While the data for pruning (for_prune) in google drive has been incredibly helpful, I noticed that there doesn't seem to be a dataset provided specifically for the continued fine-tuning phase (for_ft). The absence of this dataset presents a challenge for those of us looking to follow the complete training procedure as outlined in your study.

Would it be possible for you to share the fine-tuning dataset (for_ft). This would be extremely beneficial for the research community to fully replicate and extend the experiments presented in your paper.

@pupumao pupumao changed the title seek for for_ft data Request for Fine-tuning Data for Continued Pre-training Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant