Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add example of amp training & qunatization-aware training #995

Open
nieyan opened this issue Dec 4, 2024 · 5 comments
Open

Add example of amp training & qunatization-aware training #995

nieyan opened this issue Dec 4, 2024 · 5 comments
Labels
examples feature-request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@nieyan
Copy link

nieyan commented Dec 4, 2024

No description provided.

@nieyan nieyan changed the title add pytorch amp training add pytorch amp training & QAT training Dec 4, 2024
@qubvel
Copy link
Collaborator

qubvel commented Dec 4, 2024

Hey, thanks for opening the issue, can you provide more details in the description?

@nieyan
Copy link
Author

nieyan commented Dec 4, 2024

I used mobileone backbone and it was hard to quantization to int8. What's more, the training speed seem too slow if haven't amp .

@qubvel
Copy link
Collaborator

qubvel commented Dec 4, 2024

Thanks for the details. Did you succeed in training and quantization to uint8? If so, would you like to contribute a PR with an example? I don't have such experience, so I would greatly appreciate the contribution.

@nieyan
Copy link
Author

nieyan commented Dec 4, 2024

Thanks for the details. Did you succeed in training and quantization to uint8? If so, would you like to contribute a PR with an example? I don't have such experience, so I would greatly appreciate the contribution.

unfortunately, I haven't find the soultion so I just using mix quantizaiton and that was slow in embedded device.

@qubvel
Copy link
Collaborator

qubvel commented Dec 4, 2024

Ok, let's see if anyone else has a solution

@qubvel qubvel added help wanted Extra attention is needed good first issue Good for newcomers labels Dec 4, 2024
@qubvel qubvel changed the title add pytorch amp training & QAT training Add example of amp training & qunatization-aware training Dec 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
examples feature-request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants