Skip to content

Commit

Permalink
Add more details about NoisyStudent method.
Browse files Browse the repository at this point in the history
  • Loading branch information
lmthang authored Feb 17, 2020
1 parent cabf63e commit faa02d8
Showing 1 changed file with 10 additions and 6 deletions.
16 changes: 10 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,16 @@

## Overview

NoisyStudent is a semi-supervised learning method which achieves 88.4% top-1
accuracy on ImageNet (SOTA). NoisyStudent is based on the self-training
framework with noise injected to the student model.

We are releasing the training code runnable on SVHN. For ImageNet, we are
experimenting with public image datasets as unlabeled data and will release the
NoisyStudent is a semi-supervised learning method which achieves 88.4% top-1 accuracy on ImageNet (SOTA)
and surprising gains on robustness and adversarial benchmarks.
NoisyStudent is based on the self-training framework and trained with 4 simple steps:
1. Train a classifier on ImageNet (teacher).
2. Infer labels on a much larger unlabeled dataset.
3. Train a larger classifier on the combined set, adding noise (noisy student).
4. Go to step 2, with student as teacher

To allow the community to quickly trying out ideas, we first release the training code runnable on SVHN.
For ImageNet, we are experimenting with public image datasets as unlabeled data and will release the
training code soon.

For a detailed description of technical details and experimental results, please
Expand Down

0 comments on commit faa02d8

Please sign in to comment.