Skip to content

Tensorflow r2.1 reimplementation of Model-Agnostic Meta-Learning

License

Notifications You must be signed in to change notification settings

HilbertXu/MAML-Tensorflow

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

44 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MAML-Tensorflow

Tensorflow r2.1 reimplementation of Model-Agnostic Meta-Learning from this paper:

Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks

Reinforcement Learning part is adapted from MoritzTaylor/maml-rl-tf2 and tristandeleu/pytorch-maml-rl Sincerely Thanks for their fantastic works!!!

Project Requirements

  1. python 3.x
  2. Tensorflow r2.1
  3. numpy
  4. matplotlib
  5. ...
  6. All Scripts in image_classification folder is tested on python 3.6.5

MiniImagenet Dataset

I wrote a task generator which samples randomly from the whole dataset to set up a train batch during every training steps so it won't consume too much GPU memory.

For 5-way 1-shot tasks on the MiniImagenet, it takes at round 1.6 s to run one training steps on the GTX1070 and for each task update fast_weights 1 time, and it allocate 1.3GB GPU memory.

For 5-way 5-shot tasks on MiniImagenet, it takes at around 2.2 s to run one training steps.

If you set the --update_steps > 1, it will take more time for one training step.

  1. Download the MiniImagenet, and the split files train.csv, test.csv, val.csv from here

  2. Put the MiniImagenet dataset to your project folder like this

    dataset/miniimagenet
    |-- images
    	|--- n0153282900000005.jpg
    	|--- n0153282900000006.jpg
    	...
    |-- test.csv
    |-- train.csv
    |-- val.csv
    
  3. Run the python script to resize and split the whole dataset

    cd scripts/image_classification
    python image_preprocess.py --dataset=miniimagenet
    
  4. Modify the path to dataset in scripts/image_classification/task_generator.py

    if self.dataset == 'miniimagenet':
        ...
        META_TRAIN_DIR = '../../dataset/miniImagenet/train'
        META_VAL_DIR = '../../dataset/miniImagenet/test'
        ...
    
    if self.dataset == 'omniglot':
        ...
            DATA_FOLDER = '../../dataset/omniglot'
            ... 
  5. Run the main python script

    cd scripts/image_classification
    # For 5-way 1-shot on miniimagenet
    python main.py --dataset=miniimagenet --mode=train --n_way=5 --k_shot=1 --k_query=15
    # For 5-way 5-shot on miniimagenet
    python main.py --dataset=miniimagenet --mode=train --n_way=5 --k_shot=5 --k_query=15
    

Omniglot Dataset

For Omniglot dataset, it will consume fewer computing resource and time

For 5-way 1-shot, 0.3 s for one training step

For 20-way 1-shot, 0.7 s for one training step

  1. Download Omniglot dataset from [here](git clone [email protected]:brendenlake/omniglot.git) and extract the contents of python/images_background.zip and python/images_evaluation.zip to the dataset/omniglot it will looks like this:

    dataset/omniglot
    |-- Alphabet_of_the_Magi
    |-- Angelic
    ...
    
  2. Run the python script to resize the images

    cd scripts/image_classification
    python image_preprocess.py --dataset=omniglot
    
  3. Run the main python script

    cd scripts/image_classification
    # For 5-way 1-shot on Omniglot
    python main.py --dataset=omniglot --mode=train --n_way=5 --k_shot=1 --k_query=1 --inner_lr=0.1
    # For 20-way 1-shot on Omniglot
    python main.py --dataset=omniglot --mode=train --n_way=20 --k_shot=1 --k_query=1 --inner_lr=0.1
    

References

This project is, for the most part, a reproduction of the original implementation cbfinn/maml_rl in TensorFlow 2. The experiments are based on the paper

Chelsea Finn, Pieter Abbeel, and Sergey Levine. Model-agnostic meta-learning for fast adaptation of deep networks. International Conference on Machine Learning (ICML), 2017 [ArXiv]

If you want to cite this paper

@article{DBLP:journals/corr/FinnAL17,
  author    = {Chelsea Finn and Pieter Abbeel and Sergey Levine},
  title     = {Model-{A}gnostic {M}eta-{L}earning for {F}ast {A}daptation of {D}eep {N}etworks},
  journal   = {International Conference on Machine Learning (ICML)},
  year      = {2017},
  url       = {http://arxiv.org/abs/1703.03400}
}

About

Tensorflow r2.1 reimplementation of Model-Agnostic Meta-Learning

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages