CLIP-for-Mushrooms

About

Finetuning OpenAI's CLIP to match images of mushrooms/fungi with their species/genus name.

• Colab Notebook version here

Dataset

• The full dataset (mushroom_images/) can be downloaded from Google Drive.

• Repository for downloading from scratch

• Thank you to mushroomobserver.org for making this data available.

Setup and Use

• Install docker with GPU support (Ubuntu instructions), then modify and run docker_train.sh
• If not using Docker, install PyTorch and Torchvision and the HuggingFace Transformers libraries with GPU support.