Plain-Det

The official PyTorch implementation of the "Plain-Det: A Plain Multi-Dataset Object Detector".

By Cheng Shi*, Yuchen Zhu* and Sibei Yang†

*Equal contribution; †Corresponding Author

Highlights

• Plain-Det is accepted by ECCV2024!
• 2024/12/8: We have released the training code of Plain-Det!

To-do:

• We will release more training weights and results soon.

Main results

Table 1

METHOD	COCO	LVIS	O365	OID	mAP	Paper Position	CFG	CKPT
L	37.2	33.3	13.4	35.3	29.8	Tab1 line3	cfg	ckpt
CL	46.0	33.2	14.2	35.7	32.3	Tab1 line4	cfg	ckpt
CLO	51.8	39.9	33.2	41.7	41.7	Tab1 line5	cfg	ckpt
CLOD	51.9	40.9	33.3	63.4	47.4	Tab1 line6	cfg	ckpt

Note:

• We first release the results of CLOD(COCO, LVIS, Objects365, OIDv4). We are checking other training weights and will update the results soon.
• You can get the label embedding we use from here

Installation

Conda

# create conda environment
conda create -n plaindet python=3.10.11 -y
conda activate plaindet

# install pytorch (other versions may also work)
pip install torch==2.0.0 torchvision==0.15.1 torchaudio==2.0.1

# other requirements
git clone https://github.com/ChengShiest/Plain-Det.git
cd Plain-Det

# install packages
pip install -r requirements.txt

# setup detectron2
python -m pip install -e detectron2

# setup detrex
python setup.py build develop

Prepare datasets for Plain-Det

You can follow detectron2 or detic to download and prepare the dataset.

We place the datasets in the following directory structure:

# Plain-Det datasets structure
├── datasets/
│   ├── coco/
│       ├── annotations/
│       ├── train2017/
│       ├── val2017/
│   ├── lvis
│       ├── lvis_v1_train.json
│       ├── lvis_v1_val.json
│   ├── objects365v2
│       ├── annotations/
│           ├── modified_zhiyuan_objv2_train.json 
│           ├── modified_zhiyuan_objv2_val.json 
│       ├── images/
│           ├── train/
│               ├── patch0/
│               ├── ...
│               ├── patch50/
│           ├── val/
│               ├── patch0/
│               ├── ...
│               ├── patch43/
│   ├── oid
│       ├── annotations/
│           ├── bbox_labels_600_hierarchy-list.json      
│           ├── openimages_v4_train_bbox.json              
│           ├── openimages_v4_val_bbox.json              
│       ├── images/
│           ├── train_0/
│           ├── ...
│           ├── train_f/
│           ├── validation/
│              

Usage

Training

Attention! In our experiments, we use 8/16 A100 GPUs for training. You should modify the num_gpus in the config file to match your own setting. Other numbers may also work, but we haven't tested them. When reading the dataset, due to the large size of the annotation file, memory explosion issues often occur. We have resolved this issue by storing the annotations for each image as a txt file and dynamically loading them. You can process the data yourself or contact us(you can find our code about this in dataset register and mapper).

# You should change the dataset config in \
# ./projects/deformable_detr/configs/deformable_detr_r50_two_stage_800k_clod.py \

# Training
bash scripts/run_CLOD.sh

Evaluation

# You should change the dataset config in \
# ./projects/deformable_detr/configs/deformable_detr_r50_two_stage_800k_clod.py \
# to evaluate different datasets.

# run evaluation
bash scripts/eval.sh

Citing Plain-Det

If you find Plain-Det useful in your research, please consider citing:

inproceedings{
  shi2024plain,
  title={Plain-Det: A Plain Multi-Dataset Object Detector},
}

Acknowledgement

This code is based on detrex and detectron2. Some code are brought from Detic and UniDet. Thanks for their awesome works.