SSPNet: Scale Selection Pyramid Network for Tiny Person Detection from UAV Images (IEEE GRSL 2021)
We have released the full version code of SSPNet. Code (based on mmdetection) for SSPNet: Scale Selection Pyramid Network for Tiny Person Detection from UAV Images. [PDF].
Illustrations of FPN (a) and our SSPNet (b), where the blue boxes indicate that the object that can not be matched at the current layer will be regarded as a negative sample, and the opposite is a positive sample. The SSM will filter the features flowing from deep layers to the next layer, where those objects that can be both matched at adjacent layers will be reserved, and others (i.e., background, objects that can not be both matched at adjacent layers) will be weakened.
model | Anchor | AP50 | Params | Flops | Speed | Download |
---|---|---|---|---|---|---|
faster_rcnn_r50_sspnet | β | 60.87 | - | - | - | Google Drive Baidu Drive (Passwd:l25j) |
fovea_r50_sspnet | - | 58.49 | - | - | - | Google Drive Baidu Drive (Passwd:ikit) |
pytorch = 1.10.0
python = 3.7.10
cuda = 10.2
numpy = 1.21.2
mmcv-full = 1.3.18
mmdet = 2.19.0
You can also use this command
pip install -r requirements.txt
- Download the TinyPerson Dataset
- Install mmdetection
- Download our customized label (Google Drive, Baidu Drive
passwd:x433
) - Edit the
data_root, ann_file, img_prefix
in./configs/_base_/datasets/coco_detection.py
π Core File π
Config file
config/sspnet/faster_rcnn_r50_sspnet_1x_coco.py (Anchor-based).
config/sspnet/fovea_r50_sspnet_4x4_1x_coco.py (Anchor-free).
Scale Selection Pyramid Network
mmdet/models/necks/ssfpn.py
Weight Sampler
mmdet/core/bbox/samplers/ic_neg_sampler.py
Multiple GPU:
./dist_train.sh ../config/sspnet/faster_rcnn_r50_sspnet_1x_coco.py 2
Single GPU:
python train.py ../config/sspnet/faster_rcnn_r50_sspnet_1x_coco.py
Multiple GPU:
./dist_test.sh ../config/sspnet/faster_rcnn_r50_sspnet_1x_coco.py ../{your_checkpoint_path} 2 --eval bbox
Single GPU:
python test.py ../config/sspnet/faster_rcnn_r50_sspnet_1x_coco.py ../{your_checkpoint_path} --eval bbox
- release customized label
- release pretrain model
- add quantitative results
If you use this code or ideas from the paper for your research, please cite our paper:
@article{hong2021sspnet,
title={SSPNet: Scale Selection Pyramid Network for Tiny Person Detection From UAV Images},
author={Hong, Mingbo and Li, Shuiwang and Yang, Yuchao and Zhu, Feiyu and Zhao, Qijun and Lu, Li},
journal={IEEE Geoscience and Remote Sensing Letters},
year={2021},
publisher={IEEE}
}
[1] Chen, Kai, et al. "MMDetection: Open mmlab detection toolbox and benchmark." arXiv preprint arXiv:1906.07155 (2019).
[2] Yu, Xuehui, et al. "Scale match for tiny person detection." Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2020.