SCD-Net [AAAI2024]

The Official implementation for 'SCD-Net: Spatiotemporal Clues Disentanglement Network for Self-supervised Skeleton-based Action Recognition' (AAAI 2024). AAAI arXiv

• Prerequisite
• Data
• Training&Testing
• Log files

Prerequisite

• Pytorch

• We provided requirement file to install all packages, just by running

pip install -r requirements.txt

Data

Generate the data

Download the raw data

• NTU-RGB+D.
• PKU-MMD.

Preprocess

• Preprocess data with python ntu_gendata.py.

Training&Testing

Training

• To train on NTU-RGB+D 60 under Cross-Subject evaluation, you can run

  python ./pretraining.py --lr 0.01 --batch-size 64 --encoder-t 0.2 --encoder-k 8192
  --checkpoint-path ./checkpoints/pretrain/
  --schedule 351 --epochs 451 --pre-dataset ntu60
  --protocol cross_subject --skeleton-representation joint

Testing

• For action recognition on NTU-RGB+D 60 under Cross-Subject evaluation, you can run

  python ./action_classification.py --lr 2 --batch-size 1024
  --pretrained ./checkpoints/pretrain/checkpoint.pth.tar
  --finetune-dataset ntu60 --protocol cross_subject --finetune_skeleton_representation joint

• For action retrieval on NTU-RGB+D 60 under Cross-Subject evaluation, you can run

  python ./action_retrieval.py --knn-neighbours 1
  --pretrained ./checkpoints/pretrain/checkpoint.pth.tar
  --finetune-dataset ntu60 --protocol cross_subject --finetune-skeleton-representation joint

Log files

We also provided some the testing logs in ./log