SBeA_release

The release version of SBeA.
Linked paper: Multi-animal 3D social pose estimation, identification and behaviour embedding with a few-shot learning framework

For the single animal usage, please jump to Behavior Atlas, and the related paper is A hierarchical 3D-motion learning framework for animal spontaneous behavior mapping

1. The demo of SBeA

Multi-animal tracking cross species

Tracking mice

Tracking parrots

Tracking dogs

Notes:
Blue color: animal 1
Red color: animal 2
Masks: the segmentation of them
Bounding boxes: generated by the maximum external boxes of masks
Left: Video capture with multi-view cameras
Center: Cropped identities
Right: 3D poses with identities of multiple animals

Social behavior clustering of mice autism model

Notes:
Left three frames: the free-social interactions of three group of mice
WT: Wild type mouse
KO: Shank3B knockout mouse
Right: social behavior atlas with distance map
Circle: current social behavior module of left three groups
Trace: previous social behavior modules last 100 frames

2. The tutorials of SBeA

SBeA_tracker
SBeA_mapper