Skip to content

Commit

Permalink
hand pose estimation
Browse files Browse the repository at this point in the history
  • Loading branch information
Hzzone committed Nov 13, 2018
1 parent fcf0fe6 commit bea35b7
Show file tree
Hide file tree
Showing 8 changed files with 298 additions and 213 deletions.
23 changes: 20 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,16 +2,33 @@

pytorch implementation of [openpose](https://github.com/CMU-Perceptual-Computing-Lab/openpose) including **Body and Hand Pose Estimation**, and the pytorch model is directed converted from [openpose](https://github.com/CMU-Perceptual-Computing-Lab/openpose) caffemodel by [caffemodel2pytorch](https://github.com/vadimkantorov/caffemodel2pytorch). You could implement face keypoint detection in the same way if you are interested in.

### Model Download
* [dropbox](https://www.dropbox.com/sh/7xbup2qsn7vvjxo/AABWFksdlgOMXR_r5v3RwKRYa?dl=0)

`*.pth` files are pytorch model, you could also download caffemodel file if you want to use caffe as backend.

### Todo list
- [x] convert caffemodel to pytorch.
- [x] Body Pose Estimation.
- [ ] Hand Pose Estimation.
- [x] Hand Pose Estimation.
- [ ] Performance test.
- [ ] Speed up.

### Demo
#### Skeleton
![](images/skeleton.jpg)

<div align='center'>
<img src='images/skeleton.jpg'>
<div/>

#### Body Pose Estimation
![](images/body_preview.jpg)

<div align='center'>
<img src='images/body_preview.jpg'>
<div/>

### Hand Pose Estimation

<div align='center'>
<img src='images/hand_preview.png'>
<div/>
Binary file modified images/hand.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added images/hand_preview.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added images/hand_preview_estimation.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
291 changes: 277 additions & 14 deletions notebooks/hand.ipynb

Large diffs are not rendered by default.

191 changes: 0 additions & 191 deletions python/test.py

This file was deleted.

5 changes: 0 additions & 5 deletions python/test1.py

This file was deleted.

1 change: 1 addition & 0 deletions python/util.py
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,7 @@ def transfer(model, model_weights):
transfered_model_weights[weights_name] = model_weights['.'.join(weights_name.split('.')[1:])]
return transfered_model_weights

# draw the body keypoint and lims
def draw_bodypose(canvas, candidate, subset):
stickwidth = 4
limbSeq = [[2, 3], [2, 6], [3, 4], [4, 5], [6, 7], [7, 8], [2, 9], [9, 10], \
Expand Down

0 comments on commit bea35b7

Please sign in to comment.