Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Av dev #119

Merged
merged 18 commits into from
Jul 18, 2020
Merged

Av dev #119

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
2694253
add audio-viusal modeling functionalities
Jun 18, 2020
e7b1c93
add audio-visual decoding functionalities
Jun 18, 2020
6412041
add audio-visual decoding functionalities
Jun 18, 2020
5f5c5aa
add audio-visual decoding functionalities
Jun 18, 2020
a6881de
Adding tutorials for Audio-Visual models and Gradient-Blending
Jul 18, 2020
59043b9
Adding tutorials for Audio-Visual models and Gradient-Blending
Jul 18, 2020
55f11e9
Merge branch 'av_dev' of github.com:facebookresearch/VMZ into av_dev
Jul 18, 2020
ccb1fe6
Merge branch 'av_dev' of github.com:facebookresearch/VMZ into av_dev
Jul 18, 2020
155d9ee
Merge branch 'av_dev' of github.com:facebookresearch/VMZ into av_dev
Jul 18, 2020
de050d8
add audio-viusal modeling functionalities
Jun 18, 2020
ff1474e
add audio-visual decoding functionalities
Jun 18, 2020
f8ad0f2
add audio-visual decoding functionalities
Jun 18, 2020
bfc0c6a
add audio-visual decoding functionalities
Jun 18, 2020
1549231
Adding tutorials for Audio-Visual models and Gradient-Blending
Jul 18, 2020
66209d3
Adding tutorials for Audio-Visual models and Gradient-Blending
Jul 18, 2020
c59c441
Merge branch 'av_dev' of github.com:facebookresearch/VMZ into av_dev
Jul 18, 2020
ead5a5e
Remove c builds
Jul 18, 2020
1eef973
Fix README.md
Jul 18, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,13 @@ Currently, this codebase supports the following models:
+ R(2+1)D, MCx models [[1]](https://research.fb.com/wp-content/uploads/2018/04/a-closer-look-at-spatiotemporal-convolutions-for-action-recognition.pdf).
+ CSN models [[2]](https://arxiv.org/pdf/1904.02811.pdf) (**note:pytorch implementation is buggy**).
+ R(2+1)D and CSN models pre-trained on large-scale (65 million!) weakly-supervised public Instagram videos (**IG-65M**) [[3]](https://research.fb.com/wp-content/uploads/2019/05/Large-scale-weakly-supervised-pre-training-for-video-action-recognition.pdf).
+ Gradient-Blending for audio-visual modeling [[4]](https://arxiv.org/pdf/1905.12681.pdf) (Caffe2 Only)

## References
1. D. Tran, H. Wang, L. Torresani, J. Ray, Y. LeCun and M. Paluri. **A Closer Look at Spatiotemporal Convolutions for Action Recognition.** CVPR 2018.
2. D. Tran, H. Wang, L. Torresani and M. Feiszli. **Video Classification with Channel-Separated Convolutional Networks.** ICCV 2019.
3. D. Ghadiyaram, M. Feiszli, D. Tran, X. Yan, H. Wang and D. Mahajan, **Large-scale weakly-supervised pre-training for video action recognition.** CVPR 2019.
4. W. Wang, D. Tran, M. Feiszli, **What Makes Training Multi-Modal Classification Networks Hard?** CVPR 2020.


## Suporting Team
Expand Down
Loading