Yadav, S., Singh, G., Verma, M., Tiwari, K., Pandey, H., Akbar, S. A. and Corcoran, P., 2022. YogaTube: A Video Benchmark for Yoga Action Recognition. In: WCCI 2022 International Joint Conference on Neural Networks (IJCNN), 18- 23 July 2022, University of Padua Italy.
Full text available as:
|
PDF
YogaTube_WCCI.pdf - Accepted Version Available under License Creative Commons Attribution Non-commercial. 8MB | |
Copyright to original material in this document is with the original owner(s). Access to this content through BURO is granted on condition that you use it only for research, scholarly or other non-commercial purposes. If you wish to use it for any other purposes, you must contact BU via BURO@bournemouth.ac.uk. Any third party copyright material in this document remains the property of its respective owner(s). BU grants no licence for further use of that third party material. |
Official URL: https://wcci2022.org/
Abstract
Yoga can be seen as a set of fitness exercises involving various body postures. Most of the available pose and action recognition datasets are comprised of easy-to-moderate body pose orientations and do not offer much challenge to the learning algorithms in terms of the complexity of pose. In order to observe action recognition from a different perspective, we introduce YogaTube, a new large-scale video benchmark dataset for yoga action recognition. YogaTube aims at covering a wide range of complex yoga postures, which consist of 5484 videos belonging to a taxonomy of 82 classes of yoga asanas. Also, a three-stream architecture has been designed for yoga asanas pose recognition using two modules, feature extraction, and classification. Feature extraction comprises three parallel components. First, pose is estimated using the part affinity fields model to extract meaningful cues from the practitioner. Second, optical flow is used to extract temporal features. Third, raw RGB videos are used for extracting the spatiotemporal features. Finally in the classification module, pose, optical flow, and RGB streams are fused to get the final results of the yoga asanas. To the best of our knowledge, this is the first attempt to establish a video benchmark yoga recognition dataset. The code and dataset will be released soon.
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Uncontrolled Keywords: | Action recognition; Yoga, Multi-stream fusion; Deep Learning |
Group: | Faculty of Science & Technology |
ID Code: | 36994 |
Deposited By: | Symplectic RT2 |
Deposited On: | 30 May 2022 10:22 |
Last Modified: | 01 Sep 2022 12:31 |
Downloads
Downloads per month over past year
Repository Staff Only - |