Skip to main content

YogaTube: A Video Benchmark for Yoga Action Recognition.

Yadav, S., Singh, G., Verma, M., Tiwari, K., Pandey, H., Akbar, S. A. and Corcoran, P., 2022. YogaTube: A Video Benchmark for Yoga Action Recognition. In: WCCI 2022 International Joint Conference on Neural Networks (IJCNN), 18- 23 July 2022, University of Padua Italy. (In Press)

Full text available as:

[img] PDF
YogaTube_WCCI.pdf - Accepted Version
Restricted to Repository staff only until 24 July 2022.
Available under License Creative Commons Attribution Non-commercial.

8MB

Official URL: https://wcci2022.org/

Abstract

Yoga can be seen as a set of fitness exercises involving various body postures. Most of the available pose and action recognition datasets are comprised of easy-to-moderate body pose orientations and do not offer much challenge to the learning algorithms in terms of the complexity of pose. In order to observe action recognition from a different perspective, we introduce YogaTube, a new large-scale video benchmark dataset for yoga action recognition. YogaTube aims at covering a wide range of complex yoga postures, which consist of 5484 videos belonging to a taxonomy of 82 classes of yoga asanas. Also, a three-stream architecture has been designed for yoga asanas pose recognition using two modules, feature extraction, and classification. Feature extraction comprises three parallel components. First, pose is estimated using the part affinity fields model to extract meaningful cues from the practitioner. Second, optical flow is used to extract temporal features. Third, raw RGB videos are used for extracting the spatiotemporal features. Finally in the classification module, pose, optical flow, and RGB streams are fused to get the final results of the yoga asanas. To the best of our knowledge, this is the first attempt to establish a video benchmark yoga recognition dataset. The code and dataset will be released soon.

Item Type:Conference or Workshop Item (Paper)
Uncontrolled Keywords:Action recognition; Yoga, Multi-stream fusion; Deep Learning
Group:Faculty of Science & Technology
ID Code:36994
Deposited By: Symplectic RT2
Deposited On:30 May 2022 10:22
Last Modified:30 May 2022 10:22

Downloads

Downloads per month over past year

More statistics for this item...
Repository Staff Only -