pith. sign in

arxiv: 2012.06567 · v1 · pith:LFXRB7TCnew · submitted 2020-12-11 · 💻 cs.CV · cs.MM

A Comprehensive Study of Deep Video Action Recognition

Yi Zhu , Xinyu Li , Chunhui Liu , Mohammadreza Zolfaghari , Yuanjun Xiong , Chongruo Wu , Zhi Zhang , Joseph Tighe
show 2 more authors
R. Manmatha Mu Li
This is my paper
classification 💻 cs.CV cs.MM
keywords videoactionrecognitiondeepdatasetslearningmodelscomprehensive
0
0 comments X
read the original abstract

Video action recognition is one of the representative tasks for video understanding. Over the last decade, we have witnessed great advancements in video action recognition thanks to the emergence of deep learning. But we also encountered new challenges, including modeling long-range temporal information in videos, high computation costs, and incomparable results due to datasets and evaluation protocol variances. In this paper, we provide a comprehensive survey of over 200 existing papers on deep learning for video action recognition. We first introduce the 17 video action recognition datasets that influenced the design of models. Then we present video action recognition models in chronological order: starting with early attempts at adapting deep learning, then to the two-stream networks, followed by the adoption of 3D convolutional kernels, and finally to the recent compute-efficient models. In addition, we benchmark popular methods on several representative datasets and release code for reproducibility. In the end, we discuss open problems and shed light on opportunities for video action recognition to facilitate new research ideas.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. TRUST: Efficient Abdominal Trauma Recognition via Image-to-Ultrasound-Video Transfer Learning

    cs.CV 2026-06 unverdicted novelty 5.0

    TRUST is a scan-aware parameter-efficient image-to-video transfer learning framework for abdominal ultrasound trauma recognition featuring CFCA, MGMA, and VQSA modules that outperforms SOTA by 9.63% on in-house datasets.

  2. AVATAAR: Agentic Video Answering via Temporal Adaptive Alignment and Reasoning

    cs.CV 2025-11 unverdicted novelty 5.0

    AVATAAR reports relative gains of 5-8% over baseline on CinePile benchmark categories through agentic feedback for long video QA.

  3. Low-Latency Video Anonymization for Crowd Anomaly Detection: Privacy Versus Performance

    cs.CV 2024-10 unverdicted novelty 5.0

    LA3D is a new lightweight method for video anonymization that improves privacy protection for crowd anomaly detection while maintaining detection performance better than existing approaches.