Top 33 video-understanding open source projects

awesome grounding: A curated list of research papers in visual grounding

Comprehensive, latest, and deployable video deep learning algorithm, including video recognition, action localization, and temporal action detection tasks. It's a high-performance, light-weight codebase provides practical models for video understanding research and application

ActionVLAD for video action classification (CVPR 2017)

STEP: Spatio-Temporal Progressive Learning for Video Action Detection. CVPR'19 (Oral)

The 2nd place Solution to the Youtube-8M Video Understanding Challenge by Team Monkeytyping (based on tensorflow)

Pytorch Implementation of "Object level Visual Reasoning in Videos", F. Baradel, N. Neverova, C. Wolf, J. Mille, G. Mori , ECCV 2018

Paper list of activity prediction and related area

Easily convert RGB video data (e.g. .avi) to the TensorFlow tfrecords file format for training e.g. a NN in TensorFlow. This implementation allows to limit the number of frames per video to be stored in the tfrecords.

Dataset, code and model for the CVPR'20 paper "The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction". And for the ECCV'20 SimAug paper.

An open-source toolbox for action understanding based on PyTorch

TensorFlow code for finetuning I3D model on UCF101.

Tools for movie and video research

Code & Models for Temporal Segment Networks (TSN) in ECCV 2016

[ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding

A Pytorch implemention for some state-of-the-art models for" Temporally Language Grounding in Untrimmed Videos"

[CVPR 2021] TDN: Temporal Difference Networks for Efficient Action Recognition

Temporal Segment Networks (TSN) in PyTorch

OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

temporal action detection with SSN

Temporal Segments LSTM and Temporal-Inception for Activity Recognition

A collection of recent video understanding datasets, under construction!

A curated list of action recognition and related area resources

[ICCV 2021 Oral] Deep Evidential Action Recognition

Useful Toolbox for Anomaly Detection

A new codebase for Group Activity Recognition. It contains codes for ICCV 2021 paper: Spatio-Temporal Dynamic Inference Network for Group Activity Recognition and some other methods.

CP-360-Weakly-Supervised-Saliency

A curated list of “Temporally Language Grounding” and related area

[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

STCNet: Spatio-Temporal Cross Network for Industrial Smoke Detection

What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment [CVPR 2019]

NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions (CVPR'21)

Pytorch implementation of the paper "Glimpse Clouds: Human Activity Recognition from Unstructured Feature Points", F. Baradel, C. Wolf, J. Mille , G.W. Taylor, CVPR 2018

[CVPR 2020] Action Segmentation with Joint Self-Supervised Temporal Domain Adaptation (PyTorch)