40 Open source projects that are alternatives of or similar to NExT-QA

[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

A PyTorch implementation of VIOLET

Pytorch implementation of the paper "Glimpse Clouds: Human Activity Recognition from Unstructured Feature Points", F. Baradel, C. Wolf, J. Mille , G.W. Taylor, CVPR 2018

Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)

(CVPR2021) Kaleido-BERT: Vision-Language Pre-training on Fashion Domain.

[CVPR 2020] Action Segmentation with Joint Self-Supervised Temporal Domain Adaptation (PyTorch)

awesome grounding: A curated list of research papers in visual grounding

Comprehensive, latest, and deployable video deep learning algorithm, including video recognition, action localization, and temporal action detection tasks. It's a high-performance, light-weight codebase provides practical models for video understanding research and application

ActionVLAD for video action classification (CVPR 2017)

STEP: Spatio-Temporal Progressive Learning for Video Action Detection. CVPR'19 (Oral)

The 2nd place Solution to the Youtube-8M Video Understanding Challenge by Team Monkeytyping (based on tensorflow)

Pytorch Implementation of "Object level Visual Reasoning in Videos", F. Baradel, N. Neverova, C. Wolf, J. Mille, G. Mori , ECCV 2018

Paper list of activity prediction and related area

Easily convert RGB video data (e.g. .avi) to the TensorFlow tfrecords file format for training e.g. a NN in TensorFlow. This implementation allows to limit the number of frames per video to be stored in the tfrecords.

Dataset, code and model for the CVPR'20 paper "The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction". And for the ECCV'20 SimAug paper.

An open-source toolbox for action understanding based on PyTorch

TensorFlow code for finetuning I3D model on UCF101.

Tools for movie and video research

Code & Models for Temporal Segment Networks (TSN) in ECCV 2016

[ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding

A Pytorch implemention for some state-of-the-art models for" Temporally Language Grounding in Untrimmed Videos"

[CVPR 2021] TDN: Temporal Difference Networks for Efficient Action Recognition

Temporal Segment Networks (TSN) in PyTorch

OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

temporal action detection with SSN

Temporal Segments LSTM and Temporal-Inception for Activity Recognition

A collection of recent video understanding datasets, under construction!

A curated list of action recognition and related area resources

[ICCV 2021 Oral] Deep Evidential Action Recognition

Useful Toolbox for Anomaly Detection

A new codebase for Group Activity Recognition. It contains codes for ICCV 2021 paper: Spatio-Temporal Dynamic Inference Network for Group Activity Recognition and some other methods.

CP-360-Weakly-Supervised-Saliency

A curated list of “Temporally Language Grounding” and related area

STCNet: Spatio-Temporal Cross Network for Industrial Smoke Detection

What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment [CVPR 2019]

Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering | Python3 | PyTorch | CNNs | Causality | Reasoning | LSTMs | Transformers | Multi-Head Self Attention | Published in IEEE Winter Conference on Applications of Computer Vision (WACV) 2021

Code for "Learning the Best Pooling Strategy for Visual Semantic Embedding", CVPR 2021

Vision-Language Transformer and Query Generation for Referring Segmentation (ICCV 2021)

CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks

[ACL 2020] PyTorch code for TVQA+: Spatio-Temporal Grounding for Video Question Answering