27 Open source projects that are alternatives of or similar to Multimodal-Future-Prediction

Multimodal Image Synthesis and Editing: A Survey

The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.

Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challenge. https://arxiv.org/abs/2012.12975

Code accompanying our ECCV-2020 paper on 3D Neural Listeners.

A framework for Multimodal Intelligence research from Inspur HSSLAB.

Damage Identification in Social Media Posts using Multimodal Deep Learning: code and dataset

TensorFlow implementation of "Attentive Modality Hopping for Speech Emotion Recognition," ICASSP-20

This repository contains the Pytorch implementation for our SCAI (EMNLP-2018) submission "A Knowledge-Grounded Multimodal Search-Based Conversational Agent"

(ECCV 2020) PiP: Planning-informed Trajectory Prediction for Autonomous Driving

[CVPR 2019 Oral] Social-IQ: A Question Answering Benchmark for Artificial Social Intelligence

End-to-End learning framework for circular RNA classification from other long non-coding RNA using multimodal deep learning

MultiGraphGAN for predicting multiple target graphs from a source graph using geometric deep learning.

PyTorch code for CVIU paper "AC-VRNN: Attentive Conditional-VRNN for Multi-Future Trajectory Prediction"

Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"

A Keras multi-input multi-output LSTM-based RNN for object trajectory forecasting

This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANs (CVPR 2019)

Human Trajectory Prediction in Socially Interacting Crowds Using a CNN-based Architecture

Summary of open source code for deep learning models in the field of traffic prediction

Behavior Prediction in Autonomous Driving

[arXiv] What-If Motion Prediction for Autonomous Driving ❓🚗💨

Official implementation codes of "Regularizing neural networks for future trajectory prediction via IRL framework"

Pytorch implementation of CVPR2020 paper “VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation”

Utils and modules for Speech Language and Multimodal processing using pytorch and pytorch lightning

Reference mapping for single-cell genomics

Source code for "MusCaps: Generating Captions for Music Audio" (IJCNN 2021)

Deep Convolutional Bidirectional LSTM for Complex Activity Recognition with Missing Data. Human Activity Recognition Challenge. Springer SIST (2020)