27 Open source projects that are alternatives of or similar to attentive-modality-hopping-for-SER

This repository contains the Pytorch implementation for our SCAI (EMNLP-2018) submission "A Knowledge-Grounded Multimodal Search-Based Conversational Agent"

[CVPR 2019 Oral] Social-IQ: A Question Answering Benchmark for Artificial Social Intelligence

End-to-End learning framework for circular RNA classification from other long non-coding RNA using multimodal deep learning

MultiGraphGAN for predicting multiple target graphs from a source graph using geometric deep learning.

Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"

This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

Speaker independent emotion recognition

Using Convolutional Neural Networks in speech emotion recognition on the RAVDESS Audio Dataset.

Official implementation of INTERSPEECH 2021 paper 'Emotion Recognition from Speech Using Wav2vec 2.0 Embeddings'

A collection of datasets for the purpose of emotion recognition/detection in speech.

Light-SERNet: A lightweight fully convolutional neural network for speech emotion recognition

Wav2Vec for speech recognition, classification, and audio classification

Speech Emotion Recognition Using Deep Convolutional Neural Network and Discriminant Temporal Pyramid Matching

[ICASSP19] An Interaction-aware Attention Network for Speech Emotion Recognition in Spoken Dialogs

💎 A list of accessible speech corpora for ASR, TTS, and other Speech Technologies

Keras Implementation of Deepmind's WaveNet for Supervised Learning Tasks

Utils and modules for Speech Language and Multimodal processing using pytorch and pytorch lightning

Reference mapping for single-cell genomics

Source code for "MusCaps: Generating Captions for Music Audio" (IJCNN 2021)

Deep Convolutional Bidirectional LSTM for Complex Activity Recognition with Missing Data. Human Activity Recognition Challenge. Springer SIST (2020)

The official repository for the CVPR 2019 paper "Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Prediction"

Multimodal Image Synthesis and Editing: A Survey

The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.

Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challenge. https://arxiv.org/abs/2012.12975

Code accompanying our ECCV-2020 paper on 3D Neural Listeners.

A framework for Multimodal Intelligence research from Inspur HSSLAB.

Damage Identification in Social Media Posts using Multimodal Deep Learning: code and dataset