All Categories → No Category → multimodal-deep-learning

Top 18 multimodal-deep-learning open source projects

Utils and modules for Speech Language and Multimodal processing using pytorch and pytorch lightning

✭ 17

python natural-language-processing pytorch multimodal-learning multimodal multimodal-deep-learning pytorch-lightning wandb

scarches

Reference mapping for single-cell genomics

✭ 175

Jupyter Notebook python deep-learning scrna-seq data-integration single-cell rna-seq-analysis single-cell-genomics batch-correction multimodal-deep-learning multiomics human-cell-atlas

muscaps

Source code for "MusCaps: Generating Captions for Music Audio" (IJCNN 2021)

✭ 39

Jupyter Notebook python shell music-information-retrieval mir multimodal-deep-learning audio-captioning

Robust-Deep-Learning-Pipeline

Deep Convolutional Bidirectional LSTM for Complex Activity Recognition with Missing Data. Human Activity Recognition Challenge. Springer SIST (2020)

Multimodal-Future-Prediction

The official repository for the CVPR 2019 paper "Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Prediction"

✭ 38

python C++CMake trajectory-prediction multimodal-deep-learning

MISE

Multimodal Image Synthesis and Editing: A Survey

✭ 214

TeX transformers gan nerf multimodal-deep-learning diffusion-models

Self-Supervised-Embedding-Fusion-Transformer

The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.

✭ 57

python Cuda bert emotion-recognition multimodal-sentiment-analysis multimodal-deep-learning self-supervised-learning multimodal-emotion-recognition

hateful memes-hate detectron

Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challenge. https://arxiv.org/abs/2012.12975

✭ 35

Jupyter Notebook challenge multimodal-deep-learning hateful-memes hateful-memes-challenge

referit3d

Code accompanying our ECCV-2020 paper on 3D Neural Listeners.

✭ 59

C++python c Cuda shell Makefile computer-vision deep-learning computer-graphics language-modeling rgbd multimodal-deep-learning

iMIX

A framework for Multimodal Intelligence research from Inspur HSSLAB.

✭ 21

python framework vqa multimodal vision-and-language multimodal-deep-learning

multimodal-deep-learning-for-disaster-response

Damage Identification in Social Media Posts using Multimodal Deep Learning: code and dataset

✭ 43

python dataset multimodal-deep-learning decision-fusion feature-fusion disaster-detection

attentive-modality-hopping-for-SER

TensorFlow implementation of "Attentive Modality Hopping for Speech Emotion Recognition," ICASSP-20

✭ 25

python Jupyter Notebook shell speech-emotion-recognition multimodal-deep-learning paralinguistics

mmd

This repository contains the Pytorch implementation for our SCAI (EMNLP-2018) submission "A Knowledge-Grounded Multimodal Search-Based Conversational Agent"

✭ 28

python shell pytorch mmd visual-dialog multimodal-deep-learning

Social-IQ

[CVPR 2019 Oral] Social-IQ: A Question Answering Benchmark for Artificial Social Intelligence

✭ 37

python machine-learning deep-learning multimodal-deep-learning language-and-vision intelligent-qa

circDeep

End-to-End learning framework for circular RNA classification from other long non-coding RNA using multimodal deep learning

✭ 21

python convolutional-neural-networks dynamic-programming circular-rna blstm multimodal-deep-learning

MultiGraphGAN

MultiGraphGAN for predicting multiple target graphs from a source graph using geometric deep learning.

✭ 16

python generative-adversarial-network gan graph-generation brain-connectivity predictive-learning geometric-deep-learning multimodal-deep-learning multi-view-learning brain-graphs predictive-intelligence source-graph target-graph morphological-brain-networks

MSAF

Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"

✭ 47

python shell pytorch action-recognition multimodal-learning multimodal-sentiment-analysis multimodal-deep-learning ntu-rgbd cmu-mosei multimodal-emotion-recognition ravdess

BBFN

This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

✭ 42

python shell multimodal-sentiment-analysis multimodal-deep-learning multimodal-representation huggingface-transformers

1-18 of 18 multimodal-deep-learning projects