All Categories → No Category → multimodal-learning

Top 11 multimodal-learning open source projects

Utils and modules for Speech Language and Multimodal processing using pytorch and pytorch lightning

✭ 17

python natural-language-processing pytorch multimodal-learning multimodal multimodal-deep-learning pytorch-lightning wandb

Code for the paper "VistaNet: Visual Aspect Attention Network for Multimodal Sentiment Analysis", AAAI'19

✭ 67

python sentiment-analysis attention-mechanism multimodal-learning multimodal-sentiment-analysis

[ICLR 2019] Learning Factorized Multimodal Representations

✭ 49

python machine-learning representation-learning multimodal-learning

awesome-multimodal-ml

Reading list for research topics in multimodal machine learning

✭ 3,125

machine-learning natural-language-processing reinforcement-learning computer-vision deep-learning robotics healthcare reading-list representation-learning speech-processing multimodal-learning

CoVA-Web-Object-Detection

A Context-aware Visual Attention-based training pipeline for Object Detection from a Webpage screenshot!

✭ 18

python computer-vision deep-learning pytorch information-extraction attention convolutional-neural-networks object-detection graph-convolutional-networks multimodal-learning graph-attention-networks visual-attention

[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

✭ 57

Jupyter Notebook python HTML vqa video-understanding weakly-supervised-learning multimodal-learning visual-question-answering question-generation vision-and-language videoqa pre-training video-question-answering

multimodal-vae-public

A PyTorch implementation of "Multimodal Generative Models for Scalable Weakly-Supervised Learning" (https://arxiv.org/abs/1802.05335)

✭ 98

python machine-learning variational-autoencoder generative-models multimodal-learning

mvits for class agnostic od

Multi-modal Transformers Excel at Class-agnostic Object Detection

✭ 118

python Cuda shell C++multimodal-learning class-agnostic-detection open-world-detection

Interface for easier topic modelling.

✭ 127

python shell pypi topic-modeling multimodal-learning modalities document-representation multimodal-data topic-modelling bigartm-library custom-score

Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"

✭ 47

python shell pytorch action-recognition multimodal-learning multimodal-sentiment-analysis multimodal-deep-learning ntu-rgbd cmu-mosei multimodal-emotion-recognition ravdess

Knowledge-Aware machine LEarning (KALE): accessible machine learning from multiple sources for interdisciplinary research, part of the 🔥PyTorch ecosystem

✭ 381

python data-science machine-learning computer-vision deep-learning pytorch transfer-learning graph-analysis domain-adaptation meta-learning medical-image-analysis multimodal-learning multimodal knowledge-aware-learning

1-11 of 11 multimodal-learning projects