63 Open source projects that are alternatives of or similar to mmgnn_textvqa

Accompanying code for "A Simple Loss Function for Improving the Convergence and Accuracy of Visual Question Answering Models" CVPR 2017 VQA workshop paper.

Must-read papers on graph neural networks (GNN)

Pytorch implementation of NIPS 2017 paper "Modulating early visual processing by language"

PyTorch implementation for the Neuro-Symbolic Concept Learner (NS-CL).

The official PyTorch implementation of "Pathfinder Discovery Networks for Neural Message Passing" (WebConf '21)

读过的CV方向的一些论文，图像生成文字、弱监督分割等

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)

GemNet model in PyTorch, as proposed in "GemNet: Universal Directional Graph Neural Networks for Molecules" (NeurIPS 2021)

An efficient PyTorch implementation of the winning entry of the 2017 VQA Challenge.

PyTorch implementation of "Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning"

A real-time GNN-based method. Understanding Image Retrieval Re-Ranking: A Graph Neural Network Perspective

Bottom-up features extractor implemented in PyTorch.

Code and Data for paper: Zero-shot Visual Question Answering using Knowledge Graph [ ISWC 2021 ]

DVQA Dataset: A Bar chart question answering dataset presented at CVPR 2018

Hadamard Product for Low-rank Bilinear Pooling

A framework for Multimodal Intelligence research from Inspur HSSLAB.

Code and resources on scalable and efficient Graph Neural Networks

PyTorch implementation of MTAD-GAT (Multivariate Time-Series Anomaly Detection via Graph Attention Networks) by Zhao et. al (2020, https://arxiv.org/abs/2009.02040).

PyTorch VQA implementation that achieved top performances in the (ECCV18) VizWiz Grand Challenge: Answering Visual Questions from Blind People

A review of papers proposing novel GNN methods with application to brain connectivity published in 2017-2020.

Code for NeurIPS 2019 paper ``Self-Critical Reasoning for Robust Visual Question Answering''

Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

Oscar and VinVL

An index of recommendation algorithms that are based on Graph Neural Networks.

Strong baseline for visual question answering

A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.

Making self-supervised learning work on molecules by using their 3D geometry to pre-train GNNs. Implemented in DGL and Pytorch Geometric.

Multiple Meta-model Quantifying for Medical Visual Question Answering

Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"

ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration

A Deep Graph Neural Network Architecture for Modelling Spatio-temporal Dynamics in rs-fMRI Data

TensorFlow implementation of the CNN-LSTM, Relation Network and text-only baselines for the paper "FigureQA: An Annotated Figure Dataset for Visual Reasoning"

Tensorflow Implementation of Deeper LSTM+ normalized CNN for Visual Question Answering

[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

Code for reproducing results in GraphMix paper

Code for ICML 2019 paper "Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering" [long-oral]

CloudCV Visual Question Answering Demo

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

Causing: CAUsal INterpretation using Graphs

TensorFlow GNN is a library to build Graph Neural Networks on the TensorFlow platform.

Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome

[CVPR 2020 VL3] The repository for meta fine-tuning in cross-domain few-shot learning.

Neuro-Symbolic Visual Question Answering on Sort-of-CLEVR using PyTorch

A reading list for deep graph learning acceleration.

📷 ❓ Visual Question Answering Demo and Algorithmia API

Pytorch implementation of CVPR2020 paper “VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation”

Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)

STAGIN: Spatio-Temporal Attention Graph Isomorphism Network

Visual Question Answering in Pytorch

List of Publications in Graph Contrastive Learning

A lightweight, scalable, and general framework for visual question answering research

Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)

Learning cell communication from spatial graphs of cells

Federated learning on graph, especially on graph neural networks (GNNs), knowledge graph, and private GNN.

[CVPR 2021] Counterfactual VQA: A Cause-Effect Look at Language Bias

[CVPR 2021 Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning for image-text and video-text tasks.

Visual Q&A reading list