Top 40 vqa open source projects

A lightweight, scalable, and general framework for visual question answering research

[CVPR 2021 Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning for image-text and video-text tasks.

Strong baseline for visual question answering

Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"

读过的CV方向的一些论文，图像生成文字、弱监督分割等

Tensorflow Implementation of Deeper LSTM+ normalized CNN for Visual Question Answering

Hadamard Product for Low-rank Bilinear Pooling

CloudCV Visual Question Answering Demo

Pytorch implementation of NIPS 2017 paper "Modulating early visual processing by language"

Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome

PyTorch VQA implementation that achieved top performances in the (ECCV18) VizWiz Grand Challenge: Answering Visual Questions from Blind People

📷 ❓ Visual Question Answering Demo and Algorithmia API

An efficient PyTorch implementation of the winning entry of the 2017 VQA Challenge.

Visual Question Answering in Pytorch

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)

Visual Q&A reading list

Oscar and VinVL

PyTorch implementation of "Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning"

A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.

PyTorch implementation for the Neuro-Symbolic Concept Learner (NS-CL).

Multiple Meta-model Quantifying for Medical Visual Question Answering

Bottom-up features extractor implemented in PyTorch.

ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration

Accompanying code for "A Simple Loss Function for Improving the Convergence and Accuracy of Visual Question Answering Models" CVPR 2017 VQA workshop paper.

TensorFlow implementation of the CNN-LSTM, Relation Network and text-only baselines for the paper "FigureQA: An Annotated Figure Dataset for Visual Reasoning"

DVQA Dataset: A Bar chart question answering dataset presented at CVPR 2018

[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

Code for ICML 2019 paper "Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering" [long-oral]

A framework for Multimodal Intelligence research from Inspur HSSLAB.

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

A Pytorch implementation of CVPR 2020 paper: Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text

Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)

[CVPR 2021] Counterfactual VQA: A Cause-Effect Look at Language Bias

Code and Data for paper: Zero-shot Visual Question Answering using Knowledge Graph [ ISWC 2021 ]

An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)

Neuro-Symbolic Visual Question Answering on Sort-of-CLEVR using PyTorch

Code for NeurIPS 2019 paper ``Self-Critical Reasoning for Robust Visual Question Answering''