99 Open source projects that are alternatives of or similar to self_critical_vqa

Many Class Activation Map methods implemented in Pytorch for CNNs and Vision Transformers. Including Grad-CAM, Grad-CAM++, Score-CAM, Ablation-CAM and XGrad-CAM

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

Zennit is a high-level framework in Python using PyTorch for explaining/exploring neural networks using attribution methods like LRP.

ProtoTrees: Neural Prototype Trees for Interpretable Fine-grained Image Recognition, published at CVPR2021

Implementation of the paper "Shapley Explanation Networks"

Bottom-up features extractor implemented in PyTorch.

Code for using CDEP from the paper "Interpretations are useful: penalizing explanations to align neural networks with prior knowledge" https://arxiv.org/abs/1909.13584

Fit interpretable models. Explain blackbox machine learning.

A repository for explaining feature attributions and feature interactions in deep neural networks.

TensorFlow implementation of the CNN-LSTM, Relation Network and text-only baselines for the paper "FigureQA: An Annotated Figure Dataset for Visual Reasoning"

A curated list of awesome machine learning interpretability resources.

[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

The code of AAAI 2020 paper "Transparent Classification with Multilayer Logical Perceptrons and Random Binarization".

In this part, I've introduced and experimented with ways to interpret and evaluate models in the field of image. (Pytorch)

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

A framework for Multimodal Intelligence research from Inspur HSSLAB.

Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)

Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)

Code and Data for paper: Zero-shot Visual Question Answering using Knowledge Graph [ ISWC 2021 ]

CloudCV Visual Question Answering Demo

Oscar and VinVL

Neuro-Symbolic Visual Question Answering on Sort-of-CLEVR using PyTorch

Korean Visual Question Answering

A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.

PyTorch implementation of paper "Visual Concept-Metaconcept Learner", NeruIPS 2019

Mid-level PyTorch Based Framework for Visual Question Answering.

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"

Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome

Multiple Meta-model Quantifying for Medical Visual Question Answering

A pytorch implementation for "A simple neural network module for relational reasoning", working on the CLEVR dataset

A Pytorch implementation of CVPR 2020 paper: Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text

Hadamard Product for Low-rank Bilinear Pooling

[CVPR 2021] Counterfactual VQA: A Cause-Effect Look at Language Bias

Visual Q&A reading list

An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)

No description or website provided.

PyTorch implementation of "Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning"

Repo for ICCV 2021 paper: Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering

Pytorch implementation of NIPS 2017 paper "Modulating early visual processing by language"

[ICCV 2021] TRAR: Routing the Attention Spans in Transformers for Visual Question Answering -- Official Implementation

PyTorch implementation for the Neuro-Symbolic Concept Learner (NS-CL).

[CVPR 2021 Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning for image-text and video-text tasks.

Implementation of Layerwise Relevance Propagation for heatmapping "deep" layers

✂️ Repository for our ICLR 2019 paper: Discovery of Natural Language Concepts in Individual Units of CNNs

PyTorch VQA implementation that achieved top performances in the (ECCV18) VizWiz Grand Challenge: Answering Visual Questions from Blind People

ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration

No description or website provided.

Accompanying code for "A Simple Loss Function for Improving the Convergence and Accuracy of Visual Question Answering Models" CVPR 2017 VQA workshop paper.

读过的CV方向的一些论文，图像生成文字、弱监督分割等

📷 ❓ Visual Question Answering Demo and Algorithmia API

Unsupervised Representation Learning for Singing Voice Separation

DVQA Dataset: A Bar chart question answering dataset presented at CVPR 2018

ISeeU: Visually interpretable deep learning for mortality prediction inside the ICU

An efficient PyTorch implementation of the winning entry of the 2017 VQA Challenge.

Multislice PHATE for tensor embeddings

Official NumPy Implementation of Deep Networks from the Principle of Rate Reduction (2021)

Model interpretability and understanding for PyTorch

A lightweight, scalable, and general framework for visual question answering research