57 Open source projects that are alternatives of or similar to rosita

[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

A framework for Multimodal Intelligence research from Inspur HSSLAB.

A PyTorch implementation of VIOLET

Accompanying code for "A Simple Loss Function for Improving the Convergence and Accuracy of Visual Question Answering Models" CVPR 2017 VQA workshop paper.

TensorFlow implementation of the CNN-LSTM, Relation Network and text-only baselines for the paper "FigureQA: An Annotated Figure Dataset for Visual Reasoning"

DVQA Dataset: A Bar chart question answering dataset presented at CVPR 2018

Pytorch code for ICRA'21 paper: "Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation"

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" （NeurIPS 2019）

Official PyTorch code for the ICIP 2021 paper 'Syntactically Guided Generative Embeddings For Zero Shot Skeleton Action Recognition'

VarCLR: Variable Semantic Representation Pre-training via Contrastive Learning

An ever-growing playground of notebooks showcasing CLIP's impressive zero-shot capabilities

This repository contains my solutions to the assignments for Stanford's CS231n "Convolutional Neural Networks for Visual Recognition" (Spring 2020).

Code for ICML 2019 paper "Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering" [long-oral]

[CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)

Official Tensorflow Implementation of the AAAI-2020 paper "Temporally Grounding Language Queries in Videos by Contextual Boundary-aware Prediction"

A paper list of research conducted based on wikiHow

Awesome Graph Self-Supervised Learning

[ICCV 2021] TRAR: Routing the Attention Spans in Transformers for Visual Question Answering -- Official Implementation

CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks

X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

A Pytorch implementation of CVPR 2020 paper: Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text

Vector Quantized Autoregressive Predictive Coding (VQ-APC)

Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)

[CVPR 2021] Counterfactual VQA: A Cause-Effect Look at Language Bias

(CVPR2021) Kaleido-BERT: Vision-Language Pre-training on Fashion Domain.

Referring Expression Object Segmentation with Caption-Aware Consistency, BMVC 2019

Code and Data for paper: Zero-shot Visual Question Answering using Knowledge Graph [ ISWC 2021 ]

An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)

Neuro-Symbolic Visual Question Answering on Sort-of-CLEVR using PyTorch

Code for NeurIPS 2019 paper ``Self-Critical Reasoning for Robust Visual Question Answering''

A lightweight, scalable, and general framework for visual question answering research

[CVPR 2021 Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning for image-text and video-text tasks.

Strong baseline for visual question answering

Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"

读过的CV方向的一些论文，图像生成文字、弱监督分割等

Tensorflow Implementation of Deeper LSTM+ normalized CNN for Visual Question Answering

Hadamard Product for Low-rank Bilinear Pooling

CloudCV Visual Question Answering Demo

Pytorch implementation of NIPS 2017 paper "Modulating early visual processing by language"

Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome

PyTorch VQA implementation that achieved top performances in the (ECCV18) VizWiz Grand Challenge: Answering Visual Questions from Blind People

📷 ❓ Visual Question Answering Demo and Algorithmia API

An efficient PyTorch implementation of the winning entry of the 2017 VQA Challenge.

Visual Question Answering in Pytorch

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)

Visual Q&A reading list

Oscar and VinVL

PyTorch implementation of "Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning"

A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.

PyTorch implementation for the Neuro-Symbolic Concept Learner (NS-CL).

Multiple Meta-model Quantifying for Medical Visual Question Answering

Bottom-up features extractor implemented in PyTorch.

One Person, One Model, One World: Learning Continual User Representation without Forgetting