103 Open source projects that are alternatives of or similar to Oscar

Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome

[TPAMI Special Issue on ICCV 2021 Best Papers, Oral] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

A pytorch implementation of "Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering" for image captioning.

Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)

Show and Tell : A Neural Image Caption Generator

Official pytorch implementation of paper "Dual-Level Collaborative Transformer for Image Captioning" (AAAI 2021).

My solutions to the projects assigned for the Udacity Computer Vision Nanodegree

A fast implementation of Neural Image Caption by Chainer

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

Neuro-Symbolic Visual Question Answering on Sort-of-CLEVR using PyTorch

Strong baseline for visual question answering

The objective is to process by generating textual description from an image – based on the objects and actions in the image. Using generative models so that it creates novel sentences. Pipeline type models uses two separate learning process, one for language modelling and other for image recognition. It first identifies objects in image and prov…

Accompanying code for "A Simple Loss Function for Improving the Convergence and Accuracy of Visual Question Answering Models" CVPR 2017 VQA workshop paper.

A length-controllable and non-autoregressive image captioning model.

Learning to Evaluate Image Captioning. CVPR 2018

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

The projects I do in Machine Learning with PyTorch, keras, Tensorflow, scikit learn and Python.

Generating image captions using Xception Network and Beam Search in Keras

Implementation of "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning"

Code and Data for paper: Zero-shot Visual Question Answering using Knowledge Graph [ ISWC 2021 ]

RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words (CVPR 2021)

A lightweight, scalable, and general framework for visual question answering research

Multiple Meta-model Quantifying for Medical Visual Question Answering

A PyTorch implementation of the paper Show, Attend and Tell: Neural Image Caption Generation with Visual Attention

Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"

Tensorflow Implementation of Deeper LSTM+ normalized CNN for Visual Question Answering

Twitter bot for generating photo descriptions (alt text)

My solutions for Assignments of CS231n: Convolutional Neural Networks for Visual Recognition

PyTorch implementation of pix2code. 🔥

PyTorch implementation for the Neuro-Symbolic Concept Learner (NS-CL).

Code for ICML 2019 paper "Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering" [long-oral]

TensorFlow implementation of the CNN-LSTM, Relation Network and text-only baselines for the paper "FigureQA: An Annotated Figure Dataset for Visual Reasoning"

A framework for Multimodal Intelligence research from Inspur HSSLAB.

PyTorch source code for "Stacked Cross Attention for Image-Text Matching" (ECCV 2018)

This repo includes all the projects I have finished in the Udacity Nanodegree programs

DVQA Dataset: A Bar chart question answering dataset presented at CVPR 2018

A Pytorch implementation of CVPR 2020 paper: Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text

Tensorflow implement of paper: A Hierarchical Approach for Generating Descriptive Image Paragraphs

Image Captioning Using Transformer

Using LSTM or Transformer to solve Image Captioning in Pytorch

CS231n Assignments Solutions - Spring 2020

[CVPR 2021] VirTex: Learning Visual Representations from Textual Annotations

[CVPR 2021] Counterfactual VQA: A Cause-Effect Look at Language Bias

Localized Narratives

An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)

A pytorch implemention of "StyleNet: Generating Attractive Visual Captions with Styles"

Code for NeurIPS 2019 paper ``Self-Critical Reasoning for Robust Visual Question Answering''

A curated list of Multimodal Captioning related research(including image captioning, video captioning, and text captioning)

[CVPR 2021 Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning for image-text and video-text tasks.

A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.

Image Captioning with Keras

读过的CV方向的一些论文，图像生成文字、弱监督分割等

Bottom-up features extractor implemented in PyTorch.

Hadamard Product for Low-rank Bilinear Pooling

Pytorch Implementation of Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning

PyTorch implementation of "Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning"

Complete Assignments for CS231n: Convolutional Neural Networks for Visual Recognition

Image Captioning using InceptionV3 and beam search

ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration