All Projects → WilliamYi96 → Awesome-Zero-Shot-Learning

WilliamYi96 / Awesome-Zero-Shot-Learning

Licence: other
Latest progresses (papers & datasets) of zero-shot learning.

Awesome-Zero-Shot-Learning

Selected papers I've read in the field of zero shot learning. PRs are welcome and appreciated as well!

This repo is NOT a complete list of all accepted papers. I'll mainly focus on those papers with open-source implementations and most interesting to me.

Note: This list may contain understanding bias and personal preference. Paper link will not be provided for the one without an available code.

Table of Contents

Papers

Survey

  • GBU (PAMI-18): Yongqin Xian, Christoph H. Lampert, Bernt Schiele, Zeynep Akata. "Zero-shot learning-A comprehensive evaluation of the good, the bad and the ugly". [arXiv] [Project]
  • TIST19: Wei Wang, Vincent W. Zheng, Han Yu, and Chunyan Miao. A Survey of Zero-Shot Learning: Settings, Methods, and Applications. [paper]
  • arXiv20: Farhad Pourpanah, Moloud Abdar, Yuxuan Luo, Xinlei Zhou, Ran Wang, Chee Peng Lim, and Xi-Zhao Wang. A Review of Generalized Zero-Shot Learning Methods. [arxiv]

arXiv

  • DACZSL: Domain-Aware Continual Zero-Shot Learning. Kai Yi, Mohamed Elhoseiny. [paper]
  • GRaWD: Imaginative Walks: Generative Random Walk Deviation Loss for Improved Unseen Learning Representation. Divyansh Jha*, Kai Yi*, Ivan Skorokhodov, Mohamed Elhoseiny. [paper] [code]
  • CIZSL++: CIZSL++: Creativity Inspired Generative Zero-Shot Learning. Mohamed Elhoseiny, Kai Yi, Mohamed Elfeki. [paper] [code]

ECCV 2022

  • HGR-Net: Exploring Hierarchical Graph Representation for Large-Scale Zero-Shot Image Classification. Kai Yi, Xiaoqian Shen, Yunhao Gou, Mohamed Elhoseiny. [paper] [code]

CVPR 2022

NeurIPS 2021

  • HSVA: Hierarchical Semantic-Visual Adaptation for Zero-Shot Learning. Shiming Chen, Guo-Sen Xie, Qinmu Peng, Yang Liu, Baigui Sun, Hao Li, Xinge You, Ling Shao. [paper] [code (not ready)]

ICCV 2021

  • FREE: Feature Refinement for Generalized Zero-Shot Learning. Shiming Chen, Wenjie Wang, Beihao Xia, Qinmu Peng, Xinge You, Feng Zheng, Ling Shao. [paper] [code]
  • SDGZSL: Semantic Disentangling Generalized Zero-Shot Learning. Zhi Chen, Ruihong Qiu, Sen Wang, Zi Huang, Jingjing Li, Zheng Zhang. [paper] [No code - 210805]
  • Field Guide-inspired Zero-Shot Learning. Utkarsh Mall, Bharath Hariharan, Kavita Bala. [paper] [No code - 210901]

CVPR 2021

  • GEM-ZSL: Goal-Oriented Gaze Estimation for Zero-Shot Learning. Yang Liu, Lei Zhou, Xiao Bai, Yifei Huang, Lin Gu, Jun Zhou, Tatsuya Harada. [paper] [code]
  • CE-GZSL: Contrastive Embedding for Generalized Zero-Shot Learning. Zongyan Han, Zhenyong Fu, Shuo Chen, Jian Yang. [paper] [code]
  • CGE: Learning Graph Embeddings for Compositional Zero-Shot Learning. Muhammad Ferjad Naeem, Yongqin Xian, Federico Tombari, Zeynep Akata. [paper] [code]
  • CompCos: Open World Compositional Zero-Shot Learning. Massimiliano Mancini, Muhammad Ferjad Naeem, Yongqin Xian, Zeynep Akata [paper] [code]
  • GCM-CF: Counterfactual Zero-Shot and Open-Set Visual Recognition. Zhongqi Yue, Tan Wang, Qianru Sun, Xian-Sheng Hua, Hanwang Zhang [paper] [code]
  • STHS: Hardness Sampling for Self-Training Based Transductive Zero-Shot Learning. Liu Bo, Qiulei Dong, Zhanyi Hu. [empty github repo - 210805]

ICLR 2021

  • CN-ZSL: Class Normalization for Zero Shot Learning. Ivan Skorokhodov, Mohamed Elhoseiny. [paper] [Code]

    Note: In the paper, the authors investigated basic normalization strategies and proposed the novel class normalization. Besides, they introduced a more general continual zero-shot learning setting. But generally, there is a lot of space to improve on that.
    
  • IPN: Lu Liu, Tianyi Zhou, Guodong Long, Jing Jiang, Xuanyi Dong, Chengqi Zhang. Isometric Propagation Network for Generalized Zero-shot Learning. [No code - 210805]

  • AGZSL: Yu-Ying Chou, Hsuan-Tien Lin, Tyng-Luh Liu. Adaptive and Generative Zero-Shot Learning. [paper] [code]

NeurIPS 2020

ECCV 2020

  • TF-VAEGAN: Latent Embedding Feedback and Discriminative Features for Zero-Shot Classification. Sanath Narayan*, Akshita Gupta*, Fahad Shahbaz Khan, Cees G. M. Snoek, Ling Shao. [arXiv] [Code]

  • LsrGAN: Leveraging Seen and Unseen Semantic Relationships for Generative Zero-Shot Learning. Maunil R Vyas, Hemanth Venkateswara, Sethuraman Panchanathan. [arXiv] [Code]

    Note: This is a paper based on GAZSL and the loss design is interesting and easy to follow. However, this is for transductive zero shot learning, which uses the semantic features of unseen classes at training step.
    
  • OOD: A Boundary Based Out-of-Distribution Classifier for Generalized Zero-Shot Learning. Xingyu Chen, Xuguang Lan, Fuchun Sun, Nanning Zheng. [paper] [code]

    Note: Currently, reproduced results are far below the reported results following the released code. [21--3-16] .
    
  • RGEN: Region Graph Embedding Network for Zero-shot Learning - Guo-Sen Xie, Li Liu, Fan Zhu, Fang Zhao, Zheng Zhang, Yazhou Yao, Jie Qin, Ling Shao. [No code-210311]

CVPR 2020

  • Hyperbolic-ZSL: Shaoteng Liu, Jingjing Chen, Liangming Pan, Chong-Wah Ngo, Tat-Seng Chua, Yu-Gang Jiang. Hyperbolic Visual Embedding Learning for Zero-Shot Recognition. [CVF][Code]

    Note: The most important part in this paper is the evaluations on ImageNet, which has hierarchical structures of labels. However, the processed ImageNet feature data was not provided and no response from the authors yet. I havn't tested the code for this reason so I'm not very sure this implementation can achieve reported results.
    
  • DVBE: Shaobo Min, Hantao Yao, Hongtao Xie, Chaoqun Wang, Zheng-Jun Zha, Yongdong Zhang. Domain-aware Visual Bias Eliminating for Generalized Zero-Shot Learning. [CVF] [code]

  • DAZLE: Dat Huynh, Ehsan Elhamifar. Fine-Grained Generalized Zero-Shot Learning via Dense Attribute-Based Attention. [CVF] [code]

  • LESA: Dat Huynh, Ehsan Elhamifar. A Shared Multi-Attention Framework for Multi-Label Zero-Shot Learning. [CVF] [code]

  • RFF-GZSL: Learning the Redundancy-Free Features for Generalized Zero-Shot Object Recognition. Zongyan Han, Zhenyong Fu, Jian Yang. [No code-210311]

  • SDGN: Jiamin Wu, Tianzhu Zhang, Zheng-Jun Zha, Jiebo Luo, Yongdong Zhang, Feng Wu. Self-supervised Domain-aware Generative Network for Generalized Zero-shot Learning. [CVF] [No code - 210311]

  • E-PGN: Yunlong Yu, Zhong Ji, Jungong Han, Zhongfei Zhang. Episode-based Prototype Generating Network for Zero-Shot Learning. [CVF] [code]

    Note: Code issue - "nan" loss and "0.0" accurracy, [[issue#5]](https://github.com/yunlongyu/EPGN/issues/5).
    
  • OCD: Rohit Keshari, Richa Singh, Mayank Vatsa. Generalized Zero-Shot Learning via Over-Complete Distribution. [No code - 210311]

  • Below partial related:

  • Suchen Wang, Kim-Hui Yap, Junsong Yuan, Yap-Peng Tan. Discovering Human Interactions with Novel Objects via Zero-Shot Learning. [CVF]

  • Pengkai Zhu, Hanxiao Wang, Venkatesh Sligrama. Don't Even Look Once: Synthesizing Features for Zero-Shot Detection. [CVF]

ICCV 2019

  • CIZSL: Mohamed Elhoseiny, Mohamed Elfeki. Creativity Inspired Zero-Shot Learning. [CVF] [arXiv] [Code]

    Note: Very interesting paper on designing a creative loss which can help properly formulate deviation from generating features similar to existing classes while balancing the desirable transfer learning signal.
    
  • AttentionZSL: Yang Liu, Jishun Guo, Deng Cai, Xiaofei He. Attribute Attention for Semantic Disambiguation in Zero-Shot Learning. [CVF] [Code]

  • cvcZSL: Kai Li, Martin Renqiang Min, Yun Fu. Rethinking Zero-Shot Learning: A Conditional Visual Classification Perspective. [CVF] [Code]

  • TMN: Senthil Purushwalkam, Maximilian Nickel, Abhinav Gupta, Marc'Aurelio Ranzato. Task-Driven Modular Networks for Zero-Shot Compositional Learning. [CVF] [Code]

  • TCN: Huajie Jiang, Ruiping Wang, Shiguang Shan, Xilin Chen. Transferable Contrastive Network for Generalized Zero-Shot Learning. [CVF] [No code-210311]

  • ZSL-ABP: Yizhe Zhu, Jianwen Xie, Bingchen Liu, Ahmed Elgammal. Learning Feature-to-Feature Translator by Alternating Back-Propagation for Generative Zero-Shot Learning. [CVF] [Code]

  • Inter-Intra: Yannick Le Cacheux, Herve Le Borgne, Michel Crucianu. Modeling Inter and Intra-Class Relations in the Triplet Loss for Zero-Shot Learning. [CVF] [No code-210311]

CVPR 2019

  • DGP: Michael Kampffmeyer, Yinbo Chen, Xiaodan Liang, Hao Wang, Yujia Zhang, and Eric P. Xing. Rethinking Knowledge Graph Propagation for Zero-Shot Learning. [arXiv] [Code]
  • CADA-VAE: Edgar Schönfeld, Sayna Ebrahimi, Samarth Sinha, Trevor Darrell, Zeynep Akata. Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoders. [CVF] [Code]
  • DLFZRL: Bin Tong, Chao Wang, Martin Klinkigt, Yoshiyuki Kobayashi, Yuuichi Nonaka. Hierarchical Disentanglement of Discriminative Latent Features for Zero-shot Learning. [CVF] [No code-210311]
  • SABR: Akanksha Paul, Naraynan C Krishnan, Prateek Munjal. Semantically Aligned Bias Reducing Zero Shot Learning. [CVF] [No code-210311]
  • Gzsl-VSE: Pengkai Zhu, Hanxiao Wang, Venkatesh Saligrama. Generalized Zero-Shot Recognition based on Visually Semantic Embedding. [CVF] [No code-210311]
  • COSMO: Yuval Atzmon, Gal Chechik. Adaptive Confidence Smoothing for Generalized Zero-Shot Learning. [CVF] [Code]
  • AREN: Guo-Sen Xie, Li Liu, Xiaobo Jin, Fan Zhu, Zheng Zhang, Jie Qin, Yazhou Yao, Ling Shao. Attentive Region Embedding Network for Zero-shot Learning. [CVF] [Code]
  • trivial: Tristan Hascoet, Yasuo Ariki, Tetsuya Takiguchi. On Zero-Shot Learning of generic objects. [CVF] [Code]
  • MLSE: Zhengming Ding, Hongfu Liu. Marginalized Latent Semantic Encoder for Zero-Shot Learning. [CVF] [No code-210311]
  • PrEN: Meng Ye, Yuhong Guo. Progressive Ensemble Networks for Zero-Shot Recognition. [CVF] [No code-210311]
  • GDAN: He Huang, Changhu Wang, Philip S. Yu, Chang-Dong Wang. Generative Dual Adversarial Network for Generalized Zero-shot Learning. [CVF] [Code]
  • PQZSL: Jin Li, Xuguang Lan, Yang Liu, Le Wang, Nanning Zheng. Compressing Unknown Classes with Product Quantizer for Efficient Zero-Shot Classification. [CVF] [No code-210311]
  • LisGAN: Jingjing Li, Mengmeng Jin, Ke Lu, Zhengming Ding, Lei Zhu, Zi Huang. Leveraging the Invariant Side of Generative Zero-Shot Learning. [CVF] [Code]
  • gmnZSL: Mert Bulent Sariyildiz, Ramazan Gokberk Cinbis. Gradient Matching Generative Networks for Zero-Shot Learning. [CVF] [Code]

NeurIPS 2019

  • DASCN: Jian Ni, Shanghang Zhang, Haiyong Xie. Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learning. [CVF] [No code-210311]
  • VSC: Ziyu Wan, Dongdong Chen, Yan Li, Xingguang Yan, Junge Zhang, Yizhou Yu, Jing Liao. Transductive Zero-Shot Learning with Visual Structure Constraint. [CVF] [Code]
  • SGAL: Hyeonwoo Yu, Beomhee Lee. Zero-shot Learning via Simultaneous Generating and Learning. [CVF] [Code]
  • SGMA: Yizhe Zhu, Jianwen Xie, Zhiqiang Tang, Xi Peng, Ahmed Elgammal. Semantic-Guided Multi-Attention Localization for Zero-Shot Learning. [arXiv] [No code-210311]

CVPR 2018

  • GAZSL: Yizhe Zhu, Mohamed Elhoseiny, Bingchen Liu, Xi Peng, Ahmed Elgammal. "A Generative Adversarial Approach for Zero-Shot Learning From Noisy Texts". [arXiv] [Code]

    Note: This paper is one of the earlierst works working on textual-based CUBird and NABird. And the proposed two heads discriminator and the pipeline are widely accepted.
    
  • GCN: Xiaolong Wang, Yufei Ye, Abhinav Gupta. "Zero-shot Recognition via Semantic Embeddings and Knowledge Graphs". [arXiv] [Code]

  • PSR: Yashas Annadani, Soma Biswas. "Preserving Semantic Relations for Zero-Shot Learning". [arXiv] [No code-210311]

  • QFSL: Jie Song, Chengchao Shen, Yezhou Yang, Yang Liu, Mingli Song. "Transductive Unbiased Embedding for Zero-Shot Learning". [CVF] [No code-210311]

  • SP-AEN: Long Chen, Hanwang Zhang, Jun Xiao, Wei Liu, Shih-Fu Chang. "Zero-Shot Visual Recognition Using Semantics-Preserving Adversarial Embedding Networks". [CVF] [code]

  • ML-ZSL: Chung-Wei Lee, Wei Fang, Chih-Kuan Yeh, Yu-Chiang Frank Wang. "Multi-Label Zero-Shot Learning With Structured Knowledge Graphs". [CVF] [No code-210311]

  • SE-GZSL: Vinay Kumar Verma, Gundeep Arora, Ashish Mishra, Piyush Rai. "Generalized Zero-Shot Learning via Synthesized Examples". [CVF] [No code-210311]

  • f-CLSWGAN: Yongqin Xian, Tobias Lorenz, Bernt Schiele, Zeynep Akata. "Feature Generating Networks for Zero-Shot Learning". [CVF] [code]

  • LDF: Yan Li, Junge Zhang, Jianguo Zhang, Kaiqi Huang. "Discriminative Learning of Latent Features for Zero-Shot Recognition". [CVF] [No code-210311]

  • WSL: Li Niu, Ashok Veeraraghavan, and Ashu Sabharwal. "Webly Supervised Learning Meets Zero-shot Learning: A Hybrid Approach for Fine-grained Classification". [CVF] [No code-210311]

  • Kernel: Hongguang Zhang, Piotr Koniusz. "Zero-Shot Kernel Learning". [CVF] [code]

ECCV 2018

  • SZSC: Jie Song, Chengchao Shen, Jie Lei, An-Xiang Zeng, Kairi Ou, Dacheng Tao, Mingli Song. "Selective Zero-Shot Classification with Augmented Attributes". [CVF] [No code-210311]
  • CDL: Huajie Jiang, Ruiping Wang, Shiguang Shan, Xilin Chen. "Learning Class Prototypes via Structure Alignment for Zero-Shot Recognition". [CVF] [No code-210311]
  • cycle-CLSWGAN: Rafael Felix, Vijay Kumar B. G., Ian Reid, Gustavo Carneiro. "Multi-modal Cycle-consistent Generalized Zero-Shot Learning". [CVF] [code]

NeurIPS 2018

  • DCN: Shichen Liu, Mingsheng Long, Jianmin Wang, Michael I. Jordan."Generalized Zero-Shot Learning with Deep Calibration Network". [paper] [code]
  • S2GA: Yunlong Yu, Zhong Ji, Yanwei Fu, Jichang Guo, Yanwei Pang, Zhongfei (Mark) Zhang."Stacked Semantics-Guided Attention Model for Fine-Grained Zero-Shot Learning". [paper] [No code-210311]
  • DIPL: An Zhao, Mingyu Ding, Jiechao Guan, Zhiwu Lu, Tao Xiang, Ji-Rong Wen "Domain-Invariant Projection Learning for Zero-Shot Recognition". [paper] [code]

AAAI 2018

  • GANZrl: Bin Tong, Martin Klinkigt, Junwen Chen, Xiankun Cui, Quan Kong, Tomokazu Murakami, Yoshiyuki Kobayashi. "Adversarial Zero-shot Learning With Semantic Augmentation". [pdf] [No code-210311]
  • JDZsL: Soheil Kolouri, Mohammad Rostami, Yuri Owechko, Kyungnam Kim. "Joint Dictionaries for Zero-Shot Learning". [pdf] [No code-210311]
  • VZSL: Wenlin Wang, Yunchen Pu, Vinay Kumar Verma, Kai Fan, Yizhe Zhang, Changyou Chen, Piyush Rai, Lawrence Carin. "Zero-Shot Learning via Class-Conditioned Deep Generative Models". [pdf] [No code-210311]
  • AS: Yuchen Guo, Guiguang Ding, Jungong Han, Sheng Tang. "Zero-Shot Learning With Attribute Selection". [pdf] [No code-210311]
  • DSSC: Yan Li, Zhen Jia, Junge Zhang, Kaiqi Huang, Tieniu Tan."Deep Semantic Structural Constraints for Zero-Shot Learning". [pdf] [No code-210311]
  • ZsRDA: Yang Long, Li Liu, Yuming Shen, Ling Shao. "Towards Affordable Semantic Searching: Zero-Shot Retrieval via Dominant Attributes". [pdf] [No code-210311]

Datasets

  • TBD
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].