GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → YoungXIAO13 → FewShotDetection

YoungXIAO13 / FewShotDetection

Licence: MIT license
(ECCV 2020) PyTorch implementation of paper "Few-Shot Object Detection and Viewpoint Estimation for Objects in the Wild"

Programming Languages

python
139335 projects - #7 most used programming language
c
50402 projects - #5 most used programming language
Cuda
1817 projects
shell
77523 projects

Labels

few-shot-learningfew-shot-object-detection

Projects that are alternatives of or similar to FewShotDetection

Awesome-Few-shot
Awesome Few-shot learning
Stars: ✭ 50 (-73.4%)
Mutual labels:  few-shot-learning, few-shot-object-detection
simple-cnaps
Source codes for "Improved Few-Shot Visual Classification" (CVPR 2020), "Enhancing Few-Shot Image Classification with Unlabelled Examples" (WACV 2022), and "Beyond Simple Meta-Learning: Multi-Purpose Models for Multi-Domain, Active and Continual Few-Shot Learning" (Neural Networks 2022 - in submission)
Stars: ✭ 88 (-53.19%)
Mutual labels:  few-shot-learning
Transferlearning
Transfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-迁移学习
Stars: ✭ 8,481 (+4411.17%)
Mutual labels:  few-shot-learning
P-tuning
A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
Stars: ✭ 593 (+215.43%)
Mutual labels:  few-shot-learning
protonet-bert-text-classification
finetune bert for small dataset text classification in a few-shot learning manner using ProtoNet
Stars: ✭ 28 (-85.11%)
Mutual labels:  few-shot-learning
awesome-few-shot-meta-learning
awesome few shot / meta learning papers
Stars: ✭ 44 (-76.6%)
Mutual labels:  few-shot-learning
few-shot-gan-adaptation
[CVPR '21] Official repository for Few-shot Image Generation via Cross-domain Correspondence
Stars: ✭ 198 (+5.32%)
Mutual labels:  few-shot-learning
one-shot-steel-surfaces
One-Shot Recognition of Manufacturing Defects in Steel Surfaces
Stars: ✭ 29 (-84.57%)
Mutual labels:  few-shot-learning
few shot dialogue generation
Dialogue Knowledge Transfer Networks (DiKTNet)
Stars: ✭ 24 (-87.23%)
Mutual labels:  few-shot-learning
few-shot-segmentation
PyTorch implementation of 'Squeeze and Excite' Guided Few Shot Segmentation of Volumetric Scans
Stars: ✭ 78 (-58.51%)
Mutual labels:  few-shot-learning
SCL
📄 Spatial Contrastive Learning for Few-Shot Classification (ECML/PKDD 2021).
Stars: ✭ 42 (-77.66%)
Mutual labels:  few-shot-learning
LibFewShot
LibFewShot: A Comprehensive Library for Few-shot Learning.
Stars: ✭ 629 (+234.57%)
Mutual labels:  few-shot-learning
Learning-To-Compare-For-Text
Learning To Compare For Text , Few shot learning in text classification
Stars: ✭ 38 (-79.79%)
Mutual labels:  few-shot-learning
Meta Learning Papers
Meta Learning / Learning to Learn / One Shot Learning / Few Shot Learning
Stars: ✭ 2,420 (+1187.23%)
Mutual labels:  few-shot-learning
FUSION
PyTorch code for NeurIPSW 2020 paper (4th Workshop on Meta-Learning) "Few-Shot Unsupervised Continual Learning through Meta-Examples"
Stars: ✭ 18 (-90.43%)
Mutual labels:  few-shot-learning
Awesome Domain Adaptation
A collection of AWESOME things about domian adaptation
Stars: ✭ 3,357 (+1685.64%)
Mutual labels:  few-shot-learning
multilingual kws
Few-shot Keyword Spotting in Any Language and Multilingual Spoken Word Corpus
Stars: ✭ 122 (-35.11%)
Mutual labels:  few-shot-learning
sib meta learn
Code of Empirical Bayes Transductive Meta-Learning with Synthetic Gradients
Stars: ✭ 56 (-70.21%)
Mutual labels:  few-shot-learning
sinkhorn-label-allocation
Sinkhorn Label Allocation is a label assignment method for semi-supervised self-training algorithms. The SLA algorithm is described in full in this ICML 2021 paper: https://arxiv.org/abs/2102.08622.
Stars: ✭ 49 (-73.94%)
Mutual labels:  few-shot-learning
attMPTI
[CVPR 2021] Few-shot 3D Point Cloud Semantic Segmentation
Stars: ✭ 118 (-37.23%)
Mutual labels:  few-shot-learning
View All Similar Projects ➔

Few-Shot Object Detection

(ECCV 2020) PyTorch implementation of paper "Few-Shot Object Detection and Viewpoint Estimation for Objects in the Wild"
[PDF] [Project webpage] [Code (Viewpoint)]

teaser

If our project is helpful for your research, please consider citing:

@INPROCEEDINGS{Xiao2020FSDetView,
    author    = {Yang Xiao and Renaud Marlet},
    title     = {Few-Shot Object Detection and Viewpoint Estimation for Objects in the Wild},
    booktitle = {European Conference on Computer Vision (ECCV)},
    year      = {2020}}

ChangeLog

  • [Dec-15 2020] There could be a problem for the COCO base model weight downloaded in download_models.sh, please download the correct model weight from here and put it in save_models/COCO/.

Tabel of Contents

Installation

Code built on top of MetaR-CNN.

Requirements

  • CUDA 8.0
  • Python=3.6
  • PyTorch=0.4.0
  • torchvision=0.2.1
  • gcc >= 4.9

Build

  • Create conda env:
conda create --name FSdetection --file spec-file.txt
conda activate FSdetection
  • Compile the CUDA dependencies:
cd {repo_root}/lib
sh make.sh

Data Preparation

We evaluate our method on two commonly-used benchmarks. See data/README.md for more details.

PASCAL VOC

We use the train/val sets of PASCAL VOC 2007+2012 for training and the test set of PASCAL VOC 2007 for evaluation. We split the 20 object classes into 15 base classes and 5 novel classes, and we consider 3 splits proposed in FSRW.

Download PASCAL VOC 2007+2012, create softlink named VOCdevkit in the folder data/.

COCO

We use COCO 2014 and keep the 5k images from minival set for evaluation and use the rest for training. We use the 20 object classes that are the same with PASCAL VOC as novel classes and use the rest as base classes.

Download COCO 2014, create softlink named coco in the folder data/. Please follow the instructins here to download the instances_minival2014.json and instances_valminusminival2014.json.

Getting Started

1. Base-Class Training

Pre-trained ResNet: folloing Meta R-CNN, we used ResNet101 for PASCAL VOC and ResNet50 for MS-COCO. Download it and put it into the data/pretrained_model/.

  • We provide pre-trained models of base-class training:
bash download_models.sh

You will get a dir like:

save_models/
    COCO/
    VOC_first/
    VOC_second/
    VOC_third/
  • You can also train it yourself:
# the first split on VOC
bash run/train_voc_first.sh

# the second split on VOC
bash run/train_voc_second.sh

# the third split on VOC
bash run/train_voc_third.sh

# NonVOC / VOC split on COCO
bash run/train_coco.sh

2. Few-Shot Fine-tuning

Fine-tune the base-training models on a balanced training data including both base and novel classes (3K instances per base class and K instances per novel class):

bash run/finetune_voc_first.sh

bash run/finetune_voc_second.sh

bash run/finetune_voc_third.sh

bash run/finetune_coco.sh

3. Testing

Evaluation is conducted on the test set of PASCAL VOC 2007 or minival set of COCO 2014:

bash run/test_voc_first.sh

bash run/test_voc_second.sh

bash run/test_voc_third.sh

bash run/test_coco.sh

Quantitative Results

Multiple Runs

By running multiple times (~10) the few-shot fine-tuning experiments and averaging the results, we got the performance below:

Pascal-VOC (AP@50)

Split-1 (Base) Split-1 (Novel) Split-2 (Base) Split-2 (Novel) Split-3 (Base) Split-3 (Novel)
K=1 64.2 24.2 66.9 21.6 66.7 21.1
K=2 67.8 35.3 69.9 24.6 69.1 30.0
K=3 69.4 42.2 70.8 31.9 69.9 37.2
K=5 69.8 49.1 71.4 37.0 70.9 43.8
K=10 71.1 57.4 72.2 45.7 72.2 49.6

MS-COCO

AP (Base) AP@50 (Base) AP@75 (Base) AP (Novel) AP@50 (Novel) AP@75 (Novel)
K=1 3.6 9.8 1.7 4.5 12.4 2.2
K=2 5.0 13.0 2.7 6.6 17.1 3.5
K=3 5.9 14.7 3.9 7.2 18.7 3.7
K=5 8.6 20.3 6.0 10.7 24.5 6.7
K=10 10.5 23.3 8.2 12.5 27.3 9.8
K=30 12.7 26.1 9.7 14.7 30.6 12.2

Specific Split

For a direct and quick comparison on COCO, we also run experiments using the specific few-shot sample split provided in TFA.

  • Download their json files into the annotation folder of COCO:
cd ./data/coco/annotations
mkdir TFA && cd TFA
wget -r --no-parent  http://dl.yf.io/fs-det/datasets/cocosplit/
mv dl.yf.io/fs-det/datasets/cocosplit/ cocosplit && rm -r dl.yf.io

  • You will see a set of json files in format "full_box_{K}shot_{cls}_trainval.json" as well as 9 folders named "seed{i}"

  • Then you can run the command line in run/finetune_coco_TFA.sh to finish few-shot fine-tuning and testing

MS-COCO

We get the following results:

AP (Base) AP@50 (Base) AP@75 (Base) AP (Novel) AP@50 (Novel) AP@75 (Novel)
K=1 2.4 7.0 1.0 3.2 8.9 1.4
K=2 4.4 11.9 2.2 4.9 13.3 2.3
K=3 4.9 13.6 2.2 6.7 18.6 2.9
K=5 7.0 17.5 4.4 8.1 20.1 4.4
K=10 9.0 21.2 6.1 10.7 25.6 6.5
K=30 12.3 26.4 10.2 15.9 31.7 15.1

Note: the difference between the performance of multiple runs and the performance of this specific split can be explained by the different sample configuration in the few-shot fine-tuning stage. As we follow the strategy proposed in MetaR-CNN to sample 3K instances of base class and K instances of novel class, without any specific adjustment, the performance would naturally degrade when we simply use the split of TFA where only K instances are considered for each base class.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].