GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → leaderj1001 → SimSiam

leaderj1001 / SimSiam

Licence: MIT license
Exploring Simple Siamese Representation Learning

Programming Languages

python
139335 projects - #7 most used programming language

Labels

self-supervised-learningsimclrsimsiam

Projects that are alternatives of or similar to SimSiam

mmselfsup
OpenMMLab Self-Supervised Learning Toolbox and Benchmark
Stars: ✭ 2,315 (+4351.92%)
Mutual labels:  self-supervised-learning, simclr, simsiam
PASSL
PASSL包含 SimCLR，MoCo v1/v2，BYOL，CLIP，PixPro，BEiT，MAE等图像自监督算法以及 Vision Transformer，DEiT，Swin Transformer，CvT，T2T-ViT，MLP-Mixer，XCiT，ConvNeXt，PVTv2 等基础视觉算法
Stars: ✭ 134 (+157.69%)
Mutual labels:  self-supervised-learning, simclr
Simclr
SimCLRv2 - Big Self-Supervised Models are Strong Semi-Supervised Learners
Stars: ✭ 2,720 (+5130.77%)
Mutual labels:  self-supervised-learning, simclr
temporal-ssl
Video Representation Learning by Recognizing Temporal Transformations. In ECCV, 2020.
Stars: ✭ 46 (-11.54%)
Mutual labels:  self-supervised-learning
object-aware-contrastive
Object-aware Contrastive Learning for Debiased Scene Representation (NeurIPS 2021)
Stars: ✭ 44 (-15.38%)
Mutual labels:  self-supervised-learning
ccgl
TKDE 22. CCCL: Contrastive Cascade Graph Learning.
Stars: ✭ 20 (-61.54%)
Mutual labels:  self-supervised-learning
CLMR
Official PyTorch implementation of Contrastive Learning of Musical Representations
Stars: ✭ 216 (+315.38%)
Mutual labels:  self-supervised-learning
SSTDA
[CVPR 2020] Action Segmentation with Joint Self-Supervised Temporal Domain Adaptation (PyTorch)
Stars: ✭ 150 (+188.46%)
Mutual labels:  self-supervised-learning
sesemi
supervised and semi-supervised image classification with self-supervision (Keras)
Stars: ✭ 43 (-17.31%)
Mutual labels:  self-supervised-learning
S2-BNN
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)
Stars: ✭ 53 (+1.92%)
Mutual labels:  self-supervised-learning
video-pace
code for our ECCV-2020 paper: Self-supervised Video Representation Learning by Pace Prediction
Stars: ✭ 95 (+82.69%)
Mutual labels:  self-supervised-learning
naru
Neural Relation Understanding: neural cardinality estimators for tabular data
Stars: ✭ 76 (+46.15%)
Mutual labels:  self-supervised-learning
Self-Supervised-GANs
Tensorflow Implementation for paper "self-supervised generative adversarial networks"
Stars: ✭ 34 (-34.62%)
Mutual labels:  self-supervised-learning
CLSA
official implemntation for "Contrastive Learning with Stronger Augmentations"
Stars: ✭ 48 (-7.69%)
Mutual labels:  self-supervised-learning
ViCC
[WACV'22] Code repository for the paper "Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting", https://arxiv.org/abs/2106.10137.
Stars: ✭ 33 (-36.54%)
Mutual labels:  self-supervised-learning
3DInfomax
Making self-supervised learning work on molecules by using their 3D geometry to pre-train GNNs. Implemented in DGL and Pytorch Geometric.
Stars: ✭ 107 (+105.77%)
Mutual labels:  self-supervised-learning
barlowtwins
Implementation of Barlow Twins paper
Stars: ✭ 84 (+61.54%)
Mutual labels:  self-supervised-learning
libai
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
Stars: ✭ 284 (+446.15%)
Mutual labels:  self-supervised-learning
SelfGNN
A PyTorch implementation of "SelfGNN: Self-supervised Graph Neural Networks without explicit negative sampling" paper, which appeared in The International Workshop on Self-Supervised Learning for the Web (SSL'21) @ the Web Conference 2021 (WWW'21).
Stars: ✭ 24 (-53.85%)
Mutual labels:  self-supervised-learning
VQ-APC
Vector Quantized Autoregressive Predictive Coding (VQ-APC)
Stars: ✭ 34 (-34.62%)
Mutual labels:  self-supervised-learning
View All Similar Projects ➔

Exploring Simple Siamese Representation Learning (SimSiam)

Network

simsiam

Experiments

Model Pre-training Epochs Batch size Dim Linear Evaluation Acc (%)
ResNet-18 (Paper) 800 512 2048 O 91.8
ResNet-18 (Our) 300 512 1024 O 72.49
ResNet-18 800 256 1024 O 83.93
ResNet-18 512 2048 O wip
  • plot

Usage

  • Dataset (CIFAR-10) 
    data
  └── cifar-10-batches-py
    ├── batches.meta
    ├── data_batch_1
    ├── data_batch_2
    ├── data_batch_3
    ├── data_batch_4
    ├── data_batch_5
    ├── readme.html
    └── test_batch
  1. Pre-training
python main.py --pretrain True
  1. DownStream Task (Linear)
python main.py --checkpoints checkpoints/checkpoint_pretrain_model.pth --pretrain False

Reference

  • Paper Link
  • Author: Xinlei Chen, Kaiming He
  • Organization: Facebook AI Research (FAIR)
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].