All Projects → pochih → MNIST-multitask

pochih / MNIST-multitask

Licence: other
6️⃣6️⃣6️⃣ Reproduce ICLR '18 under-reviewed paper "MULTI-TASK LEARNING ON MNIST IMAGE DATASETS"

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to MNIST-multitask

Pytorch Generative Model Collections
Collection of generative models in Pytorch version.
Stars: ✭ 2,296 (+6652.94%)
Mutual labels:  mnist, fashion-mnist
Tensorflow Generative Model Collections
Collection of generative models in Tensorflow
Stars: ✭ 3,785 (+11032.35%)
Mutual labels:  mnist, fashion-mnist
Pytorch-PCGrad
Pytorch reimplementation for "Gradient Surgery for Multi-Task Learning"
Stars: ✭ 179 (+426.47%)
Mutual labels:  mnist, multi-task-learning
Fashion Mnist
A MNIST-like fashion product database. Benchmark 👇
Stars: ✭ 9,675 (+28355.88%)
Mutual labels:  mnist, fashion-mnist
gans-2.0
Generative Adversarial Networks in TensorFlow 2.0
Stars: ✭ 76 (+123.53%)
Mutual labels:  mnist, fashion-mnist
cups-rl
Customisable Unified Physical Simulations (CUPS) for Reinforcement Learning. Experiments run on the ai2thor environment (http://ai2thor.allenai.org/) e.g. using A3C, RainbowDQN and A3C_GA (Gated Attention multi-modal fusion) for Task-Oriented Language Grounding (tasks specified by natural language instructions) e.g. "Pick up the Cup or else"
Stars: ✭ 38 (+11.76%)
Mutual labels:  transfer-learning, multi-task-learning
playing with vae
Comparing FC VAE / FCN VAE / PCA / UMAP on MNIST / FMNIST
Stars: ✭ 53 (+55.88%)
Mutual labels:  mnist, fashion-mnist
Mask-YOLO
Inspired from Mask R-CNN to build a multi-task learning, two-branch architecture: one branch based on YOLOv2 for object detection, the other branch for instance segmentation. Simply tested on Rice and Shapes. MobileNet supported.
Stars: ✭ 100 (+194.12%)
Mutual labels:  multi-task-learning
MinTL
MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems
Stars: ✭ 61 (+79.41%)
Mutual labels:  transfer-learning
FaceClassification Tensorflow
Building a Neural Network that classifies faces using OpenCV and Tensorflow
Stars: ✭ 37 (+8.82%)
Mutual labels:  transfer-learning
awesome-list-of-awesomes
A curated list of all the Awesome --Topic Name-- lists I've found till date relevant to Data lifecycle, ML and DL.
Stars: ✭ 259 (+661.76%)
Mutual labels:  transfer-learning
DeepSegmentor
A Pytorch implementation of DeepCrack and RoadNet projects.
Stars: ✭ 152 (+347.06%)
Mutual labels:  multi-task-learning
LSTM-GRU-from-scratch
LSTM, GRU cell implementation from scratch in tensorflow
Stars: ✭ 30 (-11.76%)
Mutual labels:  fashion-mnist
AdaBound-tensorflow
An optimizer that trains as fast as Adam and as good as SGD in Tensorflow
Stars: ✭ 44 (+29.41%)
Mutual labels:  mnist
cmd
Central Moment Discrepancy for Domain-Invariant Representation Learning (ICLR 2017, keras)
Stars: ✭ 53 (+55.88%)
Mutual labels:  transfer-learning
tensorflow-mnist-convnets
Neural nets for MNIST classification, simple single layer NN, 5 layer FC NN and convolutional neural networks with different architectures
Stars: ✭ 22 (-35.29%)
Mutual labels:  mnist
mnist-challenge
My solution to TUM's Machine Learning MNIST challenge 2016-2017 [winner]
Stars: ✭ 68 (+100%)
Mutual labels:  mnist
Transfer-Learning
Inception V3 for Transfer Learning on Cats and Dogs
Stars: ✭ 17 (-50%)
Mutual labels:  transfer-learning
chainer-ADDA
Adversarial Discriminative Domain Adaptation in Chainer
Stars: ✭ 24 (-29.41%)
Mutual labels:  mnist
Open-Set-Recognition
Open Set Recognition
Stars: ✭ 49 (+44.12%)
Mutual labels:  mnist

MNIST-multitask

Reproduce ICLR2018 under-reviewed paper MULTI-TASK LEARNING ON MNIST IMAGE DATASETS

the paper argues that pre-train network with MNIST-like dataset can boost performance

results

dataset single-task M+F single-task (paper reported) M+F (paper reported)
MNIST 0.996 0.9956 0.9956 0.9971
FashionMNIST 0.9394 0.942 0.9432 0.9518

discussion

in my reproduction, FashionMNIST performs better with MNIST+FashionMNIST pre-trained first

but MNIST doesn't enjoy the benefits of pre-training.

The bias between reproduction and paper can result from preprocess of data.

Author

Po-Chih Huang / @pochih

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].