All Projects → serengil → Tensorflow 101

serengil / Tensorflow 101

Licence: mit
TensorFlow 101: Introduction to Deep Learning for Python Within TensorFlow

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Tensorflow 101

Teacher Student Training
This repository stores the files used for my summer internship's work on "teacher-student learning", an experimental method for training deep neural networks using a trained teacher model.
Stars: ✭ 34 (-94.7%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, neural-networks, transfer-learning
Image classifier
CNN image classifier implemented in Keras Notebook 🖼️.
Stars: ✭ 139 (-78.35%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, transfer-learning
Deep Learning With Python
Example projects I completed to understand Deep Learning techniques with Tensorflow. Please note that I do no longer maintain this repository.
Stars: ✭ 134 (-79.13%)
Mutual labels:  jupyter-notebook, neural-networks, style-transfer
Style transfer
CNN image style transfer 🎨.
Stars: ✭ 210 (-67.29%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, style-transfer
Pba
Efficient Learning of Augmentation Policy Schedules
Stars: ✭ 461 (-28.19%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, automl
Sigmoidal ai
Tutoriais de Python, Data Science, Machine Learning e Deep Learning - Sigmoidal
Stars: ✭ 103 (-83.96%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, neural-networks
Deep Learning With Python
Deep learning codes and projects using Python
Stars: ✭ 195 (-69.63%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, neural-networks
Yann
This toolbox is support material for the book on CNN (http://www.convolution.network).
Stars: ✭ 41 (-93.61%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, neural-networks
Deeplearning.ai Assignments
Stars: ✭ 268 (-58.26%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, neural-networks
Zhihu
This repo contains the source code in my personal column (https://zhuanlan.zhihu.com/zhaoyeyu), implemented using Python 3.6. Including Natural Language Processing and Computer Vision projects, such as text generation, machine translation, deep convolution GAN and other actual combat code.
Stars: ✭ 3,307 (+415.11%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, style-transfer
Cs231
Complete Assignments for CS231n: Convolutional Neural Networks for Visual Recognition
Stars: ✭ 317 (-50.62%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, neural-networks
Sru Deeplearning Workshop
دوره 12 ساعته یادگیری عمیق با چارچوب Keras
Stars: ✭ 66 (-89.72%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, transfer-learning
Neural Painters X
Neural Paiters
Stars: ✭ 61 (-90.5%)
Mutual labels:  jupyter-notebook, transfer-learning, style-transfer
Keras transfer cifar10
Object classification with CIFAR-10 using transfer learning
Stars: ✭ 120 (-81.31%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, transfer-learning
Convisualize nb
Visualisations for Convolutional Neural Networks in Pytorch
Stars: ✭ 57 (-91.12%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, neural-networks
Coursera Deep Learning Specialization
Notes, programming assignments and quizzes from all courses within the Coursera Deep Learning specialization offered by deeplearning.ai: (i) Neural Networks and Deep Learning; (ii) Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization; (iii) Structuring Machine Learning Projects; (iv) Convolutional Neural Networks; (v) Sequence Models
Stars: ✭ 188 (-70.72%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, neural-networks
Deep learning projects
Stars: ✭ 28 (-95.64%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, neural-networks
Amazon Forest Computer Vision
Amazon Forest Computer Vision: Satellite Image tagging code using PyTorch / Keras with lots of PyTorch tricks
Stars: ✭ 346 (-46.11%)
Mutual labels:  jupyter-notebook, neural-networks, transfer-learning
Deeppicar
Deep Learning Autonomous Car based on Raspberry Pi, SunFounder PiCar-V Kit, TensorFlow, and Google's EdgeTPU Co-Processor
Stars: ✭ 242 (-62.31%)
Mutual labels:  jupyter-notebook, convolutional-neural-networks, transfer-learning
Artificio
Deep Learning Computer Vision Algorithms for Real-World Use
Stars: ✭ 326 (-49.22%)
Mutual labels:  convolutional-neural-networks, neural-networks, transfer-learning

TensorFlow 101: Introduction to Deep Learning

Stars License Patreon

I have worked all my life in Machine Learning, and I've never seen one algorithm knock over its benchmarks like Deep Learning - Andrew Ng

This repository includes deep learning based project implementations I've done from scratch. You can find both the source code and documentation as a step by step tutorial. Model structrues and pre-trained weights are shared as well.

Facial Expression Recognition Code, Tutorial

This is a custom CNN model. Kaggle FER 2013 data set is fed to the model. This model runs fast and produces satisfactory results. It can be also run real time as well.

We can run emotion analysis in real time as well Real Time Code, Video

Face Recognition Code, Tutorial

Face recognition is mainly based on convolutional neural networks. We feed two face images to a CNN model and it returns a multi-dimensional vector representations. We then compare these representations to determine these two face images are same person or not.

You can find the most popular face recognition models below.

Model Creator LFW Score Code Tutorial
VGG-Face The University of Oxford 98.78 Code Tutorial
FaceNet Google 99.65 Code Tutorial
DeepFace Facebook - Code Tutorial
OpenFace Carnegie Mellon University 93.80 Code Tutorial
DeepID The Chinese University of Hong Kong - Code Tutorial
Dlib Davis E. King 99.38 Code Tutorial
OpenCV OpenCV Foundation - Code Tutorial
OpenFace in OpenCV Carnegie Mellon University 92.92 Code Tutorial
SphereFace Georgia Institute of Technology 99.30 Code Tutorial
ArcFace Imperial College London 99.40 Code Tutorial

All of those state-of-the-art face recognition models are wrapped in deepface library for python. You can build and run them with a few lines of code. To have more information, please visit the repo of the library.

Real Time Deep Face Recognition Implementation Code, Video

These are the real time implementations of the common face recognition models we've mentioned in the previous section. VGG-Face has the highest face recognition score but it comes with the high complexity among models. On the other hand, OpenFace is a pretty model and it has a close accuracy to VGG-Face but its simplicity offers high speed than others.

Model Creator Code Demo
VGG-Face Oxford University Code Video
FaceNet Google Code Video
DeepFace Facebook Code Video
OpenFace Carnegie Mellon University Code Video

Large Scale Face Recognition

Face recognition requires to apply face verification several times. It has a O(n) time complexity and it would be problematic for very large scale data sets (millions or billions level data). Herein, if you have a really strong database, then you use relational databases and regular SQL. Besides, you can store facial embeddings in nosql databases. In this way, you can have the power of the map reduce technology. Besides, approximate nearest neighbor (a-nn) algorithm reduces time complexity dramatically. Spotify Annoy, Facebook Faiss and NMSLIB are amazing a-nn libraries. Besides, Elasticsearch wraps NMSLIB and it also offers highly scalablity. You should build and run face recognition models within those a-nn libraries if you have really large scale data sets.

Library Algorithm Tutorial Code Demo
Spotify Annoy a-nn Tutorial - Video
Facebook Faiss a-nn Tutorial - -
NMSLIB a-nn Tutorial Code -
Elasticsearch a-nn Tutorial Code Video
mongoDB k-NN Tutorial Code -
Cassandra k-NN Tutorial Code -
Hadoop k-NN Tutorial Code -
Relational Database k-NN Tutorial Code -

Apparent Age and Gender Prediction Tutorial, Code for age, Code for gender

We've used VGG-Face model for apparent age prediction this time. We actually applied transfer learning. Locking the early layers' weights enables to have outcomes fast.

We can run age and gender prediction in real time as well Real Time Code, Video

Celebrity You Look-Alike Face Recognition Code, Tutorial

Applying VGG-Face recognition technology for imdb data set will find your celebrity look-alike if you discard the threshold in similarity score.

This can be run in real time as well Real Time Code, Video

Race and Ethnicity Prediction Tutorial, Code, Real Time Code, Video

Ethnicity is a facial attribute as well and we can predict it from facial photos. We customize VGG-Face and we also applied transfer learning to classify 6 different ethnicity groups.

Beauty Score Prediction Tutorial, Code

South China University of Technology published a research paper about facial beauty prediction. They also open-sourced the data set. 60 labelers scored the beauty of 5500 people. We will build a regressor to find facial beauty score. We will also test the built regressor on a huge imdb data set to find the most beautiful ones.

Attractiveness Score Prediction Tutorial, Code

The University of Chicago open-sourced the Chicago Face Database. The database consists of 1200 facial photos of 600 people. Facial photos are also labeled with attractiveness and babyface scores by hundreds of volunteer markers. So, we've built a machine learning model to generalize attractiveness score based on a facial photo.

Making Arts with Deep Learning: Artistic Style Transfer Code, Tutorial, Video

What if Vincent van Gogh had painted Istanbul Bosporus? Today we can answer this question. A deep learning technique named artistic style transfer enables to transform ordinary images to masterpieces.

Autoencoder and clustering Code, Tutorial

We can use neural networks to represent data. If you design a neural networks model symmetric about the centroid and you can restore a base data with an acceptable loss, then output of the centroid layer can represent the base data. Representations can contribute any field of deep learning such as face recognition, style transfer or just clustering.

Convolutional Autoencoder and clustering Code, Tutorial

We can adapt same representation approach to convolutional neural networks, too.

Transfer Learning: Consuming InceptionV3 to Classify Cat and Dog Images in Keras Code, Tutorial

We can have the outcomes of the other researchers effortlessly. Google researchers compete on Kaggle Imagenet competition. They got 97% accuracy. We will adapt Google's Inception V3 model to classify objects.

Handwritten Digit Classification Using Neural Networks Code, Tutorial

We had to apply feature extraction on data sets to use neural networks. Deep learning enables to skip this step. We just feed the data, and deep neural networks can extract features on the data set. Here, we will feed handwritten digit data (MNIST) to deep neural networks, and expect to learn digits.

Handwritten Digit Recognition Using Convolutional Neural Networks with Keras Code, Tutorial

Convolutional neural networks are close to human brain. People look for some patterns in classifying objects. For example, mouth, nose and ear shape of a cat is enough to classify a cat. We don't look at all pixels, just focus on some area. Herein, CNN applies some filters to detect these kind of shapes. They perform better than conventional neural networks. Herein, we got almost 2% accuracy than fully connected neural networks.

Automated Machine Learning and Auto-Keras for Image Data Code, Model, Tutorial

AutoML concept aims to find the best network structure and hyper-parameters. Here, I've applied AutoML to facial expression recognition data set. My custom design got 57% accuracy whereas AutoML found a better model and got 66% accuracy. This means almost 10% improvement in the accuracy.

Explaining Deep Learning Models with SHAP Code, Tutorial

SHAP explains black box machine learning models and makes them transparent, explainable and provable.

Gradient Vanishing Problem Code Tutorial

Why legacy activation functions such as sigmoid and tanh disappear on the pages of the history?

How single layer perceptron works Code

This is the 1957 model implementation of the perceptron.

Face Alignment for Face Recognition Code, Tutorial

Google declared that face alignment increase its face recognition model accuracy from 98.87% to 99.63%. This is almost 1% accuracy improvement which means a lot for engineering studies.

Requirements

I have tested this repository on the following environments. To avoid environmental issues, confirm your environment is same as below.

C:\>python --version
Python 3.6.4 :: Anaconda, Inc.

C:\>activate tensorflow

(tensorflow) C:\>python
Python 3.5.5 |Anaconda, Inc.| (default, Apr  7 2018, 04:52:34) [MSC v.1900 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorflow as tf
>>> print(tf.__version__)
1.9.0
>>>
>>> import keras
Using TensorFlow backend.
>>> print(keras.__version__)
2.2.0
>>>
>>> import cv2
>>> print(cv2.__version__)
3.4.4

To get your environment up from zero, you can follow the instructions in the following videos.

Installing TensorFlow and Prerequisites Video

Installing Keras Video

Disclaimer

This repo might use some external sources. Notice that related tutorial links and comments in the code blocks cite references already.

Support

There are many ways to support a project - starring⭐️ the GitHub repos is one.

You can also support this project on Patreon 🙏

Citation

Please cite tensorflow-101 in your publications if it helps your research. Here is an example BibTeX entry:

@misc{serengil2017tensorflow,
  abstract = {TensorFlow 101: Introduction to Deep Learning for Python Within TensorFlow},
  author={Serengil, Sefik Ilkin},
  title={tensorflow-101},
  url={https://github.com/serengil/tensorflow-101},
  year={2017}
}

Licence

This repository is licensed under MIT license - see LICENSE for more details

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].