Python Codes: IoT, Machine Learning, Computer Vision

Codes in Machine Learning, Deep Learning, Reinforcement Learning, Artificial Intelligence and Computer Vision

Welcome to my GitHub repo.

I am a Data Scientist and I code in Python. Here you will find some Machine Learning, Deep Learning, Natural Language Processing, Artificial Intelligence and Computer Vision models I developed.

Data for models available at:

https://drive.google.com/drive/folders/0B0RLknmL54khU2UwX3dnX1E1WHc?usp=sharing

Keras version used in models: keras==2.0.8 Tensorflow version used in models: tensorflow==1.7.0

AWS API Gateway

This folder presents general guidelines to create an endpoint and API key in AWS API Gateway, that will receive data from a Python notebook sending sensor data, that arrives in API Gateway, is processed and cleaned in Lambda and is stored in DynamoDB. Data is then available for S3 to create a data pipeline and further visualization with Kibana or Quick Sight.

AWS SageMaker

This sector presents the development of a Docker container with a customized Machine Learning model that is pushed into Elastic Container Registry and generates and endpoint in AWS SageMaker.

COCO Model

COCO (Common Objects in Context) is an image segmentation model. This folder presents my Pull Request regarding pycocotools library incompatibility between Python 2 and 3 suggesting a fix.

CPU Temperature - IoT Project at AWS

In this project I turned my notebook into an IoT device, where CPU temperature is collected via Linux command line run inside a Python notebook and then sent via MQTT protocol to Amazon AWS IoT service, integrated with DynamoDB, Data Pipeline, S3, Quick Sight and Cloud Watch. An alternative solution for near real-time data is also presented, using Kinesis, Firehose, Elasticsearch and Kibana.

CycleGAN Project - GANs

In this folder I presente the steps to train a CycleGAN for Style Transfer applied to paintings of Vincent van Gogh and Pablo Picasso using an EC2 GPU Tesla K-80. Examples of outputs are presented.

DEEP LEARNING SUMMER SCHOOL - GANs

In this folder you will find Tensorflow and Keras codes and also a Powerpoint presentation about GANs I developed for my lecture and workshop at the first Deep Learning Summer School in Brazil, at Goiás.

EC2 INSTANCE SETUP

A set up Manual I developed to create EC2 instances in Amazon AWS

FLASK

This folder contains the Python code for the REST API and also the request code.

KERAS

GANs: Generative Adversarial Networks

DCGANs: Deep Convolutional Generative Adversarial Networks

NLP

Notebooks presenting Word2Vec similarities in trained Wikipedia corpus, Portuguese language.

OPENCV

In this folder you will find a guide to create your own haarcascade.xml so that you can identify any object using OpenCV.

Raspberry Pi3 - IoT Project

In this project I use Raspberry Pi3 running in Ubuntu Core OS and attached a sensor and then send telemetry data to Amazon AWS IoT service, integrated with DynamoDB, S3, Quick Sight and Cloud Watch. I also plan to deploy a Deep Learning trained model into the device for classification purposes.

TENSORFLOW

Model for Regression

Model for Classification

LSTM: Long Short Term Memory Neural Networks

GANs: Generative Adversarial Networks

DCGANs: Deep Convolutional Generative Adversarial Networks

InfoGANs Mutual Information Adversarial Networks where loss function is customized. Mutual Info = H(B)-Sum(P(B=b).H(A|B=b)

Tensorboard: visualization of Tensorflow models' training

SEG-NET : Image Segmentation with SEG-NET

SMOTE : Synthetic Minority Oversampling Technique for imbalanced classes

YOLO Model

The YOLO Model (You Only Look Once) is a Deep Learning project for Real-Time object detection. Examples of outputs are presented.

Datasets available at Repo-2017