• Deep Learning
  • PyTorch
  • Keras
  • NLP
• Machine Learning
  • Gradient Boosting
• Math
  • Probability
  • Statistics
• Data Science
• Cloud
• Algorithms

Deep Learning

• perceptron.ipynb Scikit-Learn's Perceptron, Neural Network, Keras on the IRIS dataset.
• linear-algebra-transpose-differential.ipynb
• backpropagation.ipynb
• tensorflow-weight.py
  • linear-regression-tensorflow.py
  • mnist.py TensorFlow Implementaion on the MNIST dataset.
• softmax.py Softmax, Cross-Entropy Loss
• vanishing-gradients.ipynb

PyTorch

• time-series-lstm-pytorch.ipynb
• pytorch-grad.py Gradients calculation using PyTorch.
• torch-backprop.py Gradients checking using PyTorch.
• transformer-sentiment-analysis.ipynb Sentiment Analysis with Transformers(BERT).
• calc-cross-entropy.py Calculate Cross-Entropy from Scratch.

Keras

• sin-graph-prediction.ipynb
• time-series-prediction-rnn.ipynb
• keras-intermediate-debugging.ipynb Intermediate Layer Debugging in Keras.
  • keras-shape-inspect.py Validate Merge, Concatenate methods in Keras.
• addition_rnn.py Implements Seq2Seq Learning for Performing Addition.
  • addition_seq2seq.py Implements Seq2Seq with Attention for Addition Task.
• attention_dense.py Attention Mechanism
  • attention_lstm.py
  • keras-attention Visualize Attention
• cnn-conv1d-internals.py Validate Conv1D on the Text Embeddings.
  • cnn-conv2d-internals.py Validate Conv2D on the Image dataset.
  • lstm-keras-inspect.py Validate LSTM calculation.

NLP

• nnlm.py Implementation of Paper "A Neural Probabilistic Language Model(Bengio et al., 2003)"
• word2vec.py
• vector-representation-of-words.ipynb
• sentimental-analysis-word2vec-keras.ipynb
• imdb-sentimental-analysis-rnn.ipynb
• uci-news.py Multi-Class Classification with CNN on the UCI News dataset.
• lstm-seq2seq.py Basic Character-Level Seq2Seq Model
• elmo.py Sentimental Analysis with ELMo Embeddings.
• allennlp-tutorial.py AllenNLP Tutorial
• cnn-classification.py Text Classification with CNN/TensorBoard
• bert.py Example codes for BERT article.

Machine Learning

• iris-dtreeviz.ipynb Decision Tree visualization for IRIS dataset.
• decision-tree-from-scratch.ipynb Decision Tree from a Scratch
• news-classification.ipynb Decision Tree, Random Forest, Naive Bayes on the UCI News dataset.
  • news-classification-nb.ipynb Trains Naive Bayes Classifiers on the UCI News dataset.
  • multinomial-naive-bayes.ipynb Naive Bayes internals.
• titanic.ipynb Decision Tree, Random Forest on the Titanic dataset.
• linear-regression.py
• logistic-regression.ipynb
• dimensionality-reduction.ipynb
• representing-data.ipynb
• model-evaluation.ipynb Decision Regions, Confusion Matrix.
• algorithm-chains-and-pipelines.ipynb
• iris-svm-trees.ipynb SVM, Decision Tree, Random Forest on the IRIS dataset.
  • iris-visualized-by-shap-and-lime.ipynb IRIS classification visualized by SHAP and LIME.
  • keras-lstm-for-imdb-sentiment-classification.ipynb Keras LSTM for IMDb Sentiment Classification visualized by SHAP.
• support-vector-machine-explained.ipynb Comparison between SVM and Neural Network
• loss-3d.py 3D Visualization linear graph with loss value.

Gradient Boosting

• gradient-boosting-from-scratch.py Gradient Boosting from Scratch
• xgboost.py GridSearchCV with XGBoost

Math

• sympy.py Partial Derivatives using Sympy.
• hard-sigmoid.ipynb
• euclidean-v-cosine.ipynb Euclidean Distance vs. Cosine Similarity
• calc-entropy.ipynb Entropy graph when one probability is high.

Probability

• ghost-leg-probabilities.ipynb Ghost Leg Probabilities.
• prob-with-permutations.py Probabilities with Duplicate Permutations.

Statistics

• gibbs-sampling.ipynb
• gaussian-distribution.ipynb Gaussion Distribution(Normal Distribution)
• poisson-dist.ipynb Poisson Distribution
• odds-ratio.ipynb Odds Ratio 1:3 Relation Graph

Data Science

• cudf-tutorial.py RAPIDS cuDF
• seaborn.ipynb

Cloud

• bigquery-pandas.ipynb

Algorithms

• circular-queue.ipynb C++ Implementation.