All Projects → Jaewan-Yun → Optimizer Visualization

Jaewan-Yun / Optimizer Visualization

Licence: mit
Visualize Tensorflow's optimizers.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Optimizer Visualization

Captainblackboard
船长关于机器学习、计算机视觉和工程技术的总结和分享
Stars: ✭ 693 (+289.33%)
Mutual labels:  optimization-algorithms
Cilib
Typesafe, purely functional Computational Intelligence
Stars: ✭ 114 (-35.96%)
Mutual labels:  optimization-algorithms
Proxtv
Matlab and Python toolbox for fast Total Variation proximity operators
Stars: ✭ 140 (-21.35%)
Mutual labels:  optimization-algorithms
Mindseye
Neural Networks in Java 8 with CuDNN and Aparapi
Stars: ✭ 8 (-95.51%)
Mutual labels:  optimization-algorithms
Viz torch optim
Videos of deep learning optimizers moving on 3D problem-landscapes
Stars: ✭ 86 (-51.69%)
Mutual labels:  optimization-algorithms
Swarmlib
This repository implements several swarm optimization algorithms and visualizes them. Implemented algorithms: Particle Swarm Optimization (PSO), Firefly Algorithm (FA), Cuckoo Search (CS), Ant Colony Optimization (ACO), Artificial Bee Colony (ABC), Grey Wolf Optimizer (GWO) and Whale Optimization Algorithm (WOA)
Stars: ✭ 121 (-32.02%)
Mutual labels:  optimization-algorithms
Cppnumericalsolvers
a lightweight C++17 library of numerical optimization methods for nonlinear functions (Including L-BFGS-B for TensorFlow)
Stars: ✭ 638 (+258.43%)
Mutual labels:  optimization-algorithms
Bads
Bayesian Adaptive Direct Search (BADS) optimization algorithm for model fitting in MATLAB
Stars: ✭ 159 (-10.67%)
Mutual labels:  optimization-algorithms
Optimviz
Visualize optimization algorithms in MATLAB.
Stars: ✭ 106 (-40.45%)
Mutual labels:  optimization-algorithms
Deeplearning.ai
Stars: ✭ 139 (-21.91%)
Mutual labels:  optimization-algorithms
Min Cost Flow Class
C++ solvers for Minimum Cost Flow Problems
Stars: ✭ 36 (-79.78%)
Mutual labels:  optimization-algorithms
Csmath 2020
This mathematics course is taught for the first year Ph.D. students of computer science and related areas @ZJU
Stars: ✭ 85 (-52.25%)
Mutual labels:  optimization-algorithms
Raven
RAVEN is a flexible and multi-purpose probabilistic risk analysis, uncertainty quantification, parameter optimization and data knowledge-discovering framework.
Stars: ✭ 122 (-31.46%)
Mutual labels:  optimization-algorithms
Pyswarms
A research toolkit for particle swarm optimization in Python
Stars: ✭ 742 (+316.85%)
Mutual labels:  optimization-algorithms
Niapy
Python microframework for building nature-inspired algorithms. Official docs: http://niapy.readthedocs.io/en/stable/
Stars: ✭ 148 (-16.85%)
Mutual labels:  optimization-algorithms
Gaft
A Genetic Algorithm Framework in Python
Stars: ✭ 651 (+265.73%)
Mutual labels:  optimization-algorithms
Tradingstrategies
Algorithmic trading strategies
Stars: ✭ 120 (-32.58%)
Mutual labels:  optimization-algorithms
Sporco
Sparse Optimisation Research Code
Stars: ✭ 164 (-7.87%)
Mutual labels:  optimization-algorithms
Nmflibrary
MATLAB library for non-negative matrix factorization (NMF): Version 1.8.1
Stars: ✭ 153 (-14.04%)
Mutual labels:  optimization-algorithms
Pygmo2
A Python platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.
Stars: ✭ 134 (-24.72%)
Mutual labels:  optimization-algorithms

optimizer-visualization

Visualize gradient descent optimization algorithms in Tensorflow.

All methods start at the same location, specified by two variables. Both x and y variables are improved by the following Optimizers:

Adadelta documentation

Adagrad documentation

Adam documentation

Ftrl documentation

GD documentation

Momentum documentation

RMSProp documentation

For an overview of each gradient descent optimization algorithms, visit this helpful resource.

Numbers in figure legend indicate learning rate, specific to each Optimizer.

Note the optimizers' behavior when gradient is steep.

Note the optimizers' behavior when initial gradient is miniscule.

Inspired by the following GIFs:

From here

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].