All Projects → mynkpl1998 → Deep-Learning-Optimization-Algorithms

mynkpl1998 / Deep-Learning-Optimization-Algorithms

Licence: other
Visualization of various deep learning optimization algorithms using PyTorch automatic differentiation and optimizers.

Programming Languages

Jupyter Notebook
11667 projects

Projects that are alternatives of or similar to Deep-Learning-Optimization-Algorithms

FirstOrderSolvers.jl
Large scale convex optimization solvers in julia
Stars: ✭ 20 (-57.45%)
Mutual labels:  optimization-algorithms, convex-optimization
GurobiLink
Wolfram Language interface to the Gurobi numerical optimization library
Stars: ✭ 16 (-65.96%)
Mutual labels:  optimization-algorithms, convex-optimization
benchopt
Making your benchmark of optimization algorithms simple and open
Stars: ✭ 89 (+89.36%)
Mutual labels:  optimization-algorithms, convex-optimization
gibbous
Convex optimization for java and scala, built on Apache Commons Math
Stars: ✭ 17 (-63.83%)
Mutual labels:  optimization-algorithms, convex-optimization
SGDLibrary
MATLAB/Octave library for stochastic optimization algorithms: Version 1.0.20
Stars: ✭ 165 (+251.06%)
Mutual labels:  optimization-algorithms, stochastic-gradient-descent
a-tour-of-pytorch-optimizers
A tour of different optimization algorithms in PyTorch.
Stars: ✭ 46 (-2.13%)
Mutual labels:  adadelta, optimization-algorithms
psgd tf
Tensorflow implementation of preconditioned stochastic gradient descent
Stars: ✭ 33 (-29.79%)
Mutual labels:  optimization-algorithms, stochastic-gradient-descent
pydata-london-2018
Slides and notebooks for my tutorial at PyData London 2018
Stars: ✭ 22 (-53.19%)
Mutual labels:  convex-optimization, stochastic-gradient-descent
awesome-nn-optimization
Awesome list for Neural Network Optimization methods.
Stars: ✭ 39 (-17.02%)
Mutual labels:  convex-optimization, non-convex-optimization
fmin adam
Matlab implementation of the Adam stochastic gradient descent optimisation algorithm
Stars: ✭ 38 (-19.15%)
Mutual labels:  optimization-algorithms, stochastic-gradient-descent
opfunu
A collection of Benchmark functions for numerical optimization problems (https://opfunu.readthedocs.io)
Stars: ✭ 31 (-34.04%)
Mutual labels:  convex-optimization, non-convex-optimization
portfolio allocation js
A JavaScript library to allocate and optimize financial portfolios.
Stars: ✭ 145 (+208.51%)
Mutual labels:  optimization-algorithms, convex-optimization
bio ik
MoveIt kinematics_base plugin based on particle optimization & GA
Stars: ✭ 104 (+121.28%)
Mutual labels:  convex-optimization, non-convex-optimization
Performance-Estimation-Toolbox
Code of the Performance Estimation Toolbox (PESTO) whose aim is to ease the access to the PEP methodology for performing worst-case analyses of first-order methods in convex and nonconvex optimization. The numerical worst-case analyses from PEP can be performed just by writting the algorithms just as you would implement them.
Stars: ✭ 38 (-19.15%)
Mutual labels:  optimization-algorithms
vqf
Implementation of Variational Quantum Factoring algorithm.
Stars: ✭ 32 (-31.91%)
Mutual labels:  optimization-algorithms
Nonlinear-Optimization-Algorithms
MATLAB implementations of a variety of nonlinear programming algorithms.
Stars: ✭ 86 (+82.98%)
Mutual labels:  optimization-algorithms
rBAS
Implementation of the (beetle antennae search) BAS algorithm and its mutations in R code
Stars: ✭ 25 (-46.81%)
Mutual labels:  optimization-algorithms
hyper-engine
Python library for Bayesian hyper-parameters optimization
Stars: ✭ 80 (+70.21%)
Mutual labels:  optimization-algorithms
ML-Optimizers-JAX
Toy implementations of some popular ML optimizers using Python/JAX
Stars: ✭ 37 (-21.28%)
Mutual labels:  optimization-algorithms
dfogn
DFO-GN: Derivative-Free Optimization using Gauss-Newton
Stars: ✭ 20 (-57.45%)
Mutual labels:  optimization-algorithms

Deep-Learning-Optimization-Algorithms

This repository contains the code for visualization of various deep learning optimization algorithms. PyTorch is used for automatic differentiation and implementing the various optimizers.

Stochastic Gradient Descent (SGD)

2D Convex Surface 2D Non-Convex Surface 3D Surface with Saddle Point

SGD with Momentum

2D Convex Surface 2D Non-Convex Surface 3D Surface with Saddle Point

Ada-delta

2D Convex Surface 2D Non-Convex Surface 3D Surface with Saddle Point

Adaptive Moment Estimation (ADAM)

2D Convex Surface 2D Non-Convex Surface 3D Surface with Saddle Point
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].