All Projects → clarkzinzow → Nonlinear-Optimization-Algorithms

clarkzinzow / Nonlinear-Optimization-Algorithms

Licence: MIT License
MATLAB implementations of a variety of nonlinear programming algorithms.

Programming Languages

matlab
3953 projects

Projects that are alternatives of or similar to Nonlinear-Optimization-Algorithms

Ceres Solver
A large scale non-linear optimization library
Stars: ✭ 2,180 (+2434.88%)
Mutual labels:  conjugate-gradient, nonlinear-programming, bfgs, nonlinear-optimization-algorithms
pdfo
Powell's Derivative-Free Optimization solvers
Stars: ✭ 56 (-34.88%)
Mutual labels:  nonlinear-optimization, optimization-algorithms, nonlinear-optimization-algorithms
dfogn
DFO-GN: Derivative-Free Optimization using Gauss-Newton
Stars: ✭ 20 (-76.74%)
Mutual labels:  optimization, nonlinear-optimization, optimization-algorithms
GDLibrary
Matlab library for gradient descent algorithms: Version 1.0.1
Stars: ✭ 50 (-41.86%)
Mutual labels:  newton, optimization-algorithms
Fewshotlearning
Pytorch implementation of the paper "Optimization as a Model for Few-Shot Learning"
Stars: ✭ 223 (+159.3%)
Mutual labels:  optimization, optimization-algorithms
Argmin
Mathematical optimization in pure Rust
Stars: ✭ 234 (+172.09%)
Mutual labels:  optimization, optimization-algorithms
Optimviz
Visualize optimization algorithms in MATLAB.
Stars: ✭ 106 (+23.26%)
Mutual labels:  optimization, optimization-algorithms
Optimization
A set of lightweight header-only template functions implementing commonly-used optimization methods on Riemannian manifolds and convex spaces.
Stars: ✭ 66 (-23.26%)
Mutual labels:  optimization, nonlinear-programming
SGDLibrary
MATLAB/Octave library for stochastic optimization algorithms: Version 1.0.20
Stars: ✭ 165 (+91.86%)
Mutual labels:  optimization-algorithms, newtons-method
FrankWolfe.jl
Julia implementation for various Frank-Wolfe and Conditional Gradient variants
Stars: ✭ 47 (-45.35%)
Mutual labels:  optimization, optimization-algorithms
procrustes
Python library for finding the optimal transformation(s) that makes two matrices as close as possible to each other.
Stars: ✭ 48 (-44.19%)
Mutual labels:  optimization, optimization-algorithms
Python Mip
Collection of Python tools for the modeling and solution of Mixed-Integer Linear programs
Stars: ✭ 202 (+134.88%)
Mutual labels:  optimization, optimization-algorithms
Sporco
Sparse Optimisation Research Code
Stars: ✭ 164 (+90.7%)
Mutual labels:  optimization, optimization-algorithms
Pygmo2
A Python platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.
Stars: ✭ 134 (+55.81%)
Mutual labels:  optimization, optimization-algorithms
LBFGS-Lite
LBFGS-Lite: A header-only L-BFGS unconstrained optimizer.
Stars: ✭ 98 (+13.95%)
Mutual labels:  optimization, nonlinear-optimization
zoofs
zoofs is a python library for performing feature selection using a variety of nature-inspired wrapper algorithms. The algorithms range from swarm-intelligence to physics-based to Evolutionary. It's easy to use , flexible and powerful tool to reduce your feature size.
Stars: ✭ 142 (+65.12%)
Mutual labels:  optimization, optimization-algorithms
Fatou.jl
Fatou sets in Julia (Fractals, Newton basins, Mandelbrot)
Stars: ✭ 92 (+6.98%)
Mutual labels:  nonlinear, newtons-method
car-racing
A toolkit for testing control and planning algorithm for car racing.
Stars: ✭ 30 (-65.12%)
Mutual labels:  nonlinear-optimization, optimization-algorithms
Cppnumericalsolvers
a lightweight C++17 library of numerical optimization methods for nonlinear functions (Including L-BFGS-B for TensorFlow)
Stars: ✭ 638 (+641.86%)
Mutual labels:  optimization, optimization-algorithms
Pyswarms
A research toolkit for particle swarm optimization in Python
Stars: ✭ 742 (+762.79%)
Mutual labels:  optimization, optimization-algorithms

Nonlinear-Optimization-Algorithms

MATLAB implementations of various nonlinear programming algorithms.


This repository contains MATLAB implementations of a variety of popular nonlinear programming algorithms, many of which can be found in Numerical Optimization by Nocedal and Wright, a text that I highly recommend.

List of algorithms implemented:

  1. line-search (simple Wolfe, strong Wolfe, Moré-Thuente)
  2. steepest descent
  3. Newton's method
  4. Dogleg method
  5. Steihaug-Toint conjugate gradient trust region method
  6. BFGS
  7. limited-memory BFGS
  8. Gauss-Newton method

All of the algorithms are heavily commented (possibly to a fault), but I wanted someone in the midst of a nonlinear programming class to be able to read through the code and understand it decently well. Although I have done my best to implement these algorithms with efficiency in mind (within the confines of MATLAB's inherent deficiencies in this regard), this repository is far more valuable as a teaching tool than as a performance-centric library.

Due to the algorithms being so heavily commented, many implementation details are contained within the code as comments instead of in a README.

Some day, I will include a demo folder that demonstrates the correctness and performance of each algorithm on a set of representative problems, and I will create a README with implementation details for each algorithm, to be located in the src folder.

Some day! :)

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].