GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → CyberZHG → keras-gradient-accumulation

CyberZHG / keras-gradient-accumulation

Licence: MIT license
Gradient accumulation for Keras

Programming Languages

python
139335 projects - #7 most used programming language
shell
77523 projects

Labels

kerasoptimizergradient-accumulation

Projects that are alternatives of or similar to keras-gradient-accumulation

Adahessian
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning
Stars: ✭ 114 (+225.71%)
Mutual labels:  optimizer
Draftfast
A tool to automate and optimize DraftKings and FanDuel lineup construction.
Stars: ✭ 192 (+448.57%)
Mutual labels:  optimizer
XTR-Toolbox
🛠 Versatile tool to optimize Windows
Stars: ✭ 138 (+294.29%)
Mutual labels:  optimizer
Image Optimize Command
Easily optimize images using WP CLI
Stars: ✭ 138 (+294.29%)
Mutual labels:  optimizer
Pytorch Optimizer
torch-optimizer -- collection of optimizers for Pytorch
Stars: ✭ 2,237 (+6291.43%)
Mutual labels:  optimizer
neth-proxy
Stratum <-> Stratum Proxy and optimizer for ethminer
Stars: ✭ 35 (+0%)
Mutual labels:  optimizer
Adamw keras
AdamW optimizer for Keras
Stars: ✭ 106 (+202.86%)
Mutual labels:  optimizer
LAMB Optimizer TF
LAMB Optimizer for Large Batch Training (TensorFlow version)
Stars: ✭ 119 (+240%)
Mutual labels:  optimizer
Image Optimizer
Easily optimize images using PHP
Stars: ✭ 2,127 (+5977.14%)
Mutual labels:  optimizer
horoscope
horoscope is an optimizer inspector for DBMS.
Stars: ✭ 34 (-2.86%)
Mutual labels:  optimizer
Lookahead pytorch
pytorch implement of Lookahead Optimizer
Stars: ✭ 138 (+294.29%)
Mutual labels:  optimizer
React Lite
An implementation of React v15.x that optimizes for small script size
Stars: ✭ 1,734 (+4854.29%)
Mutual labels:  optimizer
AshBF
Over-engineered Brainfuck optimizing compiler and interpreter
Stars: ✭ 14 (-60%)
Mutual labels:  optimizer
Keras Adabound
Keras implementation of AdaBound
Stars: ✭ 129 (+268.57%)
Mutual labels:  optimizer
prediction gan
PyTorch Impl. of Prediction Optimizer (to stabilize GAN training)
Stars: ✭ 31 (-11.43%)
Mutual labels:  optimizer
Glsl Optimizer
GLSL optimizer based on Mesa's GLSL compiler. Used to be used in Unity for mobile shader optimization.
Stars: ✭ 1,506 (+4202.86%)
Mutual labels:  optimizer
Radam
On the Variance of the Adaptive Learning Rate and Beyond
Stars: ✭ 2,442 (+6877.14%)
Mutual labels:  optimizer
Optimizers-for-Tensorflow
Adam, NAdam and AAdam optimizers
Stars: ✭ 20 (-42.86%)
Mutual labels:  optimizer
keras gradient noise
Add gradient noise to any Keras optimizer
Stars: ✭ 36 (+2.86%)
Mutual labels:  optimizer
artificial-neural-variability-for-deep-learning
The PyTorch Implementation of Variable Optimizers/ Neural Variable Risk Minimization proposed in our Neural Computation paper: Artificial Neural Variability for Deep Learning: On overfitting, Noise Memorization, and Catastrophic Forgetting.
Stars: ✭ 34 (-2.86%)
Mutual labels:  optimizer
View All Similar Projects ➔

Keras Gradient Accumulation

Travis Coverage

This repo is outdated and will no longer be maintained.

Install

pip install git+https://github.com/cyberzhg/keras-gradient-accumulation.git

Usage

Wrapper

from keras_gradient_accumulation import GradientAccumulation

optimizer = GradientAccumulation('adam', accumulation_steps=8)

Adam

from keras_gradient_accumulation import AdamAccumulated

optimizer = AdamAccumulated(accumulation_steps=8)

Known Issues

  • Not available for batch normalization
  • Not compatible with OptimizerV2
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].