All Categories → No Category → optimizers

Top 8 optimizers open source projects

🧑‍🏫 50! Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

✭ 5,720

Jupyter Notebook python deep-learning pytorch reinforcement-learning neural-networks gan deep-learning-tutorial machine-learning transformers transformer optimizers

A collection of optimizers, some arcane others well known, for Flax.

✭ 21

python flax optimizers

ML-Optimizers-JAX

Toy implementations of some popular ML optimizers using Python/JAX

✭ 37

python Jupyter Notebook machine-learning momentum gradient-descent optimization-algorithms adam adam-optimizer jax optimizers

Neutron: A pytorch based implementation of Transformer and its variants.

Summarize Massive Datasets using Submodular Optimization

✭ 36

Jupyter Notebook python greedy-algorithms combinatorial-optimization submodular-optimization data-summarization optimizers submodular-functions submodular submodular-information-measures

Hypergradient variants

Improved Hypergradient optimizers, providing better generalization and faster convergence.

✭ 15

Jupyter Notebook python shell momentum learning-rate adam-optimizer step-size optimizers hypergradient

Nx-powered Neural Networks

✭ 1,170

elixir deep-learning neural-networks nx optimizers

keras-lookahead

Lookahead mechanism for optimizers in Keras.

✭ 50

python shell keras lookahead optimizers

1-8 of 8 optimizers projects