All Projects → nikhilbarhate99 → Hierarchical Actor Critic Hac Pytorch

nikhilbarhate99 / Hierarchical Actor Critic Hac Pytorch

Licence: mit
PyTorch implementation of Hierarchical Actor Critic (HAC) for OpenAI gym environments

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Hierarchical Actor Critic Hac Pytorch

Reinforcementlearning Atarigame
Pytorch LSTM RNN for reinforcement learning to play Atari games from OpenAI Universe. We also use Google Deep Mind's Asynchronous Advantage Actor-Critic (A3C) Algorithm. This is much superior and efficient than DQN and obsoletes it. Can play on many games
Stars: ✭ 118 (+1.72%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym, actor-critic
Rl a3c pytorch
A3C LSTM Atari with Pytorch plus A3G design
Stars: ✭ 482 (+315.52%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym, actor-critic
Pytorch sac ae
PyTorch implementation of Soft Actor-Critic + Autoencoder(SAC+AE)
Stars: ✭ 94 (-18.97%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, actor-critic
Pytorch Rl
Deep Reinforcement Learning with pytorch & visdom
Stars: ✭ 745 (+542.24%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, actor-critic
Cs234 Reinforcement Learning Winter 2019
My Solutions of Assignments of CS234: Reinforcement Learning Winter 2019
Stars: ✭ 93 (-19.83%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym
Tensorflow Reinforce
Implementations of Reinforcement Learning Models in Tensorflow
Stars: ✭ 480 (+313.79%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, actor-critic
Dissecting Reinforcement Learning
Python code, PDFs and resources for the series of posts on Reinforcement Learning which I published on my personal blog
Stars: ✭ 512 (+341.38%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, actor-critic
Btgym
Scalable, event-driven, deep-learning-friendly backtesting library
Stars: ✭ 765 (+559.48%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym
Reinforcement learning tutorial with demo
Reinforcement Learning Tutorial with Demo: DP (Policy and Value Iteration), Monte Carlo, TD Learning (SARSA, QLearning), Function Approximation, Policy Gradient, DQN, Imitation, Meta Learning, Papers, Courses, etc..
Stars: ✭ 442 (+281.03%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, actor-critic
Rlcard
Reinforcement Learning / AI Bots in Card (Poker) Games - Blackjack, Leduc, Texas, DouDizhu, Mahjong, UNO.
Stars: ✭ 980 (+744.83%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym
Pytorch A3c
PyTorch implementation of Asynchronous Advantage Actor Critic (A3C) from "Asynchronous Methods for Deep Reinforcement Learning".
Stars: ✭ 879 (+657.76%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, actor-critic
Deterministic Gail Pytorch
PyTorch implementation of Deterministic Generative Adversarial Imitation Learning (GAIL) for Off Policy learning
Stars: ✭ 44 (-62.07%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym
Rl Book
Source codes for the book "Reinforcement Learning: Theory and Python Implementation"
Stars: ✭ 464 (+300%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym
Hands On Reinforcement Learning With Python
Master Reinforcement and Deep Reinforcement Learning using OpenAI Gym and TensorFlow
Stars: ✭ 640 (+451.72%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym
Mushroom Rl
Python library for Reinforcement Learning.
Stars: ✭ 442 (+281.03%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym
Deeprl Tutorials
Contains high quality implementations of Deep Reinforcement Learning algorithms written in PyTorch
Stars: ✭ 748 (+544.83%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, actor-critic
Torch Ac
Recurrent and multi-process PyTorch implementation of deep reinforcement Actor-Critic algorithms A2C and PPO
Stars: ✭ 70 (-39.66%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, actor-critic
Deep Reinforcement Learning
Repo for the Deep Reinforcement Learning Nanodegree program
Stars: ✭ 4,012 (+3358.62%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym
Pytorch Rl
This repository contains model-free deep reinforcement learning algorithms implemented in Pytorch
Stars: ✭ 394 (+239.66%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, openai-gym
Rl algos
Reinforcement Learning Algorithms
Stars: ✭ 14 (-87.93%)
Mutual labels:  reinforcement-learning, deep-reinforcement-learning, actor-critic

Hierarchical-Actor-Critic-HAC-PyTorch

This is an implementation of the Hierarchical Actor Critic (HAC) algorithm described in the paper, Learning Multi-Level Hierarchies with Hindsight (ICLR 2019), in PyTorch for OpenAI gym environments. The algorithm learns to reach a goal state by dividing the task into short horizon intermediate goals (subgoals).

Usage

  • All the hyperparameters are contained in the train.py file.
  • To train a new network run train.py
  • To test a preTrained network run test.py

To render the environments (Mountain Car and Pendulum) with subgoals (2 or 3 level) replace the gym files in local installation directory gym/envs/classic_control with the files in gym folder of this repo and change the bool render to True

Implementation Details

  • The code is implemented as described in the appendix section of the paper and the Official repository, i.e. without target networks and with bounded Q-values.
  • The Actor and Critic networks have 2 hidded layers of size 64.

Requirements

Results

MountainCarContinuous-v0

(2 levels, H = 20, 200 episodes) (3 levels, H = 5, 200 episodes)

References

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].