All Projects → cjy1992 → Gym Carla

cjy1992 / Gym Carla

Licence: mit
An OpenAI gym wrapper for CARLA simulator

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Gym Carla

Carla
Open-source simulator for autonomous driving research.
Stars: ✭ 7,012 (+4175.61%)
Mutual labels:  autonomous-driving, deep-reinforcement-learning, imitation-learning
neat
[ICCV'21] NEAT: Neural Attention Fields for End-to-End Autonomous Driving
Stars: ✭ 194 (+18.29%)
Mutual labels:  autonomous-driving, imitation-learning
l2r
Open-source reinforcement learning environment for autonomous racing.
Stars: ✭ 38 (-76.83%)
Mutual labels:  deep-reinforcement-learning, autonomous-driving
Reinforcement learning tutorial with demo
Reinforcement Learning Tutorial with Demo: DP (Policy and Value Iteration), Monte Carlo, TD Learning (SARSA, QLearning), Function Approximation, Policy Gradient, DQN, Imitation, Meta Learning, Papers, Courses, etc..
Stars: ✭ 442 (+169.51%)
Mutual labels:  deep-reinforcement-learning, imitation-learning
Carla-ppo
This repository hosts a customized PPO based agent for Carla. The goal of this project is to make it easier to interact with and experiment in Carla with reinforcement learning based agents -- this, by wrapping Carla in a gym like environment that can handle custom reward functions, custom debug output, etc.
Stars: ✭ 122 (-25.61%)
Mutual labels:  deep-reinforcement-learning, autonomous-driving
racing dreamer
Latent Imagination Facilitates Zero-Shot Transfer in Autonomous Racing
Stars: ✭ 31 (-81.1%)
Mutual labels:  deep-reinforcement-learning, autonomous-driving
Tf2rl
TensorFlow2 Reinforcement Learning
Stars: ✭ 353 (+115.24%)
Mutual labels:  deep-reinforcement-learning, imitation-learning
pytorchrl
Deep Reinforcement Learning algorithms implemented in PyTorch
Stars: ✭ 47 (-71.34%)
Mutual labels:  deep-reinforcement-learning, imitation-learning
Deterministic Gail Pytorch
PyTorch implementation of Deterministic Generative Adversarial Imitation Learning (GAIL) for Off Policy learning
Stars: ✭ 44 (-73.17%)
Mutual labels:  deep-reinforcement-learning, imitation-learning
Pgdrive
PGDrive: an open-ended driving simulator with infinite scenes from procedural generation
Stars: ✭ 60 (-63.41%)
Mutual labels:  autonomous-driving, imitation-learning
Imitation Learning
Autonomous driving: Tensorflow implementation of the paper "End-to-end Driving via Conditional Imitation Learning"
Stars: ✭ 60 (-63.41%)
Mutual labels:  autonomous-driving, imitation-learning
imitation learning
PyTorch implementation of some reinforcement learning algorithms: A2C, PPO, Behavioral Cloning from Observation (BCO), GAIL.
Stars: ✭ 93 (-43.29%)
Mutual labels:  deep-reinforcement-learning, imitation-learning
Master-Thesis
Deep Reinforcement Learning in Autonomous Driving: the A3C algorithm used to make a car learn to drive in TORCS; Python 3.5, Tensorflow, tensorboard, numpy, gym-torcs, ubuntu, latex
Stars: ✭ 33 (-79.88%)
Mutual labels:  deep-reinforcement-learning, autonomous-driving
data aggregation
This repository contains the code for the CVPR 2020 paper "Exploring Data Aggregation in Policy Learning for Vision-based Urban Autonomous Driving"
Stars: ✭ 26 (-84.15%)
Mutual labels:  autonomous-driving, imitation-learning
Macad Gym
Multi-Agent Connected Autonomous Driving (MACAD) Gym environments for Deep RL. Code for the paper presented in the Machine Learning for Autonomous Driving Workshop at NeurIPS 2019:
Stars: ✭ 106 (-35.37%)
Mutual labels:  autonomous-driving, deep-reinforcement-learning
Imitation Learning
Imitation learning algorithms
Stars: ✭ 85 (-48.17%)
Mutual labels:  deep-reinforcement-learning, imitation-learning
Easy Rl
强化学习中文教程,在线阅读地址:https://datawhalechina.github.io/easy-rl/
Stars: ✭ 3,004 (+1731.71%)
Mutual labels:  deep-reinforcement-learning, imitation-learning
Deep Learning Papers Reading Roadmap
深度学习论文阅读路线图
Stars: ✭ 142 (-13.41%)
Mutual labels:  deep-reinforcement-learning
Autonomousdrivingcookbook
Scenarios, tutorials and demos for Autonomous Driving
Stars: ✭ 1,939 (+1082.32%)
Mutual labels:  autonomous-driving
D3rlpy
An offline deep reinforcement learning library
Stars: ✭ 139 (-15.24%)
Mutual labels:  deep-reinforcement-learning

gym-carla

An OpenAI gym third party environment for CARLA simulator.

System Requirements

  • Ubuntu 16.04

Installation

  1. Setup conda environment
$ conda create -n env_name python=3.6
$ conda activate env_name
  1. Clone this git repo in an appropriate folder
$ git clone https://github.com/cjy1992/gym-carla.git
  1. Enter the repo root folder and install the packages:
$ pip install -r requirements.txt
$ pip install -e .
  1. Download CARLA_0.9.6, extract it to some folder, and add CARLA to PYTHONPATH environment variable:
$ export PYTHONPATH=$PYTHONPATH:$YourFolder$/CARLA_0.9.6/PythonAPI/carla/dist/carla-0.9.6-py3.5-linux-x86_64.egg

Usage

  1. Enter the CARLA root folder and launch the CARLA server by:
$ ./CarlaUE4.sh -windowed -carla-port=2000

You can use Alt+F1 to get back your mouse control.

Or you can run in non-display mode by:

$ DISPLAY= ./CarlaUE4.sh -opengl -carla-port=2000
  1. Run the test file:
$ python test.py

See details of test.py about how to use the CARLA gym wrapper.

Description

  1. We provide a dictionary observation including front view camera (obs['camera']), birdeye view lidar point cloud (obs['lidar']) and birdeye view semantic representation (obs['birdeye']):
We also provide a state vector observation (obs['state']) which is composed of lateral distance and heading error between the ego vehicle to the target lane center line (in meter and rad), ego vehicle's speed (in meters per second), and and indicator of whether there is a front vehicle within a safety margin.
  1. The termination condition is either the ego vehicle collides, runs out of lane, reaches a destination, or reaches the maximum episode timesteps. Users may modify function _terminal in carla_env.py to enable customized termination condition.

  2. The reward is a weighted combination of longitudinal speed and penalties for collision, exceeding maximum speed, out of lane, large steering and large lateral accleration. Users may modify function _get_reward in carla_env.py to enable customized reward function.

Related Repos and Papers

Deep Reinforcement Learning for Autonomous Driving

Deep Imitation Learning for Autonomous Driving

Autonomous Driving Perception and Representation Learning

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].