All Projects → huseinzol05 → Python Devops

huseinzol05 / Python Devops

Licence: mit
gathers Python stack for DevOps, these are usually my basic templates use for my implementations, so, feel free to use it and evolve it! Everything is Docker!

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Python Devops

pandora
Small box of pandora to prototype your app with ready for use backend. This is just my compilation of different solutions occasionally applied in hackathons and challenges
Stars: ✭ 26 (-57.38%)
Mutual labels:  kibana, rabbitmq, celery
Autoops
linux资产管理,cmdb,django, webssh,运维管理平台,数据库操作平台 本项目已停止开发!因长时间未对代码进行维护,可能会造成项目在不同环境上无法部署、运行BUG等问题,请知晓!项目仅供参考!
Stars: ✭ 340 (+457.38%)
Mutual labels:  celery, devops
Cmdb
CMDB: configuration and management of IT resources, demo: http://121.42.12.46:8000
Stars: ✭ 337 (+452.46%)
Mutual labels:  flask, devops
Flack
Companion code to my PyCon 2016 "Flask at Scale" tutorial session.
Stars: ✭ 458 (+650.82%)
Mutual labels:  flask, celery
Elves
开源自动化运维开发平台(IT Automatic Develop Platform)
Stars: ✭ 290 (+375.41%)
Mutual labels:  rabbitmq, devops
Letsmapyournetwork
Lets Map Your Network enables you to visualise your physical network in form of graph with zero manual error
Stars: ✭ 305 (+400%)
Mutual labels:  rabbitmq, celery
Full Stack
Full stack, modern web application generator. Using Flask, PostgreSQL DB, Docker, Swagger, automatic HTTPS and more.
Stars: ✭ 451 (+639.34%)
Mutual labels:  flask, celery
Online-Judge
Online Judge for hosting coding competitions inside NIT Durgapur made by GNU/Linux Users' Group!
Stars: ✭ 19 (-68.85%)
Mutual labels:  rabbitmq, celery
Flower
Real-time monitor and web admin for Celery distributed task queue
Stars: ✭ 5,036 (+8155.74%)
Mutual labels:  rabbitmq, celery
Node Celery
Celery client for Node.js
Stars: ✭ 648 (+962.3%)
Mutual labels:  rabbitmq, celery
Sparrow
运维管理平台(python3+flask+pycharts+apscheduler+gunicorn),模块化结构设计,底层依托mysql、influxdb、elasticsearch、zabbix、k8s等数据源数据
Stars: ✭ 723 (+1085.25%)
Mutual labels:  flask, devops
celery-priority-tasking
This is a prototype to schedule jobs in the backend based on some priority using Rabbitmq and Celery.
Stars: ✭ 28 (-54.1%)
Mutual labels:  rabbitmq, celery
Bibi
An e-commerce fullstack solution for Flask 出口电商全栈解决方案
Stars: ✭ 914 (+1398.36%)
Mutual labels:  flask, celery
Gather Deployment
Gathers scalable tensorflow and infrastructure deployment
Stars: ✭ 326 (+434.43%)
Mutual labels:  flask, celery
celery-connectors
Want to handle 100,000 messages in 90 seconds? Celery and Kombu are that awesome - Multiple publisher-subscriber demos for processing json or pickled messages from Redis, RabbitMQ or AWS SQS. Includes Kombu message processors using native Producer and Consumer classes as well as ConsumerProducerMixin workers for relay publish-hook or caching
Stars: ✭ 37 (-39.34%)
Mutual labels:  rabbitmq, celery
Enferno
A Python framework based on Flask microframework, with batteries included, and best practices in mind.
Stars: ✭ 385 (+531.15%)
Mutual labels:  flask, celery
TelephoneDirectory
microservices-> .net 6, golang - Docker, Ocelot, RabbitMq, MassTransit, mssql, postgresql, elasticsearch, kibana, jwt
Stars: ✭ 40 (-34.43%)
Mutual labels:  kibana, rabbitmq
frontreport
Simple frontend logging collector written in Go
Stars: ✭ 23 (-62.3%)
Mutual labels:  kibana, rabbitmq
Invenio
Invenio digital library framework
Stars: ✭ 469 (+668.85%)
Mutual labels:  flask, rabbitmq
Dockerfiles
50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu
Stars: ✭ 847 (+1288.52%)
Mutual labels:  rabbitmq, devops

logo

MIT License


Python-Devops, gathers Python stack for DevOps, these are usually my basic templates use for my implementations, so, feel free to use it and evolve it! Everything is Docker!

Table of contents

Basic Python

  1. AutoPEP8
  2. Graph function dependencies

Basic Backend

  1. Flask
  2. Flask with MongoDB
  3. REST API Flask
  4. Flask Redis PubSub
  5. Flask Mysql with REST API
  6. Flask Postgres with REST API
  7. Flask Elasticsearch
  8. Flask Logstash with Gunicorn
  9. MLFlow with Nginx reversed proxy

Scaling Backend

  1. Flask SocketIO with Redis
  2. Multiple Flask with Nginx Loadbalancer
  3. Multiple Flask SocketIO with Nginx Loadbalancer
  4. RabbitMQ and multiple Celery with Flask
  5. Flask + Gunicorn + HAproxy

Big data piping

  1. Streaming Tweepy to Elasticsearch
  2. Scheduled crawler using Luigi Spotify to Elasticsearch
  3. Airflow to Elasticsearch

Apache big data

  1. Flask with Hadoop
  2. Flask with Kafka
  3. Flask with Hadoop Hive
  4. PySpark with Jupyter and Hadoop
  5. Flink with Jupyter (not working)
  6. Apache Storm with Redis

Unit test

  1. Pytest

Stress test

  1. Locust

Miscellaneous (huseinhouse collection)

  1. Elasticsearch + Kibana
  2. Elasticsearch + Cerebro
  3. Jupyter notebook
  4. Jupyterhub
  5. Jupyterhub + Github Auth
  6. Hadoop cluster + Luigi + Jupyter Notebook
  7. Kafka cluster
  8. Apache Storm

How-to Docker

Every folders contain .yml for docker-compose. You need to install Docker-Compose first.

To run,

compose/build

To safely close

compose/down

To remove all images

docker rmi $(docker images -q)

To remove none images

docker rmi $(docker images -f "dangling=true" -q)

To remove all containers

docker rm $(docker ps -aq)
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].