tuanavu / Airflow Tutorial
Licence: mit
Apache Airflow tutorial
Stars: ✭ 485
Programming Languages
python
139335 projects - #7 most used programming language
Labels
Projects that are alternatives of or similar to Airflow Tutorial
Python For Probability Statistics And Machine Learning
Jupyter Notebooks for Springer book "Python for Probability, Statistics, and Machine Learning"
Stars: ✭ 481 (-0.82%)
Mutual labels: jupyter-notebook
Recipenlg
Set of scripts and notebooks used to produce results visible in RecipeNLG paper
Stars: ✭ 485 (+0%)
Mutual labels: jupyter-notebook
Epipolarpose
Self-Supervised Learning of 3D Human Pose using Multi-view Geometry (CVPR2019)
Stars: ✭ 477 (-1.65%)
Mutual labels: jupyter-notebook
Bayesian Stats Modelling Tutorial
How to do Bayesian statistical modelling using numpy and PyMC3
Stars: ✭ 480 (-1.03%)
Mutual labels: jupyter-notebook
Stn.pytorch
pytorch version of spatial transformer networks
Stars: ✭ 481 (-0.82%)
Mutual labels: jupyter-notebook
Jupyterhub Deploy Docker
Reference deployment of JupyterHub with docker
Stars: ✭ 479 (-1.24%)
Mutual labels: jupyter-notebook
Tensorflow Book
Accompanying source code for Machine Learning with TensorFlow. Refer to the book for step-by-step explanations.
Stars: ✭ 4,448 (+817.11%)
Mutual labels: jupyter-notebook
Nothotdog Classifier
What would you say if I told you there is a app on the market that tell you if you have a hotdog or not a hotdog.
Stars: ✭ 479 (-1.24%)
Mutual labels: jupyter-notebook
Monk v1
Monk is a low code Deep Learning tool and a unified wrapper for Computer Vision.
Stars: ✭ 480 (-1.03%)
Mutual labels: jupyter-notebook
Deep Learning Specialization Coursera
Deep Learning Specialization by Andrew Ng on Coursera.
Stars: ✭ 483 (-0.41%)
Mutual labels: jupyter-notebook
Pretty Midi
Utility functions for handling MIDI data in a nice/intuitive way.
Stars: ✭ 477 (-1.65%)
Mutual labels: jupyter-notebook
Ai Notebooks
Some ipython notebooks implementing AI algorithms
Stars: ✭ 484 (-0.21%)
Mutual labels: jupyter-notebook
Practical rl
A course in reinforcement learning in the wild
Stars: ✭ 4,741 (+877.53%)
Mutual labels: jupyter-notebook
Practical Statistics For Data Scientists
Code repository for O'Reilly book
Stars: ✭ 475 (-2.06%)
Mutual labels: jupyter-notebook
Imageprocessing Python
该资源为作者在CSDN的撰写Python图像处理文章的支撑,主要是Python实现图像处理、图像识别、图像分类等算法代码实现,希望该资源对您有所帮助,一起加油。
Stars: ✭ 483 (-0.41%)
Mutual labels: jupyter-notebook
Csrnet Pytorch
CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes
Stars: ✭ 484 (-0.21%)
Mutual labels: jupyter-notebook
Airflow tutorial
This is the code for Apache Airflow Tutorials playlist by Tuan Vu on Youtube
Contents
Getting Started
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.
- Clone this repo
- Install the prerequisites
- Run the service
- Check http://localhost:8080
- Done! 🎉
Prerequisites
- Install Docker
- Install Docker Compose
- Following the Airflow release from Python Package Index
Usage
Run the web service with docker
docker-compose up -d
# Build the image
# docker-compose up -d --build
Check http://localhost:8080/
-
docker-compose logs
- Displays log output -
docker-compose ps
- List containers -
docker-compose down
- Stop containers
Other commands
If you want to run airflow sub-commands, you can do so like this:
-
docker-compose run --rm webserver airflow list_dags
- List dags -
docker-compose run --rm webserver airflow test [DAG_ID] [TASK_ID] [EXECUTION_DATE]
- Test specific task
If you want to run/test python script, you can do so like this:
-
docker-compose run --rm webserver python /usr/local/airflow/dags/[PYTHON-FILE].py
- Test python script
Connect to database
If you want to use Ad hoc query, make sure you've configured connections: Go to Admin -> Connections and Edit "postgres_default" set this values:
- Host : postgres
- Schema : airflow
- Login : airflow
- Password : airflow
Credits
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].