Setting-up Airflow on Windows 10 without Docker

Apache Airflow is a great tool to manage and schedule all steps of a data pipeline. However, running it on Windows 10 can be challenging. Airflow’s official Quick Start suggests a smooth start, but solely for Linux users. What about on Windows 10 people incase if you want to avoid Docker which is not scalable but good from your own learning perspective :-). These steps hopefully will work for you, too.

Step By Step Guide

Step 1

1. Open Microsoft Store, search for Ubuntu, install it then restart.
2. Control Panel -> Program and Features -> Turn Windows Features on or off.
3. Enable Windows Subsystem for Linux.
4. Install Ubuntu from windows store and restart system.
5. Install and update PIP.

sudo apt-get install software-properties-common

sudo apt-add-repository universe

sudo apt-get update

sudo apt-get install python-pip

Step 2

Install airflow

1. export SLUGIFY_USES_TEXT_UNICODE=yes
2. pip install apache-airflow

Step 3

1. airflow init db
2. airflow webserver -p 8080

3. Setup folder for DAG

1. Create Folder DAG in c:\DAG
2. Change the path inside airflow.cfg

Create a HelloWorld DAG

run http://localhost:8080

Here you go

Hope this Helps

Thanks