
Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. It allows users to define workflows as Directed Acyclic Graphs (DAGs) of tasks, making it easier to manage data pipelines and automate processes.
Steps
airflow.Server: Configure Airflow server connection.
airflow.getDag: Retrieve basic information about a DAG.
airflow.filterDags: List all DAGs with optional filters.
airflow.updateDag: Mark a DAG as active or paused.
airflow.getDagRun: Retrieve details of a specific DAG run.
airflow.listDagRuns: List all runs for a specific DAG.
airflow.getTaskInstance: Retrieve details of a task instance within a DAG run.
airflow.triggerDagRun: Trigger a new DAG run.
airflow.modifyDagRun: Modify the state of a DAG run.
airflow.deleteDagRun: Delete a specific DAG run.