Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
321 views
in Technique[技术] by (71.8m points)

Scheduling Airflow Dag Runs to have exact times rather than cron

I have a two DAGs.

DAG A: picks up a zip file from a folder and unzips it at 8am.

it always extracts 5 csv files.

DAG B: parses a csv file.

I want DAG B to execute exactly 10 min after DAG A And I want DAG B to only execute 5 times, and for those 5 dag runs to execute 10 minutes after each other.

How can I get airflow to do this?

Here is an example future dates:

- DAG A tommorrow 8:00AM 
- DAG B tommorrow 8:10AM
- DAG B tommorrow 8:20AM
- DAG B tommorrow 8:30AM
- DAG B tommorrow 8:40AM
- DAG B tommorrow 8:50AM
*  done no more dag run until the next day
question from:https://stackoverflow.com/questions/66056234/scheduling-airflow-dag-runs-to-have-exact-times-rather-than-cron

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Answer

0 votes
by (71.8m points)
Waitting for answers

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

...