Recent questions tagged Airflow

0 votes

1.2k views

1 answer

airflow - Wiring top-level DAGs together

I need to have several identical (differing only in arguments) top-level DAGs that can also be triggered together with ... , but would be upto 15 in production) Question&Answers:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.7k views

1 answer

airflow - How to set a default dag trigger configuration json

When triggering a dag in airflow, there is a window, with which I am able to parameters to the dag in a ... /questions/65829103/how-to-set-a-default-dag-trigger-configuration-json...

asked Oct 7, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.5k views

1 answer

airflow - How to force fail a dag after x number of time?

I want to force fail a dag after say 3 hours have passed. I have a dag that is scheduled for 2am and one that ... questions/65834541/how-to-force-fail-a-dag-after-x-number-of-time...

asked Oct 7, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.4k views

1 answer

airflow - Changes in DAG/Operator while DAG is running

What would happen if DAG changes while DAG is running (particularly if this is dynamic DAG) What would happen ... /questions/65905412/changes-in-dag-operator-while-dag-is-running...

asked Oct 7, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.5k views

1 answer

airflow - Execute bash script (kerberos kinit) when reschedule DAG task (HiveCLIPartitionSensor)

I've got two tasks. Bash Operator [kinit], which takes kerberos ticket for hadoop Hive Sensor [ ... execute-bash-script-kerberos-kinit-when-reschedule-dag-task-hiveclipartitions...

asked Oct 7, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.4k views

1 answer

airflow worker - AIRFLOW__CELERY__WORKER_AUTOSCALE

What is the best approach to scale my Airflow environment with AIRFLOW__CELERY__WORKER_AUTOSCALE=100,35 question ... .com/questions/66050305/airflow-celery-worker-autoscale...

asked Oct 6, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.3k views

1 answer

airflow - adhoc运行的airflow命令行参数？(airflow command line parameter for adhoc run?)

We have just started including airflow for scheduling. (我们刚刚开始包括气流以进行调度 )One of my scripts runs ... (trade_acx_ld_cmd)) t2.set_upstream(t1) ask by user3858193 translate from so...

asked Mar 6, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.5k views

1 answer

airflow - adhoc运行的airflow命令行参数？(airflow command line parameter for adhoc run?)

We have just started including airflow for scheduling. (我们刚刚开始包括气流以进行调度 )One of my scripts runs ... (trade_acx_ld_cmd)) t2.set_upstream(t1) ask by user3858193 translate from so...

asked Mar 6, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.5k views

1 answer

airflow - adhoc运行的airflow命令行参数？(airflow command line parameter for adhoc run?)

We have just started including airflow for scheduling. (我们刚刚开始包括气流以进行调度 )One of my scripts runs ... (trade_acx_ld_cmd)) t2.set_upstream(t1) ask by user3858193 translate from so...

asked Feb 21, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.4k views

1 answer

airflow operator import doesn't seem to work

I am new to airflow and need some direction on this one... I'm creating my first dag that uses a ... import MySqlOperator appreciate help on resolving this issue thanks in advance!...

asked Feb 19, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.4k views

1 answer

airflow - Bash syntax: if [ ! -f "{}" ]; then exit 1; fi'

I'm reading this bash command in a Bash Operator for Apache Airflow and I couldn't really understand it despite ... (input_file)) Could you help me explaining this bash command?...

asked Feb 6, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

4.5k views

1 answer

airflow - How to force fail a dag after x number of time?

I want to force fail a dag after say 3 hours have passed. I have a dag that is scheduled for 2am and one ... where I want to give preference to a dag during certain hours...

asked Jan 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

Categories

Just Browsing Browsing

Most popular tags