--

In that case, I would recommend the solution using PythonOperator since that option gives you the opportunity to find the last successful run of the DAG of interest (using DagRun). Furthermore, there's no retry mechanism which means there's no waiting time (poking, timeout, etc.)

--

--

Giorgos Myrianthous
Giorgos Myrianthous

Written by Giorgos Myrianthous

I strive to build data-intensive systems that are not only functional, but also scalable, cost effective and maintainable over the long term.

No responses yet