--

That's a great question Lenvy.

The way I would recommend going about it, is to have one Airflow DAG per schedule (e.g. hourly, daily, weekly etc.). Then you can tag your dbt models accordingly, and then use the corresponding tag filter when using dbt-airflow in order to run only the models being tagged with that particular time interval.

Hope this helps!

--

--

Giorgos Myrianthous
Giorgos Myrianthous

Written by Giorgos Myrianthous

I strive to build data-intensive systems that are not only functional, but also scalable, cost effective and maintainable over the long term.

No responses yet