--

Hey Eric,

Thanks for taking the time to read my article.

In a nutshell, dbt is used for the creation and management of data models. It let's you specify (or easily write your own) pre-made tests and will automatically take care of the inter-dependencies between these models.

For example, let's say you have 3 models, namely A, B and C. Now, model C depends on model B that sub-sequently depends on model C. dbt is going to ensure that the sequence of execution won't violate this dependency. This is however a small subset of features plugged into dbt.

Now going to your specific use-case, let me first start by asking what Databricks products exactly do you use (Databricks is the company, not the tool)?

--

--

Giorgos Myrianthous
Giorgos Myrianthous

Written by Giorgos Myrianthous

I strive to build data-intensive systems that are not only functional, but also scalable, cost effective and maintainable over the long term.

Responses (1)