PinnedGiorgos MyrianthousinTowards Data ScienceAn Introduction To Analytics EngineeringWho is an Analytics Engineer and what are they supposed to do·6 min read·Oct 22, 2023--3--3
PinnedGiorgos MyrianthousinTowards Data ScienceKafka No Longer Requires ZooKeeperVersion 2.8.0 Gives You Early Access to Zookeeper-Less Kafka·5 min read·Apr 27, 2021--1--1
Giorgos MyrianthousinTowards Data ScienceModeling Slowly Changing DimensionsA deep dive into the various SCD types and how they can be implemented in Data Warehouses·13 min read·May 3, 2024--1--1
Giorgos MyrianthousinMaking Plum 🛠️dbt + Airflow = ❤Building dbt-airflow: A Python package that integrates dbt and Airflow·12 min read·Apr 16, 2024--7--7
Giorgos MyrianthousinTowards Data ScienceBeneath the Surface: A Closer Look at 4 Airflow InternalsFour Apache Airflow internals you might have missed·6 min read·Feb 3, 2024----
Giorgos MyrianthousinTowards Data ScienceMastering Airflow VariablesThe way you retrieve variables from Airflow can impact the performance of your DAGs·10 min read·Jan 27, 2024--4--4
Giorgos MyrianthousinLevel Up CodingCreating Airflow Local Development Environment with Astro CLIGetting Airflow up and running in less than a minute·5 min read·Dec 28, 2023--1--1
Giorgos MyrianthousinTowards Data ScienceRunning Airflow DAG Only If Another DAG Is SuccessfulUsing Airflow sensors to control the execution of DAGs on a different schedule·11 min read·Dec 19, 2023--1--1
Giorgos MyrianthousinTowards Data ScienceTransitioning from ETL to ELTHow cloud computing and analytics engineering forced the transition from ETL to ELT·7 min read·Dec 6, 2023--2--2
Giorgos MyrianthousinTowards Data SciencePath Representation in PythonHere’s why you should avoid representing paths as strings and use Pathlib instead·5 min read·Sep 14, 2023--5--5