Version 2.8.0 Gives You Early Access to Zookeeper-Less Kafka — Introduction Apache Kafka 2.8.0 is finally out and you can now have early-access to KIP-500 that removes the Apache Zookeeper dependency. Instead, Kafka now relies on an internal Raft quorum that can be activated through Kafka Raft metadata mode. …

Save time when converting large Spark DataFrames to Pandas — Converting a PySpark DataFrame to Pandas is quite trivial thanks to toPandas()method however, this is probably one of the most costly operations that must be used sparingly, especially when dealing with fairly large volume of data. Why is it so costly? Pandas DataFrames are stored in-memory which means that the operations over them are faster…

Autosigning Git commits with GPG keys on GitHub — Git is a popular version control system used by developers all over the world to manage their codebase efficiently. However, the security of Git has become a major concern in recent years, as cyber-attacks on software projects have become more common. …

Speeding up frequently called functions in Python — In today’s world, where the amount of data being processed is growing at an unprecedented rate, having efficient and optimized code has become more important than ever. Python, being a popular programming language, offers several built-in tools to optimize the performance of your code. …

Approaching and solving the ‘Interviews’ challenge on HackerRank with SQL — Consistent practice is essential for improving your SQL skills or refreshing your knowledge, especially when preparing for interviews. Fortunately, there are several platforms, including HackerRank, that offer a range of SQL challenges to help you enhance your problem-solving abilities. In this tutorial, we will focus on one of HackerRank’s medium-level…

Understanding the difference between these window functions in SQL — In the world of SQL, a window function is a powerful construct that allows users to segment and manipulate data in precise ways. By grouping data based on specific columns and sorting criteria, window functions enable advanced computations within partitions. In this comprehensive tutorial, we will explore three of the…

Fixing a bug introduced in yt-dlp Python package — In recent weeks, many Python developers have been impacted by a bug introduced in the latest release of the yt_dlp Python package. This bug is causing previously functional codebases to fail, with the error message “Error: Unable to extract uploader id. In this short article, we will delve into the…

Fixing the openpyxl bug when calling pandas read_excel method — Over the last few weeks, many Python users have started reporting issues when trying to load data from spreadsheets into pandas DataFrames via read_excel method. More specifically, they run into the following error: AttributeError: 'ReadOnlyWorksheet' object has no attribute 'defined_names' In this short tutorial, we will discuss why we’ve been…

Approaching and solving HackerRank’s Contest Leaderboard Problem with SQL — If you are looking into improving your SQL skills or nailing your next technical interview then all you need to do is practice. …