Data Analytics

Data drift meets data profiling — TLDR: We experimented with statistical tests, Kolmogorov-Smirnov (KS) specifically, applied to full datasets as well as dataset profiles and compared results. The results allow us to discuss the limitations of data profiling for KS drift detection and the pros and cons of the KS algorithm for different scenarios. …

The goal of this article is a guideline for building out a scalable business analytics framework for the modern business stack. The article is broken into three sections: Data, Analytics, and Infrastructure Strategies. — Quick Intro: Data-driven decision-making is a fundamental element of business growth. Moreover, the field is undergoing a revival due to many concurrent industry trends including the proliferation of APIs/digital data, increased basic coding literacy of new workforce entrants (high school and college grads), and new business team structures (such as Fusion Teams).

Stop waiting on pandas operations. Parallelize them. — One of the major limitations of Pandas is that it can be slow when working with large datasets, particularly when running complex operations. This can frustrate data scientists and analysts who need to process and analyze large datasets in their work. There are a few ways to address this issue…

Nowadays data science term is quite popular. People are moving toward this domain, and it is considered one of the most modern and fascinating jobs. Before understanding the term Data Science, we must first understand what Data is and how it is Generated. Storytelling is an important part of data…

As a recent graduate in the field of data analysis, I was excited to start my first job search. I had studied SQL as part of my degree program and was confident in my abilities, but I still felt a bit overwhelmed by the job market. …

In this article, I want to illustrate the uses of three measures of central tendency, when to use which central tendency, how median is used over mean, and how mode can be used. Central tendency The measure of central tendency is a single value that represents the entire data. …