The Library · Insights
Deep dives across data, automation & AI
42 in-depth articles — from Excel foundations to production machine learning. Filter by topic or difficulty to find exactly what you need.
PythonPractitioner
Comparing Periods and Calculating Month-over-Month, Year-over-Year, and Rolling Changes in pandas with shift and pct_change
Learn how to build production-quality period comparison analysis in pandas using shift and pct_change. This lesson covers MoM, YoY, and rolling metrics for single and multi-segment time series, with realistic business data and a reusable report function you can ship immediately.
19 min read
PythonFoundation
Conditional Columns and Bucketing in pandas: Creating New Fields with np.where, cut, and map
Learn how to create new columns in pandas using np.where for conditional flags, pd.cut for numeric bucketing, and .map() for code-to-label substitution. Three essential tools that replace slow loops and Excel workarounds with fast, readable Python.
15 min read
PythonFoundation
Reshaping Wide and Long Data for Reporting: When and How to Use melt, pivot, and unstack in pandas
Wide data is easy to read but hard to analyze. Long data is easy to analyze but hard to present. This lesson teaches you exactly when to use melt, pivot, and unstack in pandas — with realistic examples and a clear workflow for converting between formats.
14 min read
PythonExpert
Detecting and Resolving Data Quality Issues Across Merged DataFrames: Diagnosing Join Mismatches, Duplicate Keys, and Row Count Surprises in pandas
Silent join bugs — row multiplication, unmatched keys, type mismatches — are the most dangerous errors in data analysis because pandas won't warn you. This lesson gives you a complete diagnostic toolkit: pre-merge key profiling, cardinality analysis, post-merge row count auditing, and defensive merge wrappers that catch problems before they corrupt your analysis.
28 min read
PythonPractitioner
Weighted Averages, Percent of Total, and Custom Aggregations in pandas: Going Beyond sum and mean in groupby
Learn to compute revenue-weighted averages, percent-of-total share metrics, and fully custom aggregations in pandas groupby. This lesson builds a complete, production-ready sales analytics summary using apply, agg, and transform together.
18 min read
PythonFoundation
Summarizing and Cross-Tabulating Categorical Data in pandas: value_counts, crosstab, and Percentage Breakdowns
Learn how to summarize categorical columns in pandas using value_counts() and build two-way contingency tables with pd.crosstab(). This lesson covers normalization, margins, and percentage breakdowns — the tools you need to answer "how is X distributed across Y?" questions quickly and correctly.
14 min read
PythonExpert
Building a Reusable ETL Pipeline in pandas: Extract, Transform, and Load Data from Multiple Sources into a Clean, Analysis-Ready Output
Learn to build a production-grade ETL pipeline in pandas that extracts data from CSV files, Excel workbooks, and SQL databases; applies a layered transformation strategy; and loads results to multiple output formats. This lesson covers architecture, error handling, validation, and performance — the full picture for data professionals who need pipelines that actually hold up.
28 min read
PythonPractitioner
Reshaping and Analyzing Multi-Level Data in pandas: Working with MultiIndex Columns and Rows After groupby and pivot_table
MultiIndex DataFrames from groupby and pivot_table are powerful but consistently confusing — until you understand the structure. This lesson teaches you to select, flatten, stack, and unstack multi-level data through a complete sales analysis project.
19 min read
PythonFoundation
Conditional Column Creation in pandas: Adding Calculated Fields with np.where, cut, and map
Learn how to derive new columns in pandas using three essential tools: np.where for conditional logic, pd.cut for numeric binning, and .map() for lookup-style translation. By the end, you'll be able to transform raw transactional data into analysis-ready features without writing a single loop.
14 min read
PythonPractitioner
Calculating Running Totals, Cumulative Averages, and Ranked Rows in pandas with expanding, cumsum, and rank
Learn how to build running totals, cumulative averages, and within-group rankings in pandas using cumsum, expanding, and rank. Goes beyond the basics to cover groupby integration, tie-breaking strategies, NaN handling, and a complete sales dashboard project.
19 min read
PythonFoundation
Validating and Profiling a New Dataset with pandas: Row Counts, Distributions, and Outlier Checks Before You Analyze
Jumping straight into analysis on a new dataset is one of the most common — and costly — mistakes in data work. This lesson teaches you a systematic profiling workflow using pandas: checking shape, completeness, duplicates, distributions, and outliers before a single aggregation runs.
15 min read
PythonFoundation
Combining and Stacking Multiple Excel or CSV Files into One pandas DataFrame
Stop copying and pasting data between spreadsheets. Learn how to automatically find, read, and combine dozens of CSV or Excel files into a single pandas DataFrame using glob, pathlib, and pd.concat — with source tracking built in.
15 min read