Graph visualization of big messy data

Synthetic dirty data generator

Script for classifying your messy directories

See how a model comes apart when repeatedly photogrammetry'd

Package for entity matching, standardization, and visualization using embeddings from large language models.

A Python tool that transforms clean datasets into realistic messy datasets for testing data cleaning processes

[READ-ONLY MIRROR] A Python implementation for Hadley Wickham's Tidy Data paper

A configurable messy CSV data generator for testing data-cleaning pipelines, ETL processes, and input sanitisation. Supports three mess levels, up to 20 field types, and optional SQL/XSS injection payloads. Available as a standalone HTML tool and a Python CLI script.

Statistical Programming in SAS

A Python data cleaning project demonstrating advanced Pandas techniques, regex, and data standardization on a messy HR dataset.

Robust CSV dialect detection methodology for Python that outperforms existing state of the art solutions by 8.35% in terms of their F1 scores, using only built-in Python modules.

😺 The easiest way to structure unstructured data

To get a hands-on experience with real-life messy data, I chose to work with food and nutrient data available on FoodData Central. I wanted to compare nutrients across different types of foods available in the US market.

Use generator expressions, formatting operations, and cleaning methods to prepare data for analysis.