Tools & Utilities
Open Source

Anime Genre Analyst & Reporting Engine

View Source Code
PythonPandasMatplotlibSeabornNumPyTabulate

An automated, vectorized ETL pipeline that processes denormalized datasets to analyze genre correlations, compute sub-genre synergies, and generate comprehensive analytical reports.

Tech Stack

PythonPandasMatplotlibSeabornNumPyTabulate

System Metrics

▹Eliminated native Python iteration overhead by enforcing C-level vectorized operations (`apply`, `groupby`, `agg`) for large-scale DataFrame mutations
▹Prevented Matplotlib memory leaks by explicitly managing the visualization lifecycle and enforcing immediate garbage collection of inactive Figure canvases

Why Did I Build This?

"Processing raw, denormalized datasets—such as comma-separated arrays packed into single columns—is error-prone and inefficient. I engineered this pipeline to safely ingest malformed CSVs, dynamically resolve nested string relationships, and autonomously generate statistical reports, transforming raw data into clear insights without manual intervention."

Architecture & Decisions

Core data manipulation is offloaded to Pandas' C-backed vectorized operations. Complex 1:N relationships are flattened via the `explode` API and processed through optimized `groupby` aggregations. To guarantee fault tolerance, the ingestion layer utilizes a sequential multi-encoding fallback (UTF-8, Latin-1, CP1252) preventing runtime crashes on corrupted files. The visualization layer renders entirely in-memory via Matplotlib, serializing outputs into deterministic, timestamped artifact directories (Markdown, PNG, TXT).

Key Features

  • 01.Fault-tolerant CSV ingestion routine with automatic multi-encoding fallback
  • 02.Vectorized transformation of nested comma-separated strings into 1:N relational rows
  • 03.Statistical aggregation engine computing primary and sub-genre performance metrics
  • 04.Automated serialization of timestamp-isolated directories containing Markdown reports and charts