Architecting Enterprise Data Platforms & Applied AI Workflows.
Bridging production-scale distributed data engineering (BigQuery, Spark, Airflow) with modern Information Retrieval, RAG, and Agentic AI workflows.
Enterprise Architecture Case Studies
Deep-dive architectural RFCs detailing zero-downtime cloud migrations, multi-stream data pipelines, and verified operational benchmarks.
The 'Cost of Deal' Platform: Unified Enterprise Data Product
Consolidated fragmented pricing, ticketing, and merchant rebate pipelines into an immutable, idempotent Data Product serving C-suite margin analytics.
Enterprise Oracle to BigQuery Migration: Architecture & Cutover
Re-architected monolithic Oracle nightly batches into partitioned BigQuery ELT with Airflow DAGs, reducing critical reporting latency from 8 hours to 15 minutes.
Applied AI & Open-Source Tooling
Combining distributed data engineering discipline with UIUC CS 410/441 research, Model Context Protocol (MCP), and local LLM automations.
Building an MCP Server for Data Pipeline Triage & BigQuery Optimization
Empowering AI coding assistants with Model Context Protocol (MCP) tools to autonomously inspect BigQuery query execution plans, parse Airflow failure logs, and suggest partitioning and clustering fixes.
Automated YouTube & Media Asset Pipeline: FastAPI, DuckDB, Polars & Local LLMs
A production-grade local automation pipeline transforming raw video transcripts, timestamps, and slide benchmarks into SEO-optimized YouTube chapters, metadata, and cross-platform markdown notes.
Hybrid Search & BM25 + Dense Retrieval for Enterprise Data Catalogs
Why naive vector search fails on technical schemas and error logs, and how combining Okapi BM25 lexical ranking with dense semantic vectors (RRF) builds bulletproof RAG for Data Engineers.
Transitioning into Data Engineering or scaling into AI Data Platforms?
I offer focused 1-on-1 advisory sessions for junior and mid-level engineers: architectural system design audits, cloud warehouse roadmaps (BigQuery/Spark), and mock technical interview preparation.