Subham Kumar P.

I build production data pipelines on AWS and Azure/Microsoft Fabric, and prepare data for AI/ML and LLM-powered applications. I specialize in: • AWS data engineering — S3, Glue, Lambda, Redshift, EMR • AI/ML-ready data pipelines — cleaning, structuring, and serving data for machine learning and generative AI workflows (RAG, AI agents) • Microsoft Fabric & Azure Data Factory — Lakehouses, Delta Lake, incremental/upsert loads, orchestration • PySpark — transformation logic, data quality checks, performance tuning • API-to-warehouse integrations — Opera Cloud, NetSuite, and other REST/SOAP sources • SQL development, data modeling, and Snowflake pipelines Typical architecture I work with: APIs / ERPs / Databases → AWS (S3, Glue) or Azure (ADF, Fabric) → Data Quality → Warehouse/Lakehouse → Analytics or AI/ML layer I write pipelines with proper error handling, logging, and incremental-load logic so they hold up in production, not just in a demo. Whether you need a data pipeline that feeds an AI application, a cloud data platform on AWS or Azure, or help fixing an existing pipeline that's slow or unreliable, I can help. Let's talk about your AWS, AI/data pipeline, Fabric, or ERP integration project.