Shivam W.

I'm a Senior Data Engineer with 5+ years of experience building scalable, cloud-native data platforms that turn raw data into reliable, business-ready insights. I've delivered enterprise solutions across banking (NAB), healthcare (Molina), and CPG (PepsiCo), specializing in end-to-end pipeline architecture, data modeling, and cloud migrations. What I bring to your project: 🔹 Cloud Data Engineering – Deep expertise in Azure (Databricks, Data Factory, Synapse) and AWS (EMR, Glue, S3, RedShift), with hands-on migration experience from on-prem and Teradata to cloud. 🔹 Pipeline Architecture & ETL – I design and build robust ingestion frameworks handling batch, incremental, and real-time data (Event Hub, Kafka) across formats like JSON, CSV, Parquet, and fixed-width files. 🔹 Data Modeling & Warehousing – Skilled in dimensional modeling, Data Vault, star/snowflake schemas, and silver/gold layer design. I've modeled 50+ tables across Oracle Fusion, SAP S/4, and healthcare domains. 🔹 Transformation & Orchestration – I translate complex business rules into DBT models, orchestrate workflows with Apache Airflow or AutoSys, and automate CI/CD via Jenkins and Azure DevOps. 🔹 Performance & Governance – I tune PostgreSQL and Spark jobs, implement data quality checks, reconciliation frameworks, and ensure compliance with data governance standards. 🔹 Generative AI & MLOps – Databricks-certified in Generative AI, with experience integrating MLflow for experiment tracking and building LLM-based automation using OpenAI and LangChain. Tech Stack: Python | SQL | Scala | Apache Spark | DBT | PostgreSQL | Snowflake | Airflow | Databricks | Azure | AWS | Git | Jenkins | MLflow | Power BI Certifications: Databricks Certified Data Engineer Professional | Azure Data Engineer (DP-203) | Snowflake SnowPro Core | Fabric Analytics Engineer (DP-600) | Generative AI Engineer Associate Whether you need a production-grade pipeline, a cloud migration, or a well-modeled data warehouse, I deliver clean, documented, and scalable solutions — on time and with clear communication. Let's discuss your project!