Muddaser T.

Senior Databricks Data Engineer and Data Architect with 9 years of experience building production data platforms on Azure, AWS, and GCP. I design and build Databricks lakehouses, PySpark ETL/ELT pipelines, Snowflake data warehouses, and GenAI solutions on Databricks. 77 Upwork jobs completed and $200K+ earned. WHAT I CAN DO FOR YOU Databricks Lakehouse & Data Engineering Delta Lake, Unity Catalog, medallion architecture (bronze/silver/gold), Lakeflow Spark Declarative Pipelines (DLT), Lakeflow Jobs / Databricks Workflows, performance tuning, and cost optimization. Data Platform Migration Hadoop to Databricks, Redshift to Databricks Unity Catalog, on-premises SQL Server to Azure Data Lake, legacy ETL to Snowflake. Dependency mapping, SQL-to-PySpark conversion, data reconciliation, and production cutover. ETL / ELT Pipelines PySpark, Spark SQL, Python, Azure Data Factory (ADF), Apache Airflow, GCP Composer, dbt. Batch and real-time streaming with Kafka, Azure Event Hubs, and Stream Analytics. Generative AI & Machine Learning on Databricks AI agents with Databricks Agent Bricks, MLflow experiment tracking, Model Serving, AI/BI Genie, and RAG pipelines on curated Delta data. Cloud Data Warehousing & BI Snowflake (Snowpipe, Tasks, stored procedures), Azure Synapse, BigQuery, Redshift, Power BI. RECENT PROJECTS - Built a production GenAI investment analyst on Databricks Agent Bricks, fed by Lakeflow pipelines and an MLflow oil-price forecasting model on Model Serving, producing a daily analyst report. - Migrated a reinsurance company's Hadoop/Spark ETL workloads to Databricks, including reconciliation, tuning, and production cutover. - Migrated a Redshift data warehouse to Databricks Unity Catalog with SQL-to-PySpark conversion and data-quality validation. - Scaled an ADF + Snowflake ingestion platform from about 20 to 800+ sources with config-driven parallel processing. - Built a real-time IoT predictive maintenance solution on Azure Databricks and Event Hubs. HOW I WORK - Clear scope and plan before I start - Daily or weekly written updates - Clean, documented, production-ready code with data-quality checks and monitoring - Overlap with US, UK, EU, and Middle East working hours Microsoft certified (Azure data exams 70-475 and 70-775). BS Computer Science, FAST-NUCES. If you need a Databricks, PySpark, or Snowflake data engineer who delivers reliable, production-ready data platforms, send me a message and let's discuss your project.