Skip to content
BackNov 7
Mehedi H.

Mehedi H.

Data Engineer | Analytics Engineer - SQL|DBT|Airflow|PySpark|Kafka

Passionate, and detail-oriented Analytics Engineer with a strong focus on bridging the gap between data engineering and business analytics to empower self-service analytics and drive informed decision-making. Committed to continuous improvement though experiences and always eager to take on new challenges that make a real impact. Self Initiated Projects ✅ Core Banking Data Mart Automation - dbt | Airflow | PostgreSQL 🔗 ▶ Designed and implemented an end-to-end ATM Withdrawal Transaction Data Mart using dbt (Bronze–Silver–Gold layers) on PostgreSQL, incorporating incremental models, data quality tests, and freshness checks. ▶ Orchestrated automated 10-minute incremental updates using Apache Airflow, enabling nearly real-time data availability for downstream analytics. ✅ Core Banking System – ATM Withdrawal Streaming Simulation - Databricks | PySpark | Delta Lake | Streaming ETL ▶Designed and implemented a core banking data model, including 6 reference tables, 5 entity tables, and a double-entry financial journal table to simulate ATM cash withdrawal operations. ▶Developed a high-volume synthetic data generator and real-time PySpark Structured Streaming pipeline in Databricks to simulate and transform 100,000+ double-entry ATM transactions per minute into a unified Silver-layer data mart using Delta Lake, stream-stream joins, watermarks, and broadcast joins. ✅Real-Time Change Data Capture (CDC) Pipeline with Kafka, Debezium, and ClickHouse ▶Built a real-time data pipeline by setting up Kafka with Confluent Control Center and developing a Python Faker script to generate and stream 10M synthetic financial records. ▶Simulated a production system by sinking data into PostgreSQL, then enabled CDC with Debezium, replicating changes in real time to a ClickHouse target database with a custom-designed schema. ✅ Data Transformation with DBT ▶Built staging schemas and incremental models with well-defined schema documentation to enable efficient, modular data transformation, and ensure maintainability. ▶Developed custom macros to standardize logic and reduce code duplication and snapshots to manage slow-changing dimensions ✅ Technical Expertise: ▶ Languages & Platforms: Python, SQL; Microsoft Azure, Visual Code Studio, Jupyter Notebook, DBreaver, Docker ▶ Databases and Tools: Oracle, Postgre SQL, MySQL, ClickHouse ▶ Big Data Technologies: Apache Kafka, Airbyte, PySpark, dbt, Apache Airflow, Databricks ▶ Data Visualization: Tableau, Power BI, Metabase, Superset ▶ Microsoft: Advance Excel ▶ Soft Skills: Stakeholder Management, Time Management, Work Prioritization, Leadership ✅ Areas of Expertise : ▶ Data Architecture & Pipeline Engineering Proficient in designing and implementing real-time data pipelines, including CDC- enabled architectures, with a strong focus on scalable ETL/ELT processes and robust data modeling within modern data warehouse frameworks such as Medallion Architecture ▶Advanced SQL & Data Transformation Complex transformation logic using SQL, dbt, and custom macros to standardize logic across models ▶ Dashboard & Report Automation Create interactive dashboards in Tableau, Metabase, and Power BI supporting business units from sales to operations. ▶ FinTech Transaction analysis Customer analysis - Customer Lifetime Management, Campaign Analysis, Customer Cohort Development, Churn & Retention Analysis ▶ Inventory & Supply Chain Analytics Demand planning, Replenishment Model, Out of Stock analysis & Lost Sales, Safety Stock, Inventory Aging, Turnover, Product segmentation Industries I have worked for: FMCG, E-Commerce, FinTech(Mobile Financial Service)

🇧🇩Dhaka, Bangladesh$8/hr100% JSS5.00 (3)Since Apr 2023

Earnings and projects

MRR
$0

Last 6 months ÷ 6

World#390,943 / 412k
🇧🇩Country#14,080 / 15.0k
Revenue, last 30 days
$0
Total earnings
$1k

Billed in all: $1.1k

World#390,943 / 412k
🇧🇩Country#14,080 / 15.0k
Per project
$261
Projects, last 6 months
0
World#209,850 / 412k
🇧🇩Country#8,489 / 15.0k
Projects in all
4

Across 5 contracts

40% fixed60% hourly
World#283,741 / 412k
🇧🇩Country#13,409 / 15.0k

Earnings, last 30 days

$1.1kNothing earned in the last 30 daysBilled in all, before Upwork's fee · drag across the chart to see what was earned in any stretch
$1,100$1,120$1,140$1,160Oct 8Oct 23Nov 7

Skills