Waqar A.
Senior Data Engineer | Airbyte, BigQuery, Python, APIs & ETL/ELT
I design and build scalable, production-grade data engineering systems that turn fragmented, unreliable data into clean, automated, analytics-ready pipelines in Google BigQuery and modern cloud warehouses. If your business depends on data from CRMs, APIs, marketing platforms, or databases — and it’s inconsistent, delayed, duplicated, or breaking — I help you transform it into a reliable, real-time, decision-ready data system. With 12+ years of software engineering experience, I specialize in solving complex, real-world data problems that most engineers struggle with: API rate limits, pagination, authentication failures, schema drift, incremental sync logic, CDC pipelines, large-scale dataset processing, and production pipeline reliability. I don’t just build pipelines — I build data infrastructure that businesses can trust. WHAT I DELIVER * End-to-end ETL/ELT pipelines using Airbyte, Python, SQL, and Google Cloud * Reliable integrations between CRMs, APIs, databases, and webhook systems * Fixing and stabilizing broken or unreliable Airbyte pipelines * Custom API integrations and Airbyte connectors for unsupported systems * Scalable BigQuery data warehouse design and architecture * Incremental syncs, CDC pipelines, and near real-time data flows * High-performance SQL optimization and BigQuery cost reduction * Clean transformation layers using Dataform (SQL-based modeling) * Fully automated pipelines using Airflow, Cloud Functions, Pub/Sub * Data validation, monitoring, logging, and pipeline observability * BI-ready datasets for Looker Studio and analytics dashboards TECHNOLOGIES & PLATFORMS Airbyte, Airflow, Dataform, Python, SQL, Google BigQuery, Google Cloud Platform, Docker, Kubernetes, Linux, CI/CD pipelines, REST APIs, OAuth2, webhooks, MySQL, MariaDB, PostgreSQL, and modern data stack tools. I have deep experience integrating systems like: GoHighLevel, CallRail, WhatConverts, NICE CXone, and custom enterprise APIs. WHY CLIENTS HIRE ME * I solve end-to-end data problems, not isolated tasks * I design systems for scalability, reliability, and long-term maintainability * I can stabilize and improve existing pipelines without full rebuilds * I specialize in debugging complex production data failures * I think in terms of business impact, cost, and data reliability — not just code * I communicate clearly and make complex systems easy to understand IDEAL PROJECTS * Airbyte implementation and optimization * BigQuery data warehouse architecture * API-to-warehouse integrations * Broken pipeline debugging and recovery * Dataform transformation layer setup * Real-time or near real-time data pipelines * Data engineering system design and scaling If you’re dealing with messy data, broken pipelines, or unreliable reporting, I can help you design a system that is simple, scalable, and production-ready. Send me your data sources and current challenges — I’ll map out the most efficient and reliable architecture for your use case.
Earnings and projects
Last 6 months ÷ 6
Last 6 months: $168
Billed in all: $11,225$11k
$168 in the last 6 months
Across 12 contracts
Earnings, last 30 days
Skill rankings: Top 27% in pandas
Ranked by MRR among everyone on Upwork with the skill.
- #26Statistical Infographic57 freelancers · 🇵🇰 #6Top 46%🇵🇰#6 of 10
- #42Disaster Recovery109 freelancers · 🇵🇰 #5Top 39%🇵🇰#5 of 12
- #331Network Security902 freelancers · 🇵🇰 #59Top 37%🇵🇰#59 of 135
- #359pandas1,317 freelancers · 🇵🇰 #80Top 27%🇵🇰#80 of 199
- #389BigQuery908 freelancers · 🇵🇰 #60Top 43%🇵🇰#60 of 116
- #650Data Engineering1,602 freelancers · 🇵🇰 #131Top 41%🇵🇰#131 of 305
- #1,105Database3,249 freelancers · 🇵🇰 #158Top 34%🇵🇰#158 of 487
- #1,166Data Science3,842 freelancers · 🇵🇰 #259Top 30%🇵🇰#259 of 690