Skip to content
BackNov 7
Arose N.
Upwork badge

Arose N.

Data Engineer | Python ETL ADF SQL | Databricks & Snowflake | NetSuite

As a 𝟔𝐱 𝐂𝐞𝐫𝐭𝐢𝐟𝐢𝐞𝐝 𝐒𝐞𝐧𝐢𝐨𝐫 𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫 with 𝟔+ 𝐲𝐞𝐚𝐫𝐬 𝐨𝐟 𝐞𝐱𝐩𝐞𝐫𝐢𝐞𝐧𝐜𝐞, I specialize in architecting robust ETL/ELT pipelines across 𝐀𝐳𝐮𝐫𝐞, 𝐀𝐖𝐒, and 𝐆𝐂𝐏. Whether you need to untangle messy API data with custom code or process millions of rows using enterprise cloud tools, I build systems that don’t break in production. I bring deep expertise in both approaches to data engineering: ⚙️ 𝐂𝐮𝐬𝐭𝐨𝐦 𝐏𝐲𝐭𝐡𝐨𝐧 & 𝐀𝐏𝐈 𝐏𝐢𝐩𝐞𝐥𝐢𝐧𝐞𝐬: I bridge the gap between complex SaaS platforms (NetSuite, Shopify, HubSpot, Toast POS) and modern Data Warehouses. When standard connectors fail, I build custom Python logic handling pagination, OAuth, and complex transformations, backed by automated error handling and real-time observability. ☁️ 𝐄𝐧𝐭𝐞𝐫𝐩𝐫𝐢𝐬𝐞 𝐂𝐥𝐨𝐮𝐝 𝐄𝐓𝐋 & 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚: I design, build, and maintain cloud-scale data architectures using 𝐀𝐳𝐮𝐫𝐞 𝐃𝐚𝐭𝐚 𝐅𝐚𝐜𝐭𝐨𝐫𝐲 (𝐀𝐃𝐅), 𝐃𝐚𝐭𝐚𝐛𝐫𝐢𝐜𝐤𝐬 (𝐏𝐲𝐒𝐩𝐚𝐫𝐤), 𝐀𝐖𝐒 𝐆𝐥𝐮𝐞, 𝐚𝐧𝐝 𝐁𝐢𝐠𝐐𝐮𝐞𝐫𝐲. I expertly manage full-refresh and incremental loads (CDC/SCD Type 2) to support scalable, high-volume batch data processing. I specialize in stable data logic, ensuring you never have to guess if your numbers are accurate. 📊 Delivered ETL pipelines syncing millions of records daily 💡 Powered reporting and KPI dashboards tied to real business outcomes 🚀 Built the data backend for SaaS platforms serving 100K+ users 💎 Signature Projects (Case Studies) 🚀 𝐄-𝐂𝐨𝐦𝐦𝐞𝐫𝐜𝐞 & 𝐂𝐥𝐨𝐮𝐝 𝐒𝐞𝐜𝐮𝐫𝐢𝐭𝐲 𝐏𝐥𝐚𝐭𝐟𝐨𝐫𝐦 (𝐏𝐢𝐧𝐤 𝐂𝐡𝐢𝐜𝐤𝐞𝐧) Challenge: High-volume inventory and financial data was heavily fragmented between Shopify and an ERP. Solution: Architected a secure Azure Data Factory (ADF) pipeline leveraging Shopify GraphQL and Azure Key Vault. Outcome: Achieved 100% data consistency via automated dual-syncs, secured inside a Managed Virtual Network. 🏦 𝐅𝐢𝐧𝐚𝐧𝐜𝐢𝐚𝐥 𝐃𝐚𝐭𝐚 𝐖𝐚𝐫𝐞𝐡𝐨𝐮𝐬𝐞 (𝐀𝐩𝐞𝐱 𝐇𝐞𝐚𝐥𝐭𝐡 𝐂𝐚𝐫𝐞) Challenge: Critical financial data was locked inside NetSuite, requiring manual, error-prone extraction for reporting. Solution: Built a Python/SQLAlchemy pipeline extracting data via SuiteQL into PostgreSQL and AWS S3 (Athena). Outcome: Eliminated manual reporting by automating daily financial KPI dashboards in Tableau. 🏛️ 𝐏𝐫𝐨𝐝𝐮𝐜𝐭𝐢𝐨𝐧-𝐆𝐫𝐚𝐝𝐞 𝐅𝐥𝐞𝐞𝐭 𝐌𝐚𝐢𝐧𝐭𝐞𝐧𝐚𝐧𝐜𝐞 𝐏𝐢𝐩𝐞𝐥𝐢𝐧𝐞 (𝐍𝐘𝐂𝐓) Challenge: Safely syncing mission-critical transit data from legacy SQL databases to modern APIs without stressing production servers. Solution: Engineered a 10-step Python ETL workflow utilizing custom Change Data Capture (CDC) for incremental updates. Outcome: Prevented silent failures by implementing automated data governance and a real-time Flask observability dashboard. 🛠 Technical Arsenal 🔹 𝐂𝐥𝐨𝐮𝐝 𝐃𝐚𝐭𝐚 𝐏𝐥𝐚𝐭𝐟𝐨𝐫𝐦𝐬 & 𝐖𝐚𝐫𝐞𝐡𝐨𝐮𝐬𝐢𝐧𝐠 Warehousing: Snowflake, Azure Synapse Analytics, Amazon Redshift, Google BigQuery. Processing & Big Data: Databricks (PySpark), AWS Glue, Spark SQL. Cloud Infrastructure: Microsoft Azure (ADF, Functions, Blob, Key Vault), AWS (Lambda, S3, Athena). Orchestration & DevOps: dbt, Docker, Kubernetes, PM2, Cron. 🔹 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞𝐬, 𝐃𝐚𝐭𝐚𝐛𝐚𝐬𝐞𝐬 & 𝐌𝐨𝐝𝐞𝐥𝐢𝐧𝐠 Languages: Python (Pandas, SQLAlchemy, PyODBC, Boto3 - Expert Level). SQL: T-SQL, PL/pgSQL, Snowflake SQL, SuiteQL (NetSuite). Databases: PostgreSQL, MySQL, Azure SQL, Amazon RDS. Modeling: Star Schema, Dimensional Modeling, SCD Type 2, Entity Resolution. 🔹 𝐍𝐢𝐜𝐡𝐞 𝐈𝐧𝐭𝐞𝐠𝐫𝐚𝐭𝐢𝐨𝐧𝐬 & 𝐀𝐏𝐈𝐬 ERPs: NetSuite (SuiteTalk/SuiteQL), ApparelMagic. Commerce: Shopify (REST/GraphQL), Toast POS, Stripe. CRM: HubSpot, Salesforce, WordPress (MySQL). 📜 Certifications ✅ AWS Certified Solutions Architect – Professional ✅ AWS Certified Data Engineer – Associate ✅ Azure Data Engineer Associate (DP-203) ✅ Azure Database Administrator (DP-300) ✅ Databricks Certified Data Engineer – Professional 🏆 Why Clients Hire Me: • 𝐏𝐫𝐨𝐝𝐮𝐜𝐭𝐢𝐨𝐧-𝐆𝐫𝐚𝐝𝐞 𝐑𝐞𝐥𝐢𝐚𝐛𝐢𝐥𝐢𝐭𝐲: I build self-healing ETL pipelines handling millions of records daily, backed by automated alerting so metrics never break silently. • 𝐂𝐨𝐦𝐩𝐥𝐞𝐱 𝐀𝐏𝐈 𝐈𝐧𝐭𝐞𝐠𝐫𝐚𝐭𝐢𝐨𝐧: When drag-and-drop fails, I write custom Python (OAuth, pagination, CDC) for difficult systems like NetSuite, Shopify GraphQL, and legacy SQL. • 𝐅𝐚𝐬𝐭𝐞𝐫 𝐓𝐢𝐦𝐞 𝐭𝐨 𝐈𝐧𝐬𝐢𝐠𝐡𝐭𝐬: I don't stop at the database. I deliver clean, analytics-ready data directly to Power BI/Tableau, or build full-stack internal tools (React/Node). • 𝐓𝐫𝐮𝐬𝐭𝐞𝐝 𝐏𝐚𝐫𝐭𝐧𝐞𝐫 (𝟗𝟎%+ 𝐑𝐞𝐩𝐞𝐚𝐭 𝐂𝐥𝐢𝐞𝐧𝐭𝐬): I optimize cloud infrastructure to reduce costs, eliminate manual reporting, and provide long-term data platform ownership. Your data should drive business decisions, not create technical bottlenecks. Let’s connect to design a scalable, automated data architecture for your next phase of growth. [Invite Me to Job]

🇵🇰Lahore, Pakistan$45/hr100% JSS5.00 (9)Since Oct 2021
GlobeUpwork

Earnings and projects

MRR
$15k

Last 6 months ÷ 6

World#442 / 412k
🇵🇰Country#31 / 52.9k
Revenue, last 30 days
$14k

Last 6 months: $92k

World#698 / 412k
🇵🇰Country#57 / 52.9k
Total earnings
$233k

Billed in all: $244k

World#11,988 / 412k
🇵🇰Country#822 / 52.9k
Per project
$17k

$23k in the last 6 months

World#7,932 / 412k
🇵🇰Country#329 / 52.9k
Projects, last 6 months
4
25% fixed75% hourly
World#51,813 / 412k
🇵🇰Country#10,787 / 52.9k
Projects in all
14

Across 15 contracts

53% fixed47% hourly
World#168,283 / 412k
🇵🇰Country#27,914 / 52.9k

Earnings, last 30 days

$244k+$13.9k earned in the last 30 daysBilled in all, before Upwork's fee · drag across the chart to see what was earned in any stretch
$230k$240k$250kOct 8Oct 23Nov 7

Skill rankings: #1 in 2 skills of 20

Rarest: top 0.08% in REST API, of 5,062. Ranked by MRR among everyone on Upwork with the skill.

  1. 1Data Processing1,172 freelancers · 🇵🇰 #1Top 0.09%
  2. 1Data Lake186 freelancers · 🇵🇰 #1Top 0.54%
  3. 3Microsoft Azure SQL Database550 freelancers · 🇵🇰 #1Top 0.55%
  4. 3Databricks Platform460 freelancers · 🇵🇰 #1Top 0.65%
  5. 3Data Warehousing & ETL Software379 freelancers · 🇵🇰 #1Top 0.79%
  6. #4REST API5,062 freelancers · 🇵🇰 #2Top 0.08%
  7. #4Database Architecture864 freelancers · 🇵🇰 #1Top 0.46%
  8. #4Data Warehousing494 freelancers · 🇵🇰 #1Top 0.81%