Arose N.

Data Engineer | Python ETL ADF SQL | Databricks & Snowflake | NetSuite

As a 𝟔𝐱 𝐂𝐞𝐫𝐭𝐢𝐟𝐢𝐞𝐝 𝐒𝐞𝐧𝐢𝐨𝐫 𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫 with 𝟔+ 𝐲𝐞𝐚𝐫𝐬 𝐨𝐟 𝐞𝐱𝐩𝐞𝐫𝐢𝐞𝐧𝐜𝐞, I specialize in architecting robust ETL/ELT pipelines across 𝐀𝐳𝐮𝐫𝐞, 𝐀𝐖𝐒, and 𝐆𝐂𝐏. Whether you need to untangle messy API data with custom code or process millions of rows using enterprise cloud tools, I build systems that don’t break in production. I bring deep expertise in both approaches to data engineering: ⚙️ 𝐂𝐮𝐬𝐭𝐨𝐦 𝐏𝐲𝐭𝐡𝐨𝐧 & 𝐀𝐏𝐈 𝐏𝐢𝐩𝐞𝐥𝐢𝐧𝐞𝐬: I bridge the gap between complex SaaS platforms (NetSuite, Shopify, HubSpot, Toast POS) and modern Data Warehouses. When standard connectors fail, I build custom Python logic handling pagination, OAuth, and complex transformations, backed by automated error handling and real-time observability. ☁️ 𝐄𝐧𝐭𝐞𝐫𝐩𝐫𝐢𝐬𝐞 𝐂𝐥𝐨𝐮𝐝 𝐄𝐓𝐋 & 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚: I design, build, and maintain cloud-scale data architectures using 𝐀𝐳𝐮𝐫𝐞 𝐃𝐚𝐭𝐚 𝐅𝐚𝐜𝐭𝐨𝐫𝐲 (𝐀𝐃𝐅), 𝐃𝐚𝐭𝐚𝐛𝐫𝐢𝐜𝐤𝐬 (𝐏𝐲𝐒𝐩𝐚𝐫𝐤), 𝐀𝐖𝐒 𝐆𝐥𝐮𝐞, 𝐚𝐧𝐝 𝐁𝐢𝐠𝐐𝐮𝐞𝐫𝐲. I expertly manage full-refresh and incremental loads (CDC/SCD Type 2) to support scalable, high-volume batch data processing. I specialize in stable data logic, ensuring you never have to guess if your numbers are accurate. 📊 Delivered ETL pipelines syncing millions of records daily 💡 Powered reporting and KPI dashboards tied to real business outcomes 🚀 Built the data backend for SaaS platforms serving 100K+ users 💎 Signature Projects (Case Studies) 🚀 𝐄-𝐂𝐨𝐦𝐦𝐞𝐫𝐜𝐞 & 𝐂𝐥𝐨𝐮𝐝 𝐒𝐞𝐜𝐮𝐫𝐢𝐭𝐲 𝐏𝐥𝐚𝐭𝐟𝐨𝐫𝐦 (𝐏𝐢𝐧𝐤 𝐂𝐡𝐢𝐜𝐤𝐞𝐧) Challenge: High-volume inventory and financial data was heavily fragmented between Shopify and an ERP. Solution: Architected a secure Azure Data Factory (ADF) pipeline leveraging Shopify GraphQL and Azure Key Vault. Outcome: Achieved 100% data consistency via automated dual-syncs, secured inside a Managed Virtual Network. 🏦 𝐅𝐢𝐧𝐚𝐧𝐜𝐢𝐚𝐥 𝐃𝐚𝐭𝐚 𝐖𝐚𝐫𝐞𝐡𝐨𝐮𝐬𝐞 (𝐀𝐩𝐞𝐱 𝐇𝐞𝐚𝐥𝐭𝐡 𝐂𝐚𝐫𝐞) Challenge: Critical financial data was locked inside NetSuite, requiring manual, error-prone extraction for reporting. Solution: Built a Python/SQLAlchemy pipeline extracting data via SuiteQL into PostgreSQL and AWS S3 (Athena). Outcome: Eliminated manual reporting by automating daily financial KPI dashboards in Tableau. 🏛️ 𝐏𝐫𝐨𝐝𝐮𝐜𝐭𝐢𝐨𝐧-𝐆𝐫𝐚𝐝𝐞 𝐅𝐥𝐞𝐞𝐭 𝐌𝐚𝐢𝐧𝐭𝐞𝐧𝐚𝐧𝐜𝐞 𝐏𝐢𝐩𝐞𝐥𝐢𝐧𝐞 (𝐍𝐘𝐂𝐓) Challenge: Safely syncing mission-critical transit data from legacy SQL databases to modern APIs without stressing production servers. Solution: Engineered a 10-step Python ETL workflow utilizing custom Change Data Capture (CDC) for incremental updates. Outcome: Prevented silent failures by implementing automated data governance and a real-time Flask observability dashboard. 🛠 Technical Arsenal 🔹 𝐂𝐥𝐨𝐮𝐝 𝐃𝐚𝐭𝐚 𝐏𝐥𝐚𝐭𝐟𝐨𝐫𝐦𝐬 & 𝐖𝐚𝐫𝐞𝐡𝐨𝐮𝐬𝐢𝐧𝐠 Warehousing: Snowflake, Azure Synapse Analytics, Amazon Redshift, Google BigQuery. Processing & Big Data: Databricks (PySpark), AWS Glue, Spark SQL. Cloud Infrastructure: Microsoft Azure (ADF, Functions, Blob, Key Vault), AWS (Lambda, S3, Athena). Orchestration & DevOps: dbt, Docker, Kubernetes, PM2, Cron. 🔹 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞𝐬, 𝐃𝐚𝐭𝐚𝐛𝐚𝐬𝐞𝐬 & 𝐌𝐨𝐝𝐞𝐥𝐢𝐧𝐠 Languages: Python (Pandas, SQLAlchemy, PyODBC, Boto3 - Expert Level). SQL: T-SQL, PL/pgSQL, Snowflake SQL, SuiteQL (NetSuite). Databases: PostgreSQL, MySQL, Azure SQL, Amazon RDS. Modeling: Star Schema, Dimensional Modeling, SCD Type 2, Entity Resolution. 🔹 𝐍𝐢𝐜𝐡𝐞 𝐈𝐧𝐭𝐞𝐠𝐫𝐚𝐭𝐢𝐨𝐧𝐬 & 𝐀𝐏𝐈𝐬 ERPs: NetSuite (SuiteTalk/SuiteQL), ApparelMagic. Commerce: Shopify (REST/GraphQL), Toast POS, Stripe. CRM: HubSpot, Salesforce, WordPress (MySQL). 📜 Certifications ✅ AWS Certified Solutions Architect – Professional ✅ AWS Certified Data Engineer – Associate ✅ Azure Data Engineer Associate (DP-203) ✅ Azure Database Administrator (DP-300) ✅ Databricks Certified Data Engineer – Professional 🏆 Why Clients Hire Me: • 𝐏𝐫𝐨𝐝𝐮𝐜𝐭𝐢𝐨𝐧-𝐆𝐫𝐚𝐝𝐞 𝐑𝐞𝐥𝐢𝐚𝐛𝐢𝐥𝐢𝐭𝐲: I build self-healing ETL pipelines handling millions of records daily, backed by automated alerting so metrics never break silently. • 𝐂𝐨𝐦𝐩𝐥𝐞𝐱 𝐀𝐏𝐈 𝐈𝐧𝐭𝐞𝐠𝐫𝐚𝐭𝐢𝐨𝐧: When drag-and-drop fails, I write custom Python (OAuth, pagination, CDC) for difficult systems like NetSuite, Shopify GraphQL, and legacy SQL. • 𝐅𝐚𝐬𝐭𝐞𝐫 𝐓𝐢𝐦𝐞 𝐭𝐨 𝐈𝐧𝐬𝐢𝐠𝐡𝐭𝐬: I don't stop at the database. I deliver clean, analytics-ready data directly to Power BI/Tableau, or build full-stack internal tools (React/Node). • 𝐓𝐫𝐮𝐬𝐭𝐞𝐝 𝐏𝐚𝐫𝐭𝐧𝐞𝐫 (𝟗𝟎%+ 𝐑𝐞𝐩𝐞𝐚𝐭 𝐂𝐥𝐢𝐞𝐧𝐭𝐬): I optimize cloud infrastructure to reduce costs, eliminate manual reporting, and provide long-term data platform ownership. Your data should drive business decisions, not create technical bottlenecks. Let’s connect to design a scalable, automated data architecture for your next phase of growth. [Invite Me to Job]