Shaista R.
Senior Data Engineer| Python,Snowflake, AWS | ETL, Looker, BigQuery
Most data pipelines don’t fail because of code. They fail because they weren't built for scale. With 8+ years of experience engineering data systems at companies like Microsoft and Coreweave, I help businesses move away from "brittle prototypes" to production-grade, scalable infrastructure. I don’t just move data; I build the "Source of Truth" that leadership and AI systems actually trust. 💬What I Solve for You: Productionizing AI Pipelines: Hardening Python prototypes into scalable RAG and LLM infrastructures (AWS/Azure). ➔Infrastructure-as-Code: Building automated, modular ETL/ELT pipelines that don't require daily manual fixes. ➔The "One-Source" Dashboard: Integrating messy data from APIs, SaaS (Shopify, HubSpot), and DBs into clean Snowflake/BigQuery layers. ➔Performance Recovery: Optimizing slow SQL queries and high-cost cloud warehouses to save you thousands in monthly spend. 🛠 Tech Stack: Languages: Python (FastAPI, Pandas, PySpark), SQL Cloud & Warehousing: AWS (Glue, Lambda, S3), Snowflake, BigQuery, Azure Orchestration: Airflow, dbt, GitHub Actions Data Ops: API Integrations, Vector DBs, Data Validation ✅ Why Me? 8+ Years Experience: I’ve seen what breaks at the enterprise level and how to prevent it in your startup. Speed over Perfection: I focus on shipping high-impact systems that drive revenue, not just technical documentation. Transparent Communication: You get regular updates and a partner who challenges requirements to find better solutions. Ready to clean up your data debt? 📩 Message me for a FREE 15-minute technical consultation. Let’s discuss your architecture and see if I’m the right fit for your system.
Earnings and projects
Last 6 months ÷ 6
Last 6 months: $3k
Billed in all: $3,421$3.4k
$502 in the last 6 months
Earnings, last 30 days
Skill rankings: Top 12% in Apache Spark
Ranked by MRR among everyone on Upwork with the skill.
- #19Data Model84 freelancers · 🇺🇸 #5Top 23%🇺🇸#5 of 19
- #57Apache Spark467 freelancers · 🇺🇸 #8Top 12%🇺🇸#8 of 51
- #75Data Warehousing & ETL Software379 freelancers · 🇺🇸 #11Top 20%🇺🇸#11 of 49
- #83Databricks Platform460 freelancers · 🇺🇸 #17Top 18%🇺🇸#17 of 71
- #91Apache Airflow491 freelancers · 🇺🇸 #8Top 19%🇺🇸#8 of 49
- #111Data Warehousing494 freelancers · 🇺🇸 #25Top 22%🇺🇸#25 of 74
- #149Snowflake621 freelancers · 🇺🇸 #38Top 24%🇺🇸#38 of 127
- #160Apache Kafka981 freelancers · 🇺🇸 #8Top 16%🇺🇸#8 of 58