Noelia R.

I help companies turn complex, messy data into reliable, production-ready systems for analytics, reporting, and machine learning. I am a Senior Data Engineer and Cloud Engineer with over 8 years of experience building end-to-end data platforms, large-scale ETL pipelines, and cloud-native architectures on AWS and Azure. Most of my clients come to me when their pipelines are slow, expensive, fragile, or difficult to maintain. I design and rebuild data systems so they can run daily without breaking, handle growing volumes, and support real business decisions. I work across the full data lifecycle: ingestion, transformation, modeling, quality checks, and delivery. I build pipelines that pull data from APIs, databases, files, and event streams, transform it with Spark and SQL, and store it in data lakes and warehouses that power dashboards, analytics, and machine learning. I am AWS Certified and have built multiple production platforms using S3, Glue, EMR, Iceberg, Athena, Redshift, Lambda, IAM, and CloudFormation. I also have experience with Azure Data Factory, Databricks, and ADLS, as well as CI/CD tools such as Jenkins and GitHub Actions to keep data pipelines reliable and deployable. A strong part of my expertise is Spark and PySpark optimization. I regularly improve slow or unstable pipelines using techniques such as partitioning strategies, shuffle reduction, broadcast joins, caching, and breaking long DAGs with checkpoints. I have built highly optimized Spark pipelines processing millions of records daily in a stable and cost-efficient way. I have also implemented plug-and-play ETL frameworks that allow multiple teams to ingest and transform data from a shared repository, as well as data quality and ML monitoring using tools like Evidently to track drift and model performance. For business users and data science teams, I have delivered dashboards and reporting systems using Power BI and Amazon QuickSight. In addition to data engineering, I also have experience building web and mobile applications with React, which allows me to design data systems that integrate cleanly with real products and user interfaces. If you need someone who can not only write code but design, optimize, and operate serious data systems in production, I would be happy to help.