Bruno P.

Databricks Certified Data Engineer Professional, focused on Databricks and Azure. I build and run the production data pipelines a business depends on every day, and make them faster, more reliable and easier to maintain. If your Databricks jobs are slow or fail at night, or your data is stuck in an ERP and spreadsheets, I can help. What I can do for you: • Lakehouse pipelines on Databricks: PySpark, Delta Lake, Bronze/Silver/Gold layers • Azure data platforms from scratch: Azure Data Factory, self-hosted integration runtime, Data Lake • Ingestion of ERP and on-premises data (SAP, Oracle, SQL Server) into the cloud • Orchestration and monitoring with Airflow and Azure, with alerts before users notice a failure • Troubleshooting and tuning of failing or slow Spark jobs • Transformations and data modeling with dbt and SQL What I'm working on now: • Keeping production Airflow and Databricks pipelines healthy for a global enterprise, with 100,000+ runs a day • Building an Azure data platform for a manufacturer: ERP → Data Factory → Parquet → dbt • Using AI agents to triage pipeline failures and find root causes faster Results: • Raised the platform success rate from 96% to 99% across 100,000+ daily runs (75% fewer failures), mainly by fixing cluster configurations and adding preventive actions • 40% less ETL processing time while data volume grew 3x Background: data engineer since 2022, at consulting firms (Accenture, Rox Partner) and in industry (Neoenergia, Continental). Databricks Certified Data Engineer Professional and Associate, Azure Fundamentals. Here on Upwork, I've worked as a Databricks engineer for a consulting partner, rated 5.0 for clear communication and reliability. How I work: based in Brazil (UTC-3), with good overlap with US and European business hours. Short written updates, documented code and no surprises on scope. Send me your stack and the problem you want to solve. I'll reply with a few questions and a first plan.