Alan O.
Data Engineer | Fabric | AI | LLM | RAG | PySpark | Power BI | SQL
If your data is fragmented, your reports are slow, your APIs are difficult to manage, or your team is spending more time fixing pipelines than making decisions — that's exactly the kind of problem I solve. I work with organisations across Ireland and Europe to design and deliver production-ready data platforms on Microsoft Fabric — from raw source ingestion and API integration through to trusted, reporting-ready datasets, AI-enabled solutions, and executive dashboards. What I deliver: • End-to-end Microsoft Fabric solutions — Lakehouses, Warehouses, Medallion architecture (Bronze → Silver → Gold), Delta tables, notebooks, and automated pipelines • Python & PySpark data engineering — transformation, validation, enrichment, deduplication, automation, and large-scale data processing • REST API & webhook integrations — ingesting data from external platforms into Fabric, Dataverse, SQL, and downstream systems • Reusable API ingestion frameworks — central controller/orchestrator for multiple APIs, shared configuration, historical loads, incremental loads, watermarks, pagination, audit logging, validation, and error handling • Incremental ELT/ETL pipelines — watermarking, overlap handling, deduplication, audit tables, monitoring, and data-quality controls built in • Power BI solutions — semantic models, DAX measures, KPI dashboards, executive reporting, and self-service reporting layers • Dynamics 365 & Dataverse integrations — extraction, transformation, data loading, automation, and reporting models • LLM & RAG solutions — AI agents that retrieve relevant information from organisational data and documentation and use it as context for LLM-generated answers • Machine Learning & forecasting — regression, classification, clustering, and time-series forecasting using Python and Microsoft Fabric • DEV/UAT/PROD delivery — deployment pipelines, environment separation, access control, testing, governance, and Azure DevOps API architecture & automation I design integrations so that every new API does not require a completely new solution. I build reusable ingestion frameworks where multiple APIs can be managed through a common controller, with shared orchestration, configuration, watermarks, validation, logging, and monitoring. This makes it much easier to add new data sources, maintain existing integrations, and scale the platform over time. AI, LLM & RAG I also work with AI-enabled data solutions, including LLM and Retrieval-Augmented Generation (RAG) architectures. These solutions combine organisational data or documentation with retrieval, embeddings, vector search, and LLMs to provide context-aware answers while keeping the underlying data architecture controlled and traceable. Who I work with: Mid-size to enterprise organisations that need a senior engineer who can work independently, understand both the technical architecture and business requirement, communicate clearly, and deliver solutions that actually get used after handover — not just built and forgotten. 10+ years in data analytics and engineering. 100% Job Success on Upwork. 93 projects delivered. Available for both project-based and long-term contract engagements. Core technologies: Microsoft Fabric | Python | PySpark | SQL | Power BI | REST APIs | Webhooks | Dataverse | Dynamics 365 | Power Automate | Azure DevOps | ETL/ELT | Delta Lake | Machine Learning | LLM | RAG Let's talk about what you're building.