Josh Y.
Power BI | Fabric | ETL Developer | Databricks | AI Annotation
Struggling with legacy systems, data chaos, high Azure costs, or risky migrations? With 15+ years of experience and a 50-engineer team, I deliver proven medallion architecture, optimized data warehouses, seamless migrations, and a single source of truth to cut costs and drive clarity. Advanced T-SQL | DAX | Fabric Medallion | ADF, SSIS, config-driven meta data ETL Pipeline | Python | PySpark | Databricks (DLT, Lakeflow) | AWS Glue | Lambda | SharePoint | DOMO, Tableau to Power BI | Azure AI Foundry | Azure AI Search (RAG) | Azure Functions | Fabric Data Agent About Me I'm a senior Azure Data Architect and Microsoft Fabric expert helping organizations build, optimize, and modernize their cloud data infrastructure. From Fortune 500 companies to agile startups, I design scalable systems that simplify analytics, streamline pipelines, and unlock real business insights. I also build AI-powered agents and copilots that let business users query governed data in plain language, backed by retrieval-augmented generation and deterministic, auditable logic. As Co-Founder of a Microsoft Partner firm and a proud U.S. citizen, I offer enterprise-level expertise without the overhead. You'll work directly with the architect who's led successful projects for Microsoft, CVS, Toyota, LinkedIn, Wells Fargo, Otsuka Pharmaceutical, DHS, United Health Group, Coca-Cola, UBS, Capgemini, and multiple large law firms — no middle layers, just results. Skills & Expertise - Cloud: Azure, AWS - Data Engineering: ADF, SSIS, Databricks, ETL Pipelines - Analytics & BI: Power BI, DAX, Tableau, DOMO, SQL - Data Warehousing: Azure Synapse, SQL Server, Snowflake, Fabric Lakehouse, Teradata - Automation & AI: Azure OpenAI, Power Automate, FastAPI, Python - AI Agents & RAG: Microsoft Foundry (Prompt Agents), Azure AI Search RAG, Fabric Data Agent, GPT-4o orchestration, NetworkX concept-graph routing - Serverless: Azure Functions (Python) for governed query tools, OpenAPI 3.0 tool registration - Modeling: Fact/Dim design, SQL optimization, Delta Live Tables, Delta MERGE - Migration: SAP ECC/HANA, JDE Oracle, Teradata/MicroStrategy, Epic EHR, DOMO/Cognos to Power BI, on-prem to cloud - Business Systems: Salesforce, Sage ERP, Yardi, Entrata, Kinaxis (Maestro), Redshift - DevOps: Azure DevOps, Git (DEV/TEST/PROD), Kubernetes, Terraform, Container Registry, Azure CLI, Entra ID SSO - Security: Managed Identity/RBAC, row-level security, masked-sandbox promotion - QA: pytest regression testing for SQL correctness and routing logic Selected Client Engagements - Manufacturing: Avoided a costly SAP ECC/HANA upgrade by modernizing directly onto Microsoft Fabric — replaced fragmented SAP/Salesforce/SharePoint reporting with Medallion architecture and Direct Lake analytics. - Insurance / Home Care: Migrated Domo/Tableau to Power BI on Fabric — rebuilt semantic models and refresh schedules, adding Copilot/AI analytics inside Teams and SharePoint. - Manufacturing: Migrated JD Edwards (JDE) Oracle reporting into a Fabric Lakehouse with Copilot-assisted SQL transformation — cut IT dependency with self-service, AI-driven insights. - Healthcare / Academic Medical Center: Unified Epic EHR and on-prem Oracle sources into one Fabric Lakehouse — consolidated fragmented clinical/operational reporting. - Real Estate Investment & Asset Management: Consolidated 12+ management companies' property, treasury, and document systems (Yardi, Entrata, JPMorgan, Chatham Financial) into one governed Fabric lakehouse — cut new-entity onboarding from weeks to hours. - Healthcare / Consumer Health Manufacturing: Integrated Kinaxis (Maestro) planning data with ERP/JDE execution data on Fabric, adding a RAG-grounded AI agent for natural-language Q&A — replaced manual root-cause analysis. Why Work With Me - Direct-sourcing model: $250/hr value for $85/hr - 100% in-house team of 50+ top problem solver engineers — no juniors, no outsourcing - Proven track record: delivering enterprise data platforms 10X faster than competitors - Direct relationship with Microsoft funding teams — helping clients tap into available funds to offset implementation costs - Ability to optimize Azure costs down by up to 83%, driving long-term savings - Building enterprise-grade AI agents with RAG, governed deterministic tools, and full auditability — not just prototypes - Hands-on leadership: I code, lead execution, own quality control and delivery - Honest, trustworthy, and committed to 100% job delivery Keywords: Azure data architect, Microsoft Fabric expert, Data Engineering, ADF pipeline developer, Power BI specialist, Databricks developer, ETL automation, SQL warehouse architect, Azure AI Search RAG, Fabric Data Agent, GPT-4o integration, Generative AI developer, LLM orchestration, AI agent architect, API Integration, Apache Spark developer, Snowflake integration, C# developer, SAP to Fabric migration, JDE migration, Epic EHR integration, Kinaxis integration, Salesforce Redshift, Sage ERP, Yardi Entrata
Earnings and projects
Last 6 months ÷ 6
Last 6 months: $16k
Billed in all: $356,461$356k
$8k in the last 6 months
Across 5 contracts
Across 55 contracts
Earnings, last 30 days
Skill rankings: Top 4% in Data Analysis
Ranked by MRR among everyone on Upwork with the skill.
- #10Azure DevOps Server108 freelancers · 🇺🇸 #4Top 9%🇺🇸#4 of 12
- #23PySpark460 freelancers · 🇺🇸 #4Top 5%🇺🇸#4 of 49
- #24Amazon Redshift215 freelancers · 🇺🇸 #5Top 11%🇺🇸#5 of 42
- #34Databricks Platform460 freelancers · 🇺🇸 #7Top 7%🇺🇸#7 of 71
- #37SQL Server Integration Services448 freelancers · 🇺🇸 #12Top 8%🇺🇸#12 of 90
- #43Microsoft Power BI Development600 freelancers · 🇺🇸 #16Top 7%🇺🇸#16 of 95
- #46Microsoft Azure SQL Database550 freelancers · 🇺🇸 #10Top 8%🇺🇸#10 of 93
- #90Microsoft PowerApps939 freelancers · 🇺🇸 #23Top 10%🇺🇸#23 of 164