Asad A.

I get data from websites that block everyone else, and deliver it into production data pipelines on Azure and Databricks. Recent results: - 3M+ products scraped from a DataDome-protected e-commerce site (Zoro, an industrial supplies store) in 2 weeks - 4.5M products loaded into a database in 2 weeks through an Azure Databricks ETL pipeline (PySpark, Data Lake) - 10M Glassdoor reviews scraped and analyzed - Every law section from US state law websites, crawled through deep multi-page hierarchies What I build: - Anti-bot scraping for protected sites: DataDome, Cloudflare, Akamai, TLS fingerprinting, proxy and session rotation - Large-scale crawlers (Scrapy, Playwright, Selenium) with retry tracking and failure recovery - ETL pipelines on Azure Databricks: PySpark transformations, Data Lake storage, scheduled jobs - Price, stock and catalog monitoring with historical tracking and alerts - Clean data delivered to PostgreSQL, MySQL, MongoDB, Data Lake, APIs (FastAPI), Excel or CSV How I work: 1. Analyze the target site's protection and choose the lightest method that works reliably 2. Build the scraper with monitoring, retries and logging so it never fails silently 3. Deliver the data where your team uses it, with documentation for easy maintenance 100% Job Success across 17 jobs. A recent client: "Skillfully bypassing bot detection on a tricky project. Highly recommend his expertise." Send me the website you're struggling with, and I'll tell you within a day how I'd approach it.