Radwan F.
Web Scraping & Automation Engineer | Python Playwright
Looking for reliable, enterprise-grade data extraction pipelines that run uninterrupted? I build resilient Python web scrapers, reverse-engineer internal APIs, and deliver clean, production-ready data directly to your warehouse or application. Whether your scrapers are failing on dynamic Single-Page Applications (SPAs), suffering high failure rates, or consuming excessive proxy bandwidth, I engineer high-uptime extraction workflows built for scale and stability. Why Clients Hire Me (Proven Business Impact): Cost & Performance Optimization: Reduced server and proxy overhead by 75% for enterprise workflows by replacing heavy browser automation with reverse-engineered HTTP/JSON network pipelines and intelligent throttling. High-Volume Scale: Engineered distributed extraction systems processing over 10M+ daily requests using Apache Kafka, Redis, and ClickHouse. Reliable Extraction Architecture: Specialist in TLS/header session emulation, stealth Playwright browser automation, and distributed proxy rotation to navigate complex, JavaScript-heavy targets without service interruption. Apify Marketplace Experience: Apify Certified developer experienced in deploying, containerizing, and orchestrating cloud extraction Actors. Core Technical Stack: Scraping & Automation: Playwright, Scrapy, Selenium, BeautifulSoup, HTTP reverse-engineering, Session handling Backend & APIs: Python (FastAPI, Flask, Django), REST API integrations, JSON pipelines Data Storage & Pipelines: ClickHouse, PostgreSQL, BigQuery, Redis, Apache Kafka, AWS SQS Cloud & DevOps: Docker, AWS, Google Cloud Platform, Linux server administration My Deliverable Standards: Every project includes clean, modular code, comprehensive technical documentation, structured error logging, and post-delivery support to ensure seamless integration. To scope your extraction pipeline, send a message with: Target website URL(s) Specific data fields required Output preference (PostgreSQL, BigQuery, JSON API, or CSV)
Earnings and projects
Last 6 months ÷ 6
Last 6 months: $178
Billed in all: $10,522$11k
$89 in the last 6 months
Across 39 contracts
Earnings, last 30 days
Skill rankings: Top 26% in Apache Kafka
Ranked by MRR among everyone on Upwork with the skill.
- #34ClickHouse100 freelancers · 🇪🇬 #2Top 34%🇪🇬#2 of 2
- #202Browser Automation444 freelancers · 🇪🇬 #7Top 45%🇪🇬#7 of 18
- #218Beautiful Soup634 freelancers · 🇪🇬 #10Top 34%🇪🇬#10 of 28
- #256Apache Kafka981 freelancers · 🇪🇬 #5Top 26%🇪🇬#5 of 22
- #318Scrapy903 freelancers · 🇪🇬 #15Top 35%🇪🇬#15 of 37
- #496Redis1,774 freelancers · 🇪🇬 #14Top 28%🇪🇬#14 of 46
- #569ETL Pipeline1,396 freelancers · 🇪🇬 #16Top 41%🇪🇬#16 of 30
- #741Selenium2,249 freelancers · 🇪🇬 #24Top 33%🇪🇬#24 of 92