Skip to content
BackNov 7
Syed Mohammad Mehdi R.
Upwork badge

Syed Mohammad Mehdi R.

LEAD SDET | Automation Expert | Playwright, Scraping, BeautifulSoup

🔥Web Scraping & Automation Expert | Playwright, Selenium, Scrapy, BeautifulSoup | 5+ Years | 300+ Websites Data Scraped🔥 Looking for a reliable Web Scraping & Automation expert who can extract, clean, and deliver structured data from complex websites, even those protected by modern anti-bot systems? I’m Mehdi Abidi a Web Scraping & Automation Engineer with 5+ years of hands-on experience, specializing in Python-based data extraction, browser automation, and scalable scraping pipelines for businesses that rely on accurate, up-to-date data. I help clients turn raw, unstructured web data into clean, usable datasets—saving time, reducing manual work, and enabling better business decisions. ✅ Successfully Scraped Platforms I’ve delivered production-grade scrapers for high-profile, data-heavy platforms, including: Capterra.com – SaaS listings, reviews, ratings G2.com – Software comparisons, vendor data, user reviews Zillow – Property listings, pricing, location-based data Redfin – Real estate listings, market insights These projects involved dynamic content, pagination, location filters, session handling, and rate limits. 💼 What I Do Best Web Scraping (static & dynamic websites) Browser Automation (human-like interactions) Login-Required & Session-Based Scraping Large-Scale Data Extraction Lead Generation & Market Research Data Cleaning, Validation & Structuring Automation Scripts for Repetitive Web Tasks API Discovery & Integration (where available) 🛠️ Tools & Technologies Web Scraping & Automation Selenium, Playwright Scrapy, BeautifulSoup, Requests Programming & Performance Python, Asyncio Multithreading & Multiprocessing Data Processing Pandas, NumPy CSV, Excel, JSON Google Sheets & Drive APIs Backend & APIs REST APIs FastAPI, Flask Databases MySQL, PostgreSQL, MongoDB Deployment & Workflow Docker Git / GitHub 🛡️ Anti-Bot & Protection Handling (Ethical & Professional) I work with industry-standard techniques to handle protected websites responsibly, including: CAPTCHA handling, Cloudflare-protected sites, DataDome, Imperva, Akamai, Fastly, Incapsula, Sucuri, StackPath, Session & cookie management, IP & proxy rotation, Rate limiting & request throttling, (Always respecting website terms and project requirements.) ⭐ Why Clients Choose Me ✔ Clean, well-documented, reusable scraping code ✔ Scalable solutions built for long-term use ✔ Accurate, structured, business-ready data ✔ Clear communication & on-time delivery ✔ Real experience with complex, protected websites If you need web scraping, data extraction, or browser automation using Selenium, Scrapy, or BeautifulSoup, I’m ready to help you get accurate data, fast and reliably. 👉 Send me a message and let’s discuss your project.

🇵🇰Lahore Cantt, Pakistan$50/hr100% JSS4.40 (34)Since Jul 2018

Earnings and projects

MRR
$5.1k

Last 6 months ÷ 6

World#5,292 / 412k
🇵🇰Country#515 / 52.9k
Revenue, last 30 days
$4.9k

Last 6 months: $30k

World#5,836 / 412k
🇵🇰Country#600 / 52.9k
Total earnings
$66k

Billed in all: $69k

World#60,003 / 412k
🇵🇰Country#4,952 / 52.9k
Per project
$1.4k

$30k in the last 6 months

World#101,167 / 412k
🇵🇰Country#8,473 / 52.9k
Projects, last 6 months
1
0% fixed100% hourly
World#128,092 / 412k
🇵🇰Country#22,564 / 52.9k
Projects in all
48

Across 58 contracts

67% fixed33% hourly
World#63,651 / 412k
🇵🇰Country#9,991 / 52.9k

Earnings, last 30 days

$68.9k+$4.9k earned in the last 30 daysBilled in all, before Upwork's fee · drag across the chart to see what was earned in any stretch
$62.5k$65.0k$67.5k$70.0kOct 8Oct 23Nov 7

Skill rankings: Top 0.28% in Data Collection

Top 1% in 3 of 13 skills, ranked by MRR among everyone on Upwork with the skill.

  1. 3Python-Requests179 freelancers · 🇵🇰 #2Top 2%
  2. #10Data Collection3,620 freelancers · 🇵🇰 #2Top 0.28%
  3. #15Scrapy903 freelancers · 🇵🇰 #3Top 2%
  4. #17Web Crawling849 freelancers · 🇵🇰 #4Top 2%
  5. #36Google Apps Script1,318 freelancers · 🇵🇰 #4Top 3%
  6. #43Scripting2,145 freelancers · 🇵🇰 #5Top 2%
  7. #51Data Scraping8,783 freelancers · 🇵🇰 #9Top 0.58%
  8. #55Data Mining9,149 freelancers · 🇵🇰 #6Top 0.60%