Skip to content
BackNov 7
Prabjyot S.
Upwork badge

Prabjyot S.

Senior Web Scraping | Data Extraction | Python | ETL | Data Engineer

I engineer AI systems, scraping pipelines, and automation workflows built for production - not demos that break the second a client touches them. I've architected data extraction systems that scraped 15,000+ websites using ML classification, built AI agents that handle end-to-end business operations via WhatsApp, and designed real-time competitive intelligence pipelines monitoring 50+ retailers daily. Clients come to me when they need systems that actually work at scale. WHAT I BUILD: AI Agents & LLM Systems Multi-agent orchestration, RAG with vector search, conversational AI, voice agents. I use LangChain, LangGraph, CrewAI, Claude, and OpenAI - but the tool doesn't matter. What matters is the system handles edge cases, logs failures, and doesn't hallucinate when it counts. Web Scraping & Data Pipelines Scrapy, Playwright, Selenium - with proxy rotation, anti-detection, CAPTCHA handling, and retry logic as standard. I've extracted structured data from 15,000+ sites in a single engagement and built real-time monitoring systems that have run uninterrupted for 12+ months. n8n & Workflow Automation Custom n8n workflows that connect your CRM, email, WhatsApp, Slack, and databases into a single automated pipeline. Error handling, fallback paths, human override, and cost control built in. No black boxes. No runaway automations. Python Backend & APIs FastAPI, PostgreSQL, Docker, async pipelines. Production-grade code with proper error handling, retries, observability, and documentation. WHO I WORK WITH: Founders building AI-powered products who need someone who's shipped before. Startups scaling from prototype to production with real users and real edge cases. Businesses drowning in manual data collection or repetitive workflows. Teams that tried building it themselves, hit a wall, and need someone to fix it. HOW I WORK: Scope Call (Free) - 30 min. I understand your problem, constraints, and timeline. I'll tell you honestly if I'm the right fit. Architecture Doc - Before writing code, I define what we're building, why, and how. You get a clear plan with milestones. Build in Sprints - 1-2 week cycles. Working software each sprint, not status updates. Deliver & Support - 30-day support included. Systems I build keep running months after handoff. ๐—ง๐—ผ๐—ฝ ๐—ฅ๐—ฎ๐˜๐—ฒ๐—ฑ ๐—ฃ๐—น๐˜‚๐˜€ ๐—ฆ๐—ฒ๐—ฟ๐˜ƒ๐—ถ๐—ฐ๐—ฒ๐˜€: - ๐—ช๐—ฒ๐—ฏ ๐—”๐˜‚๐˜๐—ผ๐—บ๐—ฎ๐˜๐—ถ๐—ผ๐—ป: Automate web tasks for efficiency - ๐—ช๐—ฒ๐—ฏ ๐—ฆ๐—ฐ๐—ฟ๐—ฎ๐—ฝ๐—ถ๐—ป๐—ด: Extract website data for analysis. - ๐——๐—ฎ๐˜๐—ฎ ๐—˜๐˜…๐˜๐—ฟ๐—ฎ๐—ฐ๐˜๐—ถ๐—ผ๐—ป: Extract specific info from all sources. - ๐—ช๐—ฒ๐—ฏ ๐—–๐—ฟ๐—ฎ๐˜„๐—น๐—ถ๐—ป๐—ด: Systematically explore the web to gather info. - ๐——๐—ฎ๐˜๐—ฎ ๐— ๐—ถ๐—ป๐—ถ๐—ป๐—ด: Analyze large datasets to extract patterns. - ๐—•๐—ผ๐˜ ๐——๐—ฒ๐˜ƒ๐—ฒ๐—น๐—ผ๐—ฝ๐—บ๐—ฒ๐—ป๐˜: Create bots for task automation. - ๐—˜-๐—ฐ๐—ผ๐—บ๐—บ๐—ฒ๐—ฟ๐—ฐ๐—ฒ ๐—”๐˜‚๐˜๐—ผ๐—บ๐—ฎ๐˜๐—ถ๐—ผ๐—ป: Automate processes for online shopping. - ๐—ฆ๐—ผ๐—ฐ๐—ถ๐—ฎ๐—น ๐— ๐—ฒ๐—ฑ๐—ถ๐—ฎ ๐—”๐˜‚๐˜๐—ผ๐—บ๐—ฎ๐˜๐—ถ๐—ผ๐—ป: Automate tasks on social media platforms. - ๐—”๐—ฃ๐—œ ๐—œ๐—ป๐˜๐—ฒ๐—ด๐—ฟ๐—ฎ๐˜๐—ถ๐—ผ๐—ป: Integrate software via APIs for data exchange. - ๐——๐—ฒ๐˜€๐—ธ๐˜๐—ผ๐—ฝ & ๐—ช๐—ฒ๐—ฏ ๐—”๐—ฝ๐—ฝ๐˜€: Develop apps for desktop or web environments. ๐— ๐˜† ๐—ง๐—ฒ๐—ฐ๐—ต๐—ป๐—ถ๐—ฐ๐—ฎ๐—น ๐˜€๐—ธ๐—ถ๐—น๐—น๐˜€: - ๐—Ÿ๐—ฎ๐—ป๐—ด๐˜‚๐—ฎ๐—ด๐—ฒ๐˜€: PYTHON, .NET CORE, C#, DOTNET, PHP, HTML, ROZOR, etc. - ๐—Ÿ๐—ถ๐—ฏ๐—ฟ๐—ฎ๐—ฟ๐—ถ๐—ฒ๐˜€: Selenium, Scrapy, Requests, Regex, BeautifulSoup, Pandas, etc. - ๐——๐—ฎ๐˜๐—ฎ๐—ฏ๐—ฎ๐˜€๐—ฒ๐˜€: MySQL, MS SQL, Postgre SQL, MS Excel, Google Sheets, etc. - ๐—•๐—ฎ๐—ฟ๐—ฟ๐—ถ๐—ฒ๐—ฟ๐˜€: ReCaptcha Bypassing, IP Rotation, Public/Private API Bypassing. - ๐—™๐—ฎ๐˜€๐˜๐—ฒ๐—ฟ ๐—ผ๐˜‚๐˜๐—ฝ๐˜‚๐˜: I have been writing my algorithms to make the process super fast - ๐—œ๐——๐—˜: VS Code, Visual Studio, PyCharm, WAMP, etc. - ๐—ข๐—ฝ๐—ฒ๐—ฟ๐—ฎ๐˜๐—ถ๐—ป๐—ด ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€: Windows, MAC, Linux(Ubuntu, Flora, Kali). ๐—œ ๐˜€๐—ฝ๐—ฒ๐—ฐ๐—ถ๐—ฎ๐—น๐—ถ๐˜‡๐—ฒ ๐—ถ๐—ป ๐˜€๐—ผ๐—น๐˜ƒ๐—ถ๐—ป๐—ด ๐—ฐ๐—ผ๐—บ๐—ฝ๐—น๐—ฒ๐˜… ๐˜๐—ฒ๐—ฐ๐—ต๐—ป๐—ถ๐—ฐ๐—ฎ๐—น ๐—ฐ๐—ต๐—ฎ๐—น๐—น๐—ฒ๐—ป๐—ด๐—ฒ๐˜€, ๐—ถ๐—ป๐—ฐ๐—น๐˜‚๐—ฑ๐—ถ๐—ป๐—ด: - Bypassing logins & authentication - Overcoming bot detection systems - Extracting & downloading images - Maintaining active sessions for seamless scraping - Cleaning & structuring messy datasets - Simulating human-like interactions & clicks - Managing RAM for large-scale data processing - Parsing & handling JSON data - Navigating intricate HTML & CSS structures - Optimizing performance for high-speed scraping One client who has hired me more than a dozen times put it this way: "If you're looking for someone for data work, just pick Prabjyot. Stop looking." If you have a project, whether it's a quick one-hour task or something ongoing, send me a message. I'm quick to respond and happy to look at a sample before you commit.

๐Ÿ‡ฎ๐Ÿ‡ณKhedbrahma, India$12/hr100% JSS4.87 (15)Since Apr 2019
GlobeUpwork

Skills

This freelancer has chosen to keep their earnings private.