Shuo Y.

Software Engineer | Large-scale Scraping | AI & Automation Expert

Build scalable scraping systems, data pipelines, automations & full-stack apps that actually work in production and handle real world complex cases What I’ve built: • Wine Auction Platform: 20+ websites scraping with millions of normalized data Matching engine based on defined rules with above 85% accuracy given wine industry is fragmented High performance data pipeline including scraping, cleaning, normalizing, matching and storging Admin Site using Next.js for management of auctions, lots, lwin matching, fx rates, etc • French Car Wordpress Website: Improve loading performance from 5 - 7s to 1 - 2s Rebuild website with existing UI Automation flow of tax calculator using external website calculator Integrate AI workflow to fill non-exist data • Google Search Scraping: Implement custom solution for google search scraping with above 80% success rate Apply proxy, fingerprint, header rotation strategies and retry logic • Buycrash Site Scraping: Bypass captcha & stong rate limit protected site Designed data discovery scraping flow that maximize the chance of finding data Schedule scraper to run daily, send results by email I can help you: • Turn your idea into a working MVP and scale it further • Audit and enhance your existing web applications: adding features, fixing bugs, and improving performance • Deploy frontend/backend/database systems on cloud platforms • Build custom web scrapers to extract structured data, clean it, and build end-to-end processing pipelines Why you should work with me: • I treat myself as a owner, not just an engineer, I will stands on customer perspective and highly engaged in perfect your project • I pay attention to real world edge cases and make sure the system don't break after 2 days • I scale without your constant babysitting My core tech stack includes: • AI: ChatGPT, Claude, Kimi, Gemini • Frontend: Next, React, HTML, Tailwind CSS • Backend: C#, .NET, Python, Flask, Express.js, Node.js, Javascript • Databases: MongoDB, DynamoDB, MySQL, PostgreSQL, SQLite • Cloud/DevOps: AWS, Vercel, Supabase, Firebase • Automation/Crawling: Scrapy, Selenium, Playwright, n8n, Cloudflare, Datadome • Others: Wordpress