Bishal N.

I am a software developer with over 7+ years of experience working with various technologies, specializing in Python and JavaScript for web application development, web scraping, web automation, data engineering, and overall software development. I am expert in web scraping and data engineering with the good number experience as full stack developer as well. I would say I am problem solver. Here are my key skills Web Development: - Backend development with Python frameworks like Django, Flask, and FastAPI - Frontend development using React, Astro, Remix, and Next.js - Knowledge of REST API / GraphQL development and integration - Version control using Git and collaboration through GitHub/GitLab - Proficient in TypeScript for building scalable and maintainable web applications Web Scraping: - Expert in Scrapy framework, with extensive experience in small to large-scale projects - Proficient in Crawlee (Apify) and Playwright for building scalable and efficient web scraping solutions - Skilled in using Selenium/Playwright for automating web browsers and handling dynamic web pages - Experienced in parsing HTML and XML using Beautiful Soup and lxml libraries - Proficient in data extraction techniques, including XPath and CSS selectors, ensuring accurate and complete data extraction - Skilled in designing and implementing scalable and high-performance web scraping solutions using asynchronous programming techniques - Seamless integration of web scraping tools with web frameworks like Django, Flask FastAPI for efficient data flow and storage Data Engineering: - Experience in deploying projects on AWS, GCP, and NAS servers (Synology) - Proficient in containerization and orchestration technologies, such as Docker and Kubernetes - Database management and design using SQL (PostgreSQL, MySQL) and NoSQL (MongoDB) databases - Data processing and manipulation using Python libraries such as Pandas, NumPy, and SciPy - Data visualization using libraries like Matplotlib, Seaborn, and D3.js - Experience with data pipelines, ETL processes, and data warehousing - Familiarity with big data technologies like Apache Spark and Hadoop Other Skills and Frameworks: - Python - JavaScript - TypeScript - Scrapy - Crawlee (Apify) - Playwright - Selenium - Beautiful Soup - lxml - Django - Flask - FastAPI - React - Astro - Remix - Next.js - Node.js - PostgreSQL - MySQL - MongoDB - Pandas - NumPy - SciPy - Matplotlib - Seaborn - D3.js - Apache Spark - Hadoop - Docker - Kubernetes - AWS - GCP - Git - GitHub/GitLab - SnowFlake, Databricks Key Projects and Accomplishments: 1. E-commerce Data Aggregator: Developed a data aggregation platform using Scrapy, collecting product information from multiple e-commerce websites and integrating it with a Django-based application for analysis and visualization. 2. Real Estate Listing Scraper: Engineered a custom web scraping solution using Crawlee (Apify) and Playwright to scrape real estate listings from diverse sources, implementing data normalization techniques for consistency and usability in a Flask-powered application. 3. Competitor Price Monitoring Tool: Designed and implemented a Selenium-based solution for monitoring competitor prices across online retailers, utilizing dynamic scraping techniques to extract pricing information from JavaScript-rendered pages. I am passionate about leveraging my expertise in web scraping, data engineering, and web development to tackle complex data extraction challenges and deliver exceptional results. Let's collaborate to unlock the full potential of your data and drive your business forward.