Roman K.

Python, Web Scraping, Data Science, Data Mining, Scrapy

Hello, my name is Roman. I'm a Python 🐍 developer with 7+ years of experience in web scraping and automation of different boring stuff. Also have 12+ years of experience in JAVA back-end development 𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲: 𝑾𝒆𝒃 𝒔𝒄𝒓𝒂𝒑𝒊𝒏𝒈 𝒂𝒖𝒕𝒐𝒎𝒂𝒕𝒊𝒐𝒏: ☑ web scraping, data mining, data extraction, data transformation, ☑ multiple browser automation (for example, with multilogin or similar tools) ☑ mobile app data scraping, and automation (uiautomator2) ☑ scraping info from websites into SQL-like DB (SQLite, MySQL, Postgres), NoSQL, or any other format (txt, CSV, EXCEL, JSON, etc). 𝑹𝒐𝒖𝒕𝒊𝒏𝒆 𝒂𝒖𝒕𝒐𝒎𝒂𝒕𝒊𝒐𝒏: ☑ automation of routine stuff, copy-paste, folder creation, etc. ☑ writing scripts and utilities, ☑ image/file downloading. ☑ File transformation. 🕷️𝐖𝐞𝐛 𝐬𝐜𝐫𝐚𝐩𝐢𝐧𝐠 𝐭𝐞𝐜𝐡𝐧𝐨𝐥𝐨𝐠𝐢𝐬: ☑ Selenium Webdriver - create an autotest, scraping information from different websites, creating a script for the automation login process (Amazon/Google, other websites) ☑ Scrapy - a gathering of information from a variety of websites like Amazon, Airbnb, etc (Python) ☑ Xpath - analysis and using XPath to navigate in an XML document/DOM ☑ Beautiful Soup + requests - collecting information from the given websites. 𝗦𝗸𝗶𝗹𝗹𝘀𝗲𝘁: ☑ Java – advances (new tools implementation, web applications creation, bug fixing, code review) ☑ JavaScript – basic (new script creation, support existing solution). ☑ Groovy – basic (creation of a simple CRUD web application using the Grails Framework). ☑ Python (knowledge: PyGame, Django, Scrapy, beautiful soup) ☑ Spring (Core, MVC, Security, JPA) – new application creation, support existing web applications. ☑ Oracle SQL – creating new scripts, supporting and tuning existing scripts. ☑ HTML + CSS – simple page creation/support existing Keywords: autotest development, web scraping, data mining, python, java, spring-boot, spring-wvc, beautiful soup, scrapy, XPath, Regexp, selenium, csv, Google Sheet, Airbnb, bs4, SQLite, bitbucket, scrapinghub/zyte, boto3, s3, DynamoDB, ETL, MySQL, Amazon review, Amazon inventory scraping, scrapyd, CSS selector, XPATH selector, olx, api, json, shopify scraping, Missive, Google API, WooCommerce-rest-api, spread, scripting. PostgreSQL, isort, black, oracle DB, bid-scraping, multilogin, gologin, dash.plotly, spring-jpa, Google Cloud, telegram bot, FastAPI