Abdul H.

*ABOUT ME* I am a Data Engineer and Data Automation Engineer with 6 years of professional experience designing scalable data pipelines, automating business processes, developing data integrations, and delivering reliable data solutions. My expertise includes Python, SQL, IBM DataStage, Power BI, Zapier, n8n, AWS, web scraping, and AI/RAG-based solutions. I specialize in transforming complex data processes into reliable, automated, and scalable workflows. My experience covers the complete data lifecycle, from data extraction and integration to transformation, validation, analytics, automation, and AI-powered data retrieval. WHAT I DO • Design, develop, and maintain ETL pipelines using IBM DataStage for full and incremental data processing. • Integrate and transform data from PostgreSQL, SQL Server, MySQL, APIs, flat files, and cloud platforms. • Build and maintain automated workflows using Zapier and n8n to connect business applications and eliminate repetitive manual processes. • Develop API-based integrations and data synchronization workflows between multiple systems and platforms. • Build data validation and quality frameworks to identify missing records, duplicates, inconsistencies, and processing issues. • Develop Python-based automation using Pandas, NumPy, Requests, BeautifulSoup, and Selenium. • Build web scraping solutions for collecting structured product, pricing, and business data. • Develop AI and RAG-based solutions involving document processing, PDF extraction, text chunking, embeddings, vector search, and LLM-powered retrieval. • Develop AWS-based data processing workflows using S3, Lambda, SQS, ECS/Fargate, DynamoDB, EventBridge, and Textract. • Create Power BI dashboards and reports to transform processed data into actionable business insights. TECHNICAL SKILLS Languages: Python, SQL ETL & Data Integration: IBM DataStage, SSIS, ETL Pipelines, Data Migration, Data Synchronization Automation: Zapier, n8n, Workflow Automation, API Integrations Databases: PostgreSQL, SQL Server, MySQL, DynamoDB Cloud & AWS: S3, Lambda, SQS, ECS/Fargate, DynamoDB, EventBridge, Textract AI & RAG: RAG, LLM Applications, Document Processing, PDF Extraction, Embeddings, Vector Search Analytics & Visualization: Power BI, Excel Python & Data: Pandas, NumPy, PySpark, Requests Web Scraping: BeautifulSoup, Selenium, Requests Version Control: Git, GitHub SELECTED PROJECT EXPERIENCE Enterprise Data Pipeline Designed and implemented end-to-end ETL pipelines using IBM DataStage to integrate client, loan, and transaction data into centralized databases. Implemented data validation and quality checks to improve reliability and consistency. Workflow Automation and Integration Developed and maintained Zapier and n8n workflows for business process automation, API integrations, data synchronization, error handling, and automated record management across multiple platforms. Data Synchronization Built automated integrations to synchronize employee, customer, project, and operational data between different business applications using APIs, workflow automation platforms, and custom Python solutions. AI-Powered Document and RAG Pipeline Developed an automated document-processing and RAG pipeline for technical product information. The solution included PDF extraction, document processing, chunking, embeddings, vector search, and LLM-based retrieval, supported by AWS services including S3, Lambda, SQS, ECS/Fargate, DynamoDB, EventBridge, and Textract. Web Scraping and Data Processing Developed Python-based scraping solutions using BeautifulSoup, Selenium, and Requests to collect product, pricing, and technical information from multiple sources and transform it into structured datasets. Sales Data Automation and Analytics Developed Python workflows to clean, transform, and analyze sales data and created Power BI dashboards for KPI monitoring and business reporting. Data Quality Framework Created SQL and DataStage-based validation processes to identify data inconsistencies, missing records, duplicates, and ETL processing issues. WHAT YOU CAN EXPECT • Reliable and scalable data engineering solutions • Automated ETL and business workflows • Zapier and n8n integrations • API and system integrations • AWS-based data processing solutions • AI/RAG and document-processing solutions • Data quality and validation frameworks • Performance-focused and maintainable solutions • Clear communication and timely delivery If you are looking for a Data Engineer, Data Automation Engineer, or Data Analyst who can build reliable data pipelines, automate business processes, integrate systems, develop AI/RAG solutions, and deliver actionable insights, I would be happy to discuss your requirements and how I can contribute to your project.