Arun K.
Senior Data Engineer
Data Engineer with 15+ years of experience in designing and delivering scalable data pipelines, cloud-based ETL solutions, and data warehouse migrations. Expertise in Python, Apache Kafka, Airflow, Redshift, S3, and modern data architectures. Proven track record of migrating legacy systems to cloud environments, optimizing ETL processes, and leading cross-functional teams. Skilled in delivering high-quality, maintainable solutions in Agile environments. · Extensive hands-on expertise in Python, Apache Kafka, Apache Airflow, Oracle Data Integrator (ODI), Redshift, PostgreSQL, MySQL, and T-SQL. · Skilled in designing scalable, event-driven architectures for efficient data ingestion, transformation, and storage, including real-time streaming pipelines. · Strong experience in ETL design, data modeling, profiling, cleansing, migration, and data quality management for enterprise-scale data warehouses. · Designed and optimized ODI mappings, packages, procedures, and load plans, delivering maintainable and high-performance integration solutions. · Experienced in developing ETL pipelines using Python and Airflow, automating complex workflows in enterprise data warehouses. · Proficient in PL/SQL, SQL, MySQL, database performance tuning, and advanced ETL development. · Skilled in containerized applications (Docker), CI/CD deployments, and Agile development methodologies, ensuring reliable production environments. · Adept at leading projects, collaborating with cross-functional teams, and delivering production-ready solutions on time. · Excellent analytical, problem-solving, and communication skills, consistently achieving project deadlines and business objectives. · Comfortable working across multi-platform environments (Windows, UNIX, Linux) and managing version control tools such as Git and SVN.
Earnings and projects
Last 6 months ÷ 6
Billed in all: $17,698$18k
Across 18 contracts