Haitao W.
spark/flink/python/java/recommend system/big data
I’m a developer with experience in BigData/AI and Spring framework . 1. I’m experienced in pyspark/hbase/redis/kafka/spark/flink/dbt. 8 years + 2. I’m experienced in tensorflow/pytorch. 2 years+ 3. I’m experienced in html/spring mvc. 3 year + 4.I’m experienced in aws componet, such as emr/ec2/s3/code deploy/lambda;3 year+ 5.I’m experienced in gcp componet, such as cloud storage/dataproc/bigquery/looker/dbt/ai studio; 3 year + My main skils are as followings: 1.Cloud-Native Data Platform Architecture & Deployment: Expertise in designing and deploying scalable, cloud-native data platforms on GCP and AWS, utilizing modern data stacks (Airbyte, Airflow, dbt, BigQuery, Hudi, Delta Lake). This demonstrates strong architectural and deployment skills in cloud environments. 2.End-to-End Data Pipeline Engineering & Optimization: Proficiency in building and optimizing data ingestion and ETL pipelines using Airbyte, PySpark, and dbt, ensuring efficient data processing, transformation, and analysis. This highlights expertise in data engineering and pipeline optimization. 3.Advanced Analytics & Recommendation Systems Development: Demonstrated ability to develop and deploy complex recommendation systems and enhance user personalization through advanced analytics, including interest modeling, vector generation, and click sequence analysis. This shows strong analytical and system development skills. 4.Large Language Model (LLM) Integration & Innovation: Implemented innovative solutions using LLMs like Gemini to automate data parsing and information extraction, showcasing a commitment to leveraging cutting-edge technologies. This highlights innovation and the ability to adapt to new technologies. 5.Performance Optimization & Scalability: Proven track record of optimizing data lake performance (Hudi, Delta Lake) and ETL processes, resulting in significant improvements in efficiency and scalability, including a 50% reduction in ETL processing time. This demonstrates strong problem solving and optimization skills.
Earnings and projects
An estimate from an earlier read
Billed in all: $4,849$4.8k
Earnings, last 30 days
No data since Nov 5, 2026.