Yazhen L.
Expert Data Engineer | Scalable ETL & Spark Optimization | Scala
🔝 𝐓𝐨𝐩-𝐑𝐚𝐭𝐞𝐝 𝐅𝐫𝐞𝐞𝐥𝐚𝐧𝐜𝐞𝐫 𝐨𝐧 𝐔𝐩𝐰𝐨𝐫𝐤 🚀 𝗦𝘁𝗿𝘂𝗴𝗴𝗹𝗶𝗻𝗴 𝘄𝗶𝘁𝗵 𝘀𝗹𝗼𝘄 𝗱𝗮𝘁𝗮 𝗽𝗿𝗼𝗰𝗲𝘀𝘀𝗶𝗻𝗴 𝗼𝗿 𝘂𝗻𝗿𝗲𝗹𝗶𝗮𝗯𝗹𝗲 𝗘𝗧𝗟 𝗽𝗶𝗽𝗲𝗹𝗶𝗻𝗲𝘀? 𝗜 𝗯𝘂𝗶𝗹𝗱 𝗮𝗻𝗱 𝗼𝗽𝘁𝗶𝗺𝗶𝘇𝗲 𝗵𝗶𝗴𝗵-𝗽𝗲𝗿𝗳𝗼𝗿𝗺𝗮𝗻𝗰𝗲 𝗱𝗮𝘁𝗮 𝘀𝘆𝘀𝘁𝗲𝗺𝘀 𝘁𝗵𝗮𝘁 𝘁𝘂𝗿𝗻 𝗺𝗮𝘀𝘀𝗶𝘃𝗲 𝗱𝗮𝘁𝗮𝘀𝗲𝘁𝘀 𝗶𝗻𝘁𝗼 𝗮𝗰𝘁𝗶𝗼𝗻𝗮𝗯𝗹𝗲 𝗶𝗻𝘀𝗶𝗴𝗵𝘁𝘀. With 4+ years of professional experience, I have worked as a Data Engineer at world-class tech giants Xiaomi (Fortune Global 500) and Shopee ($80B Market Cap). My expertise lies in transforming complex data challenges into seamless, efficient, and scalable data workflows. ⭐ How I Can Elevate Your Business: ✔ End-to-End ETL/ELT Pipeline Development: I architect and build fully automated data pipelines using Airflow and Apache Spark (Scala/Python/Java), ensuring timely and accurate data for your analytics and machine learning models. ✔ Spark Performance Tuning & Optimization: Is your Spark job running slow or failing? I specialize in deep-diving into Spark applications to diagnose bottlenecks, optimize resource utilization (memory/CPU), and significantly cut down processing time and cost. ✔ Big Data Architecture & Solutions: Leveraging modern data stack tools like Kafka, Flink, Hadoop (HDFS, Hive), and Druid, I design and implement scalable Data Lakes and Data Warehouses tailored to your specific business needs. ✔ Data Quality & Integrity: I implement rigorous data cleaning and validation processes, transforming raw, messy data into a pristine, reliable asset for your decision-making. ⭐ Core Technical Skills: ✔ Big Data Ecosystem: Apache Spark, Airflow, Kafka, Flink, Hadoop, Hive, HDFS, Druid ✔ Programming: Scala, Python, Java, SQL ✔ Databases: HBase, Redis (NoSQL), Relational SQL Databases ✔ Platforms: Data Lake, Data Warehouse, AWS, GCP ⭐ What Sets Me Apart: ✅ Problem-Solver, Not Just a Coder: I focus on understanding your business goals first, then architect a solution that delivers real value. My work at Xiaomi was praised for not just meeting, but exceeding expectations by foreseeing future needs. ✅ Proactive & Clear Communication: You will always be in the loop. I believe in transparent, frequent updates to ensure the project aligns perfectly with your vision. ✅ Partnership & Kindness: I see my clients as partners. I am committed to working collaboratively and kindly to make your project a success and your life easier. Ready to build a data infrastructure that drives your business forward? 𝗝𝗨𝗦𝗧 𝗖𝗟𝗜𝗖𝗞 𝗢𝗡 𝗜𝗡𝗩𝗜𝗧𝗘 𝗕𝗨𝗧𝗧𝗢𝗡 and let's have a quick chat about your project goals.
Earnings and projects
Last 6 months ÷ 6
Last 6 months: $10
Billed in all: $5,291$5.3k
$10 in the last 6 months
Across 32 contracts
Earnings, last 30 days
Skill rankings: Top 22% in Apache Spark
Ranked by MRR among everyone on Upwork with the skill.
- #10Apache Flink40 freelancers · 🇨🇳 #1Top 25%🇨🇳#1 of 5
- #14Hive38 freelancers · 🇨🇳 #1Top 37%🇨🇳#1 of 2
- #39Apache Hadoop176 freelancers · 🇨🇳 #1Top 22%🇨🇳#1 of 5
- #48Scala215 freelancers · 🇨🇳 #2Top 22%🇨🇳#2 of 3
- #101Apache Spark467 freelancers · 🇨🇳 #3Top 22%🇨🇳#3 of 6
- #155Big Data559 freelancers · 🇨🇳 #1Top 28%🇨🇳#1 of 6
- #279Apache Kafka981 freelancers · 🇨🇳 #3Top 28%🇨🇳#3 of 7
- #634ETL Pipeline1,397 freelancers · 🇨🇳 #6Top 45%🇨🇳#6 of 7