Skip to content
BackNov 7
Yazhen L.
Upwork badge

Yazhen L.

Expert Data Engineer | Scalable ETL & Spark Optimization | Scala

🔝 𝐓𝐨𝐩-𝐑𝐚𝐭𝐞𝐝 𝐅𝐫𝐞𝐞𝐥𝐚𝐧𝐜𝐞𝐫 𝐨𝐧 𝐔𝐩𝐰𝐨𝐫𝐤 🚀 𝗦𝘁𝗿𝘂𝗴𝗴𝗹𝗶𝗻𝗴 𝘄𝗶𝘁𝗵 𝘀𝗹𝗼𝘄 𝗱𝗮𝘁𝗮 𝗽𝗿𝗼𝗰𝗲𝘀𝘀𝗶𝗻𝗴 𝗼𝗿 𝘂𝗻𝗿𝗲𝗹𝗶𝗮𝗯𝗹𝗲 𝗘𝗧𝗟 𝗽𝗶𝗽𝗲𝗹𝗶𝗻𝗲𝘀? 𝗜 𝗯𝘂𝗶𝗹𝗱 𝗮𝗻𝗱 𝗼𝗽𝘁𝗶𝗺𝗶𝘇𝗲 𝗵𝗶𝗴𝗵-𝗽𝗲𝗿𝗳𝗼𝗿𝗺𝗮𝗻𝗰𝗲 𝗱𝗮𝘁𝗮 𝘀𝘆𝘀𝘁𝗲𝗺𝘀 𝘁𝗵𝗮𝘁 𝘁𝘂𝗿𝗻 𝗺𝗮𝘀𝘀𝗶𝘃𝗲 𝗱𝗮𝘁𝗮𝘀𝗲𝘁𝘀 𝗶𝗻𝘁𝗼 𝗮𝗰𝘁𝗶𝗼𝗻𝗮𝗯𝗹𝗲 𝗶𝗻𝘀𝗶𝗴𝗵𝘁𝘀. With 4+ years of professional experience, I have worked as a Data Engineer at world-class tech giants Xiaomi (Fortune Global 500) and Shopee ($80B Market Cap). My expertise lies in transforming complex data challenges into seamless, efficient, and scalable data workflows. ⭐ How I Can Elevate Your Business: ✔ End-to-End ETL/ELT Pipeline Development: I architect and build fully automated data pipelines using Airflow and Apache Spark (Scala/Python/Java), ensuring timely and accurate data for your analytics and machine learning models. ✔ Spark Performance Tuning & Optimization: Is your Spark job running slow or failing? I specialize in deep-diving into Spark applications to diagnose bottlenecks, optimize resource utilization (memory/CPU), and significantly cut down processing time and cost. ✔ Big Data Architecture & Solutions: Leveraging modern data stack tools like Kafka, Flink, Hadoop (HDFS, Hive), and Druid, I design and implement scalable Data Lakes and Data Warehouses tailored to your specific business needs. ✔ Data Quality & Integrity: I implement rigorous data cleaning and validation processes, transforming raw, messy data into a pristine, reliable asset for your decision-making. ⭐ Core Technical Skills: ✔ Big Data Ecosystem: Apache Spark, Airflow, Kafka, Flink, Hadoop, Hive, HDFS, Druid ✔ Programming: Scala, Python, Java, SQL ✔ Databases: HBase, Redis (NoSQL), Relational SQL Databases ✔ Platforms: Data Lake, Data Warehouse, AWS, GCP ⭐ What Sets Me Apart: ✅ Problem-Solver, Not Just a Coder: I focus on understanding your business goals first, then architect a solution that delivers real value. My work at Xiaomi was praised for not just meeting, but exceeding expectations by foreseeing future needs. ✅ Proactive & Clear Communication: You will always be in the loop. I believe in transparent, frequent updates to ensure the project aligns perfectly with your vision. ✅ Partnership & Kindness: I see my clients as partners. I am committed to working collaboratively and kindly to make your project a success and your life easier. Ready to build a data infrastructure that drives your business forward? 𝗝𝗨𝗦𝗧 𝗖𝗟𝗜𝗖𝗞 𝗢𝗡 𝗜𝗡𝗩𝗜𝗧𝗘 𝗕𝗨𝗧𝗧𝗢𝗡 and let's have a quick chat about your project goals.

🇨🇳Beijing, China$30/hr100% JSS4.97 (12)Since Nov 2021

Earnings and projects

MRR
$2

Last 6 months ÷ 6

World#180,741 / 412k
🇨🇳Country#1,056 / 2,007
Revenue, last 30 days
$0

Last 6 months: $10

Total earnings
$5.1k

Billed in all: $5.3k

World#253,222 / 412k
🇨🇳Country#1,097 / 2,007
Per project
$203

$10 in the last 6 months

World#263,193 / 412k
🇨🇳Country#1,219 / 2,007
Projects, last 6 months
1
100% fixed0% hourly
World#128,092 / 412k
🇨🇳Country#730 / 2,007
Projects in all
25

Across 32 contracts

75% fixed25% hourly
World#113,042 / 412k
🇨🇳Country#531 / 2,007

Earnings, last 30 days

$5.3kNothing earned in the last 30 daysBilled in all, before Upwork's fee · drag across the chart to see what was earned in any stretch
$5.1k$5.2k$5.3k$5.4kOct 8Oct 23Nov 7

Skill rankings: Top 22% in Apache Spark

Ranked by MRR among everyone on Upwork with the skill.

  1. #10Apache Flink40 freelancers · 🇨🇳 #1Top 25%
  2. #14Hive38 freelancers · 🇨🇳 #1Top 37%
  3. #39Apache Hadoop176 freelancers · 🇨🇳 #1Top 22%
  4. #48Scala215 freelancers · 🇨🇳 #2Top 22%
  5. #101Apache Spark467 freelancers · 🇨🇳 #3Top 22%
  6. #155Big Data559 freelancers · 🇨🇳 #1Top 28%
  7. #279Apache Kafka981 freelancers · 🇨🇳 #3Top 28%
  8. #634ETL Pipeline1,397 freelancers · 🇨🇳 #6Top 45%