Skip to content
BackNov 7
kapil s.
Upwork badge

kapil s.

Senior Data & AI Engineer | GenAI, LLM/RAG, ML & Data Platforms

I am a Senior Data & AI Engineer with more than 15+ years of experience. I build data platforms, data pipelines, machine learning solutions and AI or Generative AI systems for both startups and large companies. My work covers the data and AI life cycle. I handle data ingestion, ETL or ELT data modeling, warehousing, machine learning, LLM applications, Retrieval Augmented Generation (RAG) systems, AI agents, analytics and production deployment. I use AWS, Azure, GCP, Databricks, Snowflake and the newest AI and machine‑learning tools. Recent Projects - Built an inbound voice system with Twilio, OpenAI Whisper and GPT‑4 that takes voice input in real time and routes calls. - Created LLM and RAG systems for company knowledge bases, documents and business data. - Developed an AI platform that integrates HL7 FHIR R4 with Epic, Cerner and Athenahealth. - Cut LLM inference costs by twenty‑five percent for a high‑volume voice AI product by improving OpenAI Realtime API use and token handling. - Designed scalable data pipelines and platforms using Apache Spark, PySpark, Airflow, dbt, Databricks, Snowflake, Kafka and cloud services. - Built machine‑learning pipelines and predictive models with PyTorch, TensorFlow, scikit‑learn and MLflow. - Built Power BI data models and reporting for healthcare and finance. Data Engineering I have experience building ETL or ELT pipelines, data warehouses, lakehouse platforms, batch and real‑time pipelines and data models. I use Python, SQL, PySpark, Apache Spark, Airflow, dbt, Kafka, Kinesis, Fivetran, Databricks, Delta Lake, Snowflake, BigQuery, Redshift and AWS Glue. AI, Generative AI & Machine Learning I create production AI solutions that use LLMs, RAG, AI agents, AI assistants, natural‑language processing, embeddings, vector search, machine learning and ML pipelines. My hands‑on tools include OpenAI GPT‑4 or GPT‑4o, Claude, Gemini, LangChain, LlamaIndex, Pinecone, Weaviate, pgvector, PyTorch, TensorFlow, scikit‑learn and MLflow. I focus on more than connecting an application to an LLM. I engineer the surrounding parts: data preparation, retrieval, evaluation, prompt design, model integration, cost control, scaling, monitoring and production reliability. Infrastructure I work on AWS, Microsoft Azure and Google Cloud. I use services such as AWS Glue, EMR, Lambda, S3, Redshift, Athena, SageMaker, GCP BigQuery, Dataflow, Vertex AI, Azure Data Factory, Azure Synapse and Azure ML. I also use Docker, Kubernetes, Terraform, GitHub Actions and CI/CD to deploy and manage production data and AI workloads. Healthcare, Security & Compliance I work with healthcare and sensitive data. I handle HL7 FHIR, electronic health records, HIPAA, GDPR, SOC 2 personal data protection, role‑based access control, encryption, data masking, access controls and data lineage. In enterprise settings I treat security, privacy, governance and compliance as part of the design from day one instead of adding them later. How I Work I begin by learning the business problem the current systems and the data architecture. Then I choose the solution. My goal is to build systems that're reliable, scalable, maintainable, secure and useful for the business. Whether you need a data platform, ETL pipeline, lakehouse, machine‑learning solution, LLM or RAG application AI agent, analytics platform or AI infrastructure I can own the project from architecture through deployment and ongoing improvement. I have delivered projects for startups and large companies, in the United States, Europe and Asia in healthcare, finance, SaaS, e‑commerce and other data‑heavy industries. If you need a Senior Data & AI Engineer who can connect your data, AI and cloud services into a solution I would be glad to talk about your project.

🇮🇳Indore, India$20/hr100% JSS4.90 (42)Since Jan 2016

Earnings and projects

MRR
$1.9k

Last 6 months ÷ 6

World#24,552 / 412k
🇮🇳Country#3,018 / 45.9k
Revenue, last 30 days
$1.1k

Last 6 months: $11k

World#40,459 / 412k
🇮🇳Country#4,426 / 45.9k
Total earnings
$157k

Billed in all: $160k

World#22,120 / 412k
🇮🇳Country#3,593 / 45.9k
Per project
$3k

$1.9k in the last 6 months

World#55,424 / 412k
🇮🇳Country#6,478 / 45.9k
Projects, last 6 months
6

Across 7 contracts

29% fixed71% hourly
World#34,405 / 412k
🇮🇳Country#4,220 / 45.9k
Projects in all
52

Across 62 contracts

13% fixed87% hourly
World#58,779 / 412k
🇮🇳Country#9,749 / 45.9k

Earnings, last 30 days

$160k+$1.1k earned in the last 30 daysBilled in all, before Upwork's fee · drag across the chart to see what was earned in any stretch
$159k$160k$161kOct 8Oct 23Nov 7

Skill rankings: Top 7% in AWS Glue

Ranked by MRR among everyone on Upwork with the skill.

  1. #14Data Science Consultation188 freelancers · 🇮🇳 #3Top 7%
  2. #18AWS Glue266 freelancers · 🇮🇳 #6Top 7%
  3. #19Data Lake186 freelancers · 🇮🇳 #2Top 10%
  4. #32Apache Spark467 freelancers · 🇮🇳 #3Top 7%
  5. #57Data Analytics & Visualization Software797 freelancers · 🇮🇳 #7Top 7%
  6. #66Data Warehousing494 freelancers · 🇮🇳 #12Top 13%
  7. #93Snowflake621 freelancers · 🇮🇳 #12Top 15%
  8. #173Tableau2,183 freelancers · 🇮🇳 #23Top 8%