Arun M.
Data & AI Infrastructure Engineer | RAG Pipelines, Knowledge Graphs.
I build production-grade data and AI infrastructure. If you need someone who can architect a RAG pipeline, set up observability for a platform processing millions of events, or build a knowledge graph, that's me. What I bring: At Shopify, I spent 4 years building the Logging & Distributed Tracing Analytics platform that had ClickHouse clusters ingesting 15M+ spans/sec, managing 2+ PB/week of infrastructure data. I designed the Query Builder, Schema Explorer, and implemented TraceQL from the OpenTelemetry spec. I also built a GPT-powered chatbot for trace-based developer support. I'm the author of CogDB, an open-source graph database with 338+ GitHub stars and 151K+ PyPI downloads. It's used by a Swiss university for geodata knowledge graphs and in Big Data curriculum at Bellevue University. Before Shopify, I built analytics pipelines at scale - Protocol Buffers APIs with 4x performance gains, graph-based ad targeting systems, and distributed file storage at Oracle. What I can help you with: → RAG pipeline architecture & implementation (embedding pipelines, vector stores, retrieval optimization, knowledge graph-augmented generation) → Observability & monitoring infrastructure (ClickHouse, OpenTelemetry, Prometheus, Grafana, distributed tracing) → Knowledge graph design & implementation (graph databases, entity extraction, relationship modeling, graph queries) → AI/LLM integration (OpenAI API, chatbots, AI-powered analytics, prompt engineering for production systems) → Data pipeline engineering (Kafka, Spark, S3, Parquet, ETL/ELT, real-time streaming) Tech stack: Python, Go, TypeScript, Java | ClickHouse, BigQuery, Elasticsearch, Redis, Postgres, Supabase, Firebase | Kubernetes, GCP, AWS | React, Next.js Stanford Graduate Certificate in Mining Massive Datasets (ML, Deep Learning for NLP, Information Retrieval). I work fast, communicate clearly, and ship production-quality code. Happy to discuss your project.
Earnings and projects
Last 6 months ÷ 6
Billed in all: $1,200$1.2k