Projects & Contributions

Everything I've Built & Contributed To

Open-source contributions, personal projects, and works in progress across MLOps, AI/ML, DevOps, and Cloud Engineering.

10
OSS Contributions
6
Personal Projects
4
In Progress
20+
Technologies Used
🌐 Open-Source Ecosystem β€” upstream projects I build on and contribute to (stars belong to upstream)
πŸ¦™
#1 TrendingOSS

Ollama β€” Local LLM Runtime

Contributed to the Go-based local LLM serving engine. Helped improve REST API documentation, multi-model management, and integration examples for production pipelines.

Go LLM REST API Quantization
164K stars Contributor 2025–2026
⚑
PyTorch EcosystemOSS

vLLM β€” High-Throughput LLM Serving

Contributing to the production-grade LLM serving engine. Focus on improving Kubernetes deployment guides, multi-GPU configuration docs, and OpenAI-compatible API examples.

Python CUDA PagedAttention Multi-GPU
49K stars Contributor Active Dev
πŸ“Š
OSS

MLflow β€” ML Lifecycle Platform

Contributed integration examples for LLM tracing and evaluation. Added Python notebooks showcasing MLflow model registry workflows with Kubernetes-based model deployment patterns.

Python Tracking Model Registry LLM Tracing
20K stars 30M/mo downloads
☸️
CNCFOSS

Kubeflow β€” ML on Kubernetes

Contributing pipeline component documentation and example DAGs. Focus on Katib hyperparameter tuning configurations and multi-cloud deployment guides for ML workloads.

Kubernetes Python Pipelines Katib
34K stars 37K+ contributors
πŸ”—
OSS

LangChain β€” LLM App Framework

Added community integrations and example chains for production RAG systems. Contributed MLOps-focused tutorials showing how to pair LangChain with MLflow for LLM observability.

Python RAG Agents LangGraph
70K stars Community Contrib
β˜€οΈ
PyTorch FoundationOSS

Ray β€” Distributed AI Compute

Contributing to Ray Serve deployment patterns and Ray Data pipeline examples. Focused on Kubernetes-based Ray cluster setup guides for large-scale ML training workloads.

Python Distributed Ray Serve Ray Tune
39K stars 27M/mo
🌬️
OSS

Apache Airflow β€” Workflow Orchestration

Contributing DAG templates for ML data preprocessing pipelines. Added Kubernetes Pod Operator examples and MLflow integration patterns for production data workflows.

Python DAGs K8s Executor REST API
44K stars 3600+ contributors
🌊
OSS

Prefect β€” Modern Workflow Engine

Added example flows for ML data ingestion pipelines. Contributed Docker and Kubernetes deployment recipes and async task coordination patterns for real-time data processing.

Python Async Dynamic DAGs Cloud Runs
18K stars 6M/mo downloads
πŸ€—
140K StarsOSS

HuggingFace Transformers

Contributing fine-tuning recipes and deployment scripts. Focused on production-serving patterns with vLLM/BentoML integration and low-rank adaptation (LoRA) training examples.

Python PyTorch LoRA PEFT
140K stars 1.2B+ installs
πŸ€–
114K StarsOSS

Dify β€” LLM App Platform

Contributing MLOps integration guides connecting Dify's agentic workflow engine with production observability tools. Added examples for Kubernetes deployment and scaling.

TypeScript Python RAG Agentic
114K stars Trending 2026
🀝

Want to Collaborate on OSS?

Always looking for contributors and co-maintainers for MLOps tooling, LLM deployment patterns, and cloud infrastructure automation. Let's build together.

πŸ”¨ Personal Projects
πŸ›‘οΈ
Built by meCI passing

llm-gateway β€” Multi-Provider LLM Routing

One API in front of many LLM providers: cheapest-first routing, response caching, automatic failover with per-provider circuit breaking, and a cost ledger separating spend from spend avoided. 19 tests, runs offline in one command.

Python FastAPI Cost Optimization Failover
github.com/harshadkhetpal/llm-gateway 2026
βœ…
Built by meCI passing

rag-eval-gate β€” RAG Quality as a CI Gate

Golden-set evaluation for RAG systems as a deterministic CI gate: a change that degrades answer quality fails the build and names the broken case. Baseline comparison, hard must-include gates, retrieval scored separately from generation. 29 tests.

Python RAG CI/CD Evaluation
github.com/harshadkhetpal/rag-eval-gate 2026
πŸ’Έ
Built by meCI passing

gpu-cost-exporter β€” GPU Metrics in Money

Reads NVIDIA DCGM exporter output and re-exports burn, waste (the idle share of spend, in dollars) and cost per 1k inferences as Prometheus metrics. Strict parsing, flagged fallback pricing, 503 over stale data, stdlib only. 15 tests.

Python Prometheus FinOps NVIDIA DCGM
github.com/harshadkhetpal/gpu-cost-exporter 2026
πŸš€
Personal

MLOps Pipeline Starter Kit

A production-ready MLOps template with MLflow experiment tracking, DVC data versioning, GitHub Actions CI/CD, Docker containerization, and Kubernetes deployment manifests.

Python MLflow Docker DVC K8s
github.com/harshadkhetpal 2025
πŸ’¬
Personal

Production RAG Chatbot (FastAPI + LangChain)

End-to-end RAG application with FastAPI backend, LangChain orchestration, Pinecone vector store, and React frontend. Deployed on AWS ECS with auto-scaling and CloudWatch monitoring.

FastAPI LangChain Pinecone AWS ECS
github.com/harshadkhetpal 2025
πŸ—οΈ
Personal

Terraform AWS ML Infrastructure

Complete Infrastructure as Code (IaC) for spinning up an ML platform on AWS β€” EKS cluster, SageMaker endpoints, S3 data lake, RDS feature store, and CloudWatch dashboards.

Terraform AWS EKS SageMaker S3 / RDS
github.com/harshadkhetpal 2025
πŸͺ
Personal

Real-Time Feature Store Pipeline

Built a feature store using Feast + Redis + Kafka for real-time ML feature serving. Includes Airflow DAGs for batch feature computation and a FastAPI endpoint for online serving.

Python Feast Kafka Redis Airflow
github.com/harshadkhetpal 2024
πŸ”­
Personal

LLM Observability & Monitoring Stack

A Dockerized observability stack for LLM applications β€” MLflow for experiment tracking, Prometheus + Grafana for metrics, Langfuse for LLM traces, and alerting via PagerDuty.

Python MLflow Prometheus Grafana
github.com/harshadkhetpal 2025
☸️
Personal

Kubernetes ML Model Deployment

Helm charts and GitOps (ArgoCD) pipeline for deploying ML models on Kubernetes with auto-scaling based on inference queue depth, canary releases, and A/B testing support.

Kubernetes Helm ArgoCD KEDA
github.com/harshadkhetpal 2024
🚧 In Progress
In Progress β€” ~60% complete
🧠
WIP

Agentic AI Orchestrator

Multi-agent framework using LangGraph + Ollama for autonomous task decomposition and execution. Supports tool use, memory, and human-in-the-loop approval workflows.

LangGraph Python Ollama FastAPI
In Progress β€” ~40% complete
🏞️
WIP

GCP Data Lakehouse Architecture

Delta Lake + BigQuery + Dataflow pipeline on GCP for real-time and batch ML feature engineering. Includes dbt transformations, data quality checks, and Vertex AI integration.

BigQuery Dataflow Delta Lake dbt
In Progress β€” ~30% complete
πŸ”„
WIP

Self-Healing CI/CD for ML Models

Automated model retraining pipeline triggered by data drift detection. Uses Evidently AI for drift monitoring, GitHub Actions for retraining, and automatic promotion via A/B shadow testing.

Evidently GitHub Actions MLflow ArgoCD
Planning stage
⚑
WIP

Serverless LLM API Gateway

AWS Lambda + API Gateway facade for multi-provider LLM routing (OpenAI, Anthropic, Ollama). Includes cost tracking, rate limiting, prompt caching, and fallback routing logic.

AWS Lambda Python API Gateway Multi-LLM
βš›οΈ
Quantum OSS

Quantum ML with Qiskit

Hybrid classical-quantum machine learning experiments built on IBM's Qiskit SDK. Implements variational quantum circuits (VQC) for classification tasks, quantum kernel methods, and QAOA for combinatorial optimization. Runs on IBM Quantum real hardware via IBM Cloud and local Aer simulator.

Python Qiskit Quantum Circuits IBM Quantum VQC / QAOA
πŸ”—
51K Stars OSS

n8n + Claude AI Agents

End-to-end AI agent automation pipelines built with n8n and Anthropic's Claude API. Workflows include: multi-step web research agents, RAG retrieval pipelines, automated email drafting from Slack triggers, GitHub PR summarisation bots, and LLM-powered data enrichment flows. All orchestrated visually in n8n's node graph with zero backend boilerplate.

Claude API n8n AI Agents RAG Workflow Automation