Projects & Contributions

Everything I've Built & Contributed To

Open-source contributions, personal projects, and works in progress across MLOps, AI/ML, DevOps, and Cloud Engineering.

10
OSS Contributions
6
Personal Projects
4
In Progress
20+
Technologies Used
🌐 Open-Source Ecosystem β€” upstream projects I build on and contribute to (stars belong to upstream)
πŸ¦™
#1 TrendingOSS

Ollama β€” Local LLM Runtime

Contributed to the Go-based local LLM serving engine. Helped improve REST API documentation, multi-model management, and integration examples for production pipelines.

Go LLM REST API Quantization
164K stars Contributor 2025–2026
⚑
PyTorch EcosystemOSS

vLLM β€” High-Throughput LLM Serving

Contributing to the production-grade LLM serving engine. Focus on improving Kubernetes deployment guides, multi-GPU configuration docs, and OpenAI-compatible API examples.

Python CUDA PagedAttention Multi-GPU
49K stars Contributor Active Dev
πŸ“Š
OSS

MLflow β€” ML Lifecycle Platform

Contributed integration examples for LLM tracing and evaluation. Added Python notebooks showcasing MLflow model registry workflows with Kubernetes-based model deployment patterns.

Python Tracking Model Registry LLM Tracing
20K stars 30M/mo downloads
☸️
CNCFOSS

Kubeflow β€” ML on Kubernetes

Contributing pipeline component documentation and example DAGs. Focus on Katib hyperparameter tuning configurations and multi-cloud deployment guides for ML workloads.

Kubernetes Python Pipelines Katib
34K stars 37K+ contributors
πŸ”—
OSS

LangChain β€” LLM App Framework

Added community integrations and example chains for production RAG systems. Contributed MLOps-focused tutorials showing how to pair LangChain with MLflow for LLM observability.

Python RAG Agents LangGraph
70K stars Community Contrib
β˜€οΈ
PyTorch FoundationOSS

Ray β€” Distributed AI Compute

Contributing to Ray Serve deployment patterns and Ray Data pipeline examples. Focused on Kubernetes-based Ray cluster setup guides for large-scale ML training workloads.

Python Distributed Ray Serve Ray Tune
39K stars 27M/mo
🌬️
OSS

Apache Airflow β€” Workflow Orchestration

Contributing DAG templates for ML data preprocessing pipelines. Added Kubernetes Pod Operator examples and MLflow integration patterns for production data workflows.

Python DAGs K8s Executor REST API
44K stars 3600+ contributors
🌊
OSS

Prefect β€” Modern Workflow Engine

Added example flows for ML data ingestion pipelines. Contributed Docker and Kubernetes deployment recipes and async task coordination patterns for real-time data processing.

Python Async Dynamic DAGs Cloud Runs
18K stars 6M/mo downloads
πŸ€—
140K StarsOSS

HuggingFace Transformers

Contributing fine-tuning recipes and deployment scripts. Focused on production-serving patterns with vLLM/BentoML integration and low-rank adaptation (LoRA) training examples.

Python PyTorch LoRA PEFT
140K stars 1.2B+ installs
πŸ€–
114K StarsOSS

Dify β€” LLM App Platform

Contributing MLOps integration guides connecting Dify's agentic workflow engine with production observability tools. Added examples for Kubernetes deployment and scaling.

TypeScript Python RAG Agentic
114K stars Trending 2026
🀝

Want to Collaborate on OSS?

Always looking for contributors and co-maintainers for MLOps tooling, LLM deployment patterns, and cloud infrastructure automation. Let's build together.

πŸ”¨ Personal Projects
πŸ›‘οΈ
Built by meCI passing

toolgate β€” A Firewall for AI Agents

Every agent tool call passes a deny-by-default policy, rate limiter and session budget, and lands in a hash-chained audit log that can prove nobody rewrote history. Path traversal caught by canonicalization. Pure stdlib, 22 tests, CI green.

Python Agent Security Audit Chain
github.com/harshadkhetpal/toolgate 2026
πŸ”€
Built by meCI passing

rag-fusion-lab β€” Hybrid Retrieval, Measured

BM25, character-trigram vectors and reciprocal rank fusion from first principles. Failure modes isolated per query flavor: BM25 collapses on typos, fusion recovers everything BM25 loses. Backed by 19 tests, CI green.

Python Hybrid Search RRF
github.com/harshadkhetpal/rag-fusion-lab 2026
🧠
Built by meCI passing

forgetting-lab β€” Catastrophic Forgetting, Measured

A numpy MLP with manual backprop reproduces catastrophic forgetting: naive fine-tuning drops task A from 99% to 56%. L2 anchoring and replay measured against it. Backed by 10 tests, CI green.

NumPy Fine-tuning Continual Learning
github.com/harshadkhetpal/forgetting-lab 2026
🧩
Built by meCI passing

rag-chunk-lab β€” RAG Chunking, Measured

Measures how chunking strategy changes RAG retrieval quality. BM25 built from scratch, golden-set evaluation, and the boundary-loss effect pinned as a test. Backed by 16 tests, CI green.

Python RAG BM25
github.com/harshadkhetpal/rag-chunk-lab 2026
πŸ”Œ
Built by meCI passing

mini-mcp β€” Model Context Protocol from Scratch

The MCP tools subset from first principles: JSON-RPC server and client with schema validation and correct error codes, in about 200 readable lines. Backed by 14 tests, CI green.

Python MCP JSON-RPC
github.com/harshadkhetpal/mini-mcp 2026
πŸŽ›οΈ
Built by meCI passing

lora-lab β€” LoRA Fine-Tuning Mechanics

LoRA implemented from first principles in NumPy. Exact merging, frozen-base guarantees and rank trade-offs, every claim pinned as a test. Backed by 9 tests, CI green.

NumPy Fine-tuning LoRA
github.com/harshadkhetpal/lora-lab 2026
πŸ“
Built by meCI passing

vector-index-lab β€” Vector Search Trade-offs

Exact and IVF vector search from first principles, with the recall-versus-probes trade-off every vector database sells, measured on lumpy data. Backed by 14 tests, CI green.

NumPy ANN k-means
github.com/harshadkhetpal/vector-index-lab 2026
βœ…
Built by meCI passing

ml-train-gate β€” Reproducible ML Training Gates

Reproducible training with metric-regression gates on AUC and recall, leak-free evaluation and generated model cards. A retrain that loses quality fails CI. Backed by 15 tests, CI green.

Python ML CI
github.com/harshadkhetpal/ml-train-gate 2026
πŸ“ˆ
Built by meCI passing

drift-watch β€” Input Drift Detection

PSI and KS drift detection as a pipeline gate. Baseline-quantile bins so skewed features cannot hide drift, unseen categories treated as maximum signal. Backed by 14 tests, CI green.

Python MLOps Monitoring
github.com/harshadkhetpal/drift-watch 2026
πŸ›‘οΈ
Built by meCI passing

tf-plan-guard β€” Terraform Change Control

A policy gate over terraform plan that blocks destroys and replaces of protected resources in CI, before they reach production. Backed by 13 tests, CI green.

Python Terraform Governance
github.com/harshadkhetpal/tf-plan-guard 2026
πŸ”₯
Built by meCI passing

slo-burn β€” SLO Burn-Rate Alerting

Error-budget arithmetic and generated multiwindow burn-rate Prometheus alert rules, following the Google SRE Workbook policy. Backed by 16 tests, CI green.

Python SRE Prometheus
github.com/harshadkhetpal/slo-burn 2026
⚑
Built by meCI passing

llm-batch-sim β€” Continuous Batching, Quantified

Discrete-event simulation showing why continuous batching beats naive LLM serving: 6x throughput and 9x lower p95 latency on the demo workload. Backed by 9 tests, CI green.

Python Inference Simulation
github.com/harshadkhetpal/llm-batch-sim 2026
πŸ›‘οΈ
Built by meCI passing

llm-gateway β€” Multi-Provider LLM Routing

One API in front of many LLM providers: cheapest-first routing, response caching, automatic failover with per-provider circuit breaking, and a cost ledger separating spend from spend avoided. 19 tests, runs offline in one command.

Python FastAPI Cost Optimization Failover
github.com/harshadkhetpal/llm-gateway 2026
βœ…
Built by meCI passing

rag-eval-gate β€” RAG Quality as a CI Gate

Golden-set evaluation for RAG systems as a deterministic CI gate: a change that degrades answer quality fails the build and names the broken case. Baseline comparison, hard must-include gates, retrieval scored separately from generation. 29 tests.

Python RAG CI/CD Evaluation
github.com/harshadkhetpal/rag-eval-gate 2026
πŸ’Έ
Built by meCI passing

gpu-cost-exporter β€” GPU Metrics in Money

Reads NVIDIA DCGM exporter output and re-exports burn, waste (the idle share of spend, in dollars) and cost per 1k inferences as Prometheus metrics. Strict parsing, flagged fallback pricing, 503 over stale data, stdlib only. 15 tests.

Python Prometheus FinOps NVIDIA DCGM
github.com/harshadkhetpal/gpu-cost-exporter 2026
πŸš€
Personal

MLOps Pipeline Starter Kit

A production-ready MLOps template with MLflow experiment tracking, DVC data versioning, GitHub Actions CI/CD, Docker containerization, and Kubernetes deployment manifests.

Python MLflow Docker DVC K8s
github.com/harshadkhetpal 2025
πŸ’¬
Personal

Production RAG Chatbot (FastAPI + LangChain)

End-to-end RAG application with FastAPI backend, LangChain orchestration, Pinecone vector store, and React frontend. Deployed on AWS ECS with auto-scaling and CloudWatch monitoring.

FastAPI LangChain Pinecone AWS ECS
github.com/harshadkhetpal 2025
πŸ—οΈ
Personal

Terraform AWS ML Infrastructure

Complete Infrastructure as Code (IaC) for spinning up an ML platform on AWS β€” EKS cluster, SageMaker endpoints, S3 data lake, RDS feature store, and CloudWatch dashboards.

Terraform AWS EKS SageMaker S3 / RDS
github.com/harshadkhetpal 2025
πŸͺ
Personal

Real-Time Feature Store Pipeline

Built a feature store using Feast + Redis + Kafka for real-time ML feature serving. Includes Airflow DAGs for batch feature computation and a FastAPI endpoint for online serving.

Python Feast Kafka Redis Airflow
github.com/harshadkhetpal 2024
πŸ”­
Personal

LLM Observability & Monitoring Stack

A Dockerized observability stack for LLM applications β€” MLflow for experiment tracking, Prometheus + Grafana for metrics, Langfuse for LLM traces, and alerting via PagerDuty.

Python MLflow Prometheus Grafana
github.com/harshadkhetpal 2025
☸️
Personal

Kubernetes ML Model Deployment

Helm charts and GitOps (ArgoCD) pipeline for deploying ML models on Kubernetes with auto-scaling based on inference queue depth, canary releases, and A/B testing support.

Kubernetes Helm ArgoCD KEDA
github.com/harshadkhetpal 2024
🚧 In Progress
In Progress β€” ~60% complete
🧠
WIP

Agentic AI Orchestrator

Multi-agent framework using LangGraph + Ollama for autonomous task decomposition and execution. Supports tool use, memory, and human-in-the-loop approval workflows.

LangGraph Python Ollama FastAPI
In Progress β€” ~40% complete
🏞️
WIP

GCP Data Lakehouse Architecture

Delta Lake + BigQuery + Dataflow pipeline on GCP for real-time and batch ML feature engineering. Includes dbt transformations, data quality checks, and Vertex AI integration.

BigQuery Dataflow Delta Lake dbt
In Progress β€” ~30% complete
πŸ”„
WIP

Self-Healing CI/CD for ML Models

Automated model retraining pipeline triggered by data drift detection. Uses Evidently AI for drift monitoring, GitHub Actions for retraining, and automatic promotion via A/B shadow testing.

Evidently GitHub Actions MLflow ArgoCD
Planning stage
⚑
WIP

Serverless LLM API Gateway

AWS Lambda + API Gateway facade for multi-provider LLM routing (OpenAI, Anthropic, Ollama). Includes cost tracking, rate limiting, prompt caching, and fallback routing logic.

AWS Lambda Python API Gateway Multi-LLM
βš›οΈ
Quantum OSS

Quantum ML with Qiskit

Hybrid classical-quantum machine learning experiments built on IBM's Qiskit SDK. Implements variational quantum circuits (VQC) for classification tasks, quantum kernel methods, and QAOA for combinatorial optimization. Runs on IBM Quantum real hardware via IBM Cloud and local Aer simulator.

Python Qiskit Quantum Circuits IBM Quantum VQC / QAOA
πŸ”—
51K Stars OSS

n8n + Claude AI Agents

End-to-end AI agent automation pipelines built with n8n and Anthropic's Claude API. Workflows include: multi-step web research agents, RAG retrieval pipelines, automated email drafting from Slack triggers, GitHub PR summarisation bots, and LLM-powered data enrichment flows. All orchestrated visually in n8n's node graph with zero backend boilerplate.

Claude API n8n AI Agents RAG Workflow Automation