About Skills Projects AI News Community Contact
Open to Opportunities & Collaborations

Harshad Khetpal

MLOps · DevOps · Cloud · AI/ML · Data Engineer

|
7+
Years Experience
20+
Technologies
10+
OSS Contributions
3
Cloud Platforms

Turning Data Into Production Reality

Bridging the gap between ML research and robust production systems

🧑‍💻
AWS Certified
MLOps Expert

Hi, I'm Harshad

I'm a passionate MLOps, DevOps, Cloud & AI/ML Engineer with a deep focus on building scalable machine learning systems that actually ship to production. I specialize in designing end-to-end ML pipelines, automating infrastructure, and integrating large language models into real-world applications.

From containerizing models with Docker and orchestrating them on Kubernetes, to fine-tuning LLMs and building RAG pipelines — I work across the full stack of modern AI infrastructure. My cloud experience spans AWS, GCP, and Azure, and I'm deeply familiar with tools like MLflow, Kubeflow, Airflow, Terraform, and the broader LangChain ecosystem.

I believe in open-source collaboration, continuous learning, and building systems that are reproducible, monitored, and maintainable. Currently contributing to trending OSS projects and always open to exciting challenges at the intersection of AI and infrastructure.

🔭 Building LLM Pipelines 🌱 Learning Agentic AI 🤝 Open Source Contributor 📍 Available Worldwide (Remote)

My Tech Arsenal

A diverse skill set spanning the full AI/ML lifecycle and modern cloud infrastructure

MLOps & ML Lifecycle

MLflowKubeflow DVCBentoML Weights&BiasesFeast Evidently AI

Cloud Platforms

AWS SageMakerEC2 / EKS GCP Vertex AIBigQuery Azure MLS3 / GCS Lambda

DevOps & CI/CD

DockerKubernetes TerraformHelm GitHub ActionsJenkins ArgoCD

AI / ML / LLM

PyTorchTransformers LangChainLangGraph RAGFine-tuning vLLMOllama

Data Engineering

Apache SparkAirflow Prefectdbt KafkaPostgreSQL PineconeWeaviate

Programming & Frameworks

PythonFastAPI GoBash SQLPandas Scikit-learn
MLOps Pipelines90%
Cloud Infrastructure85%
Docker / Kubernetes88%
LLM / RAG Engineering80%
Python / ML Frameworks92%
Data Engineering82%

Projects & Contributions

My own projects first — each one tested, CI-green and runnable in one command — followed by the open-source ecosystem I build on and contribute to (stars shown belong to the upstream projects)

Built by me · CI passing
🛡️ My project

llm-gateway

One API in front of many LLM providers: cheapest-first routing, response caching, automatic failover with circuit breaking, and a cost ledger that separates spend from spend avoided. Runs offline — clone and run in one command.

Python FastAPI 19 tests
Built by me · CI passing
My project

rag-eval-gate

Golden-set evaluation for RAG systems as a deterministic CI gate — a change that degrades answer quality fails the build and names the case that broke. Catches the fluent answer with the load-bearing fact missing.

Python RAG Evaluation 29 tests
Built by me · CI passing
💸 My project

gpu-cost-exporter

Reads NVIDIA DCGM metrics and re-exports what utilisation graphs don't show: burn, waste (the idle share, in money) and cost per 1k inferences, as Prometheus metrics. Stdlib only, ships a captured DCGM sample.

Python Prometheus 15 tests
🦙 164K

Ollama

Get up and running with large language models locally. Simplifies LLM deployment on personal hardware with a clean REST API and model management.

Go REST API Local LLM
Active Dev
49K

vLLM

High-throughput and memory-efficient inference engine for LLMs. Uses PagedAttention for 24x faster serving vs HuggingFace. PyTorch ecosystem member.

Python CUDA OpenAI API
🤖 114K

Dify

Production-ready LLM app development platform with RAG pipelines, agentic workflows, model management, and observability in one intuitive interface.

TypeScript Python RAG
Contributor-Friendly
📊 20K

MLflow

End-to-end ML platform with experiment tracking, model registry, LLM observability, and AI agent tracing. 30M+ monthly downloads. The industry standard.

Python Model Registry Tracking
CNCF Project
☸️ 34K

Kubeflow

ML Toolkit for Kubernetes enabling end-to-end ML workflows. Covers pipelines, Katib hyperparameter tuning, and model training at scale. CNCF member.

Kubernetes Python Pipelines
Weekly Releases
🔗 70K

LangChain

The de facto standard for building LLM-powered applications. Modular abstractions for chains, agents, RAG, memory, and tool use. Massive plugin ecosystem.

Python TypeScript LLM
PyTorch Foundation
☀️ 39K

Ray

AI compute engine providing a distributed runtime and ML libraries for accelerating ML workloads. Used by Uber, Spotify, OpenAI. 27M monthly downloads.

Python Distributed Ray Serve
3600+ Contributors
🌬️ 44K

Apache Airflow

Platform to programmatically author, schedule, and monitor workflows. The backbone of data engineering pipelines at thousands of companies worldwide.

Python DAGs Kubernetes
6M+ Downloads/mo
🌊 18K

Prefect

Workflow orchestration for building resilient, dynamic data pipelines in Python. Reacts to real-world events, Pythonic API, Kubernetes-native.

Python Async Dynamic DAGs
🤗 140K

HuggingFace Transformers

State-of-the-art ML models for text, vision, audio, and multimodal tasks. 1.2B+ installs, 750K+ models, Transformers v5 with modular architecture.

Python PyTorch NLP / Vision
⚛️ 5.7K

Qiskit

IBM's open-source SDK for quantum computing. Compose and run quantum circuits on real IBM Quantum hardware or local simulators. Actively exploring hybrid classical-quantum ML algorithms for optimization and sampling problems.

Python Quantum Circuits IBM Quantum
🔗 51K

n8n + Claude Agents

Low-code workflow automation platform wired to Claude API for end-to-end AI agent pipelines. Build multi-step agentic workflows — web research, RAG retrieval, email drafting, Slack alerts — all orchestrated via n8n's visual node graph.

Claude API n8n AI Agents

What's Happening in AI

Staying current with the latest breakthroughs, model releases & community updates

🚀
LLM Release 13 Apr 2026

Meta Debuts Muse Spark — First Model from Alexandr Wang’s Lab

Meta’s Muse Spark achieves Llama 4 performance at an order of magnitude less compute, built by Meta Superintelligence Labs with $115-135B capex backing.

Read more →
🔒
Frontier AI 13 Apr 2026

Anthropic Claude Mythos 5 — Restricted to 40+ Security Partners

The first widely recognized 10-trillion-parameter model will not receive public release due to cybersecurity risks, rolling out to a handpicked consortium only.

Read more →
🧠
Benchmark 13 Apr 2026

GPT-5.4 Thinking Surpasses Human-Level on Desktop Tasks

OpenAI’s GPT-5.4 Thinking variant scores 75% on OSWorld-Verified, officially surpassing human-level performance on desktop task benchmarks.

Read more →
🔥
Open Source 13 Apr 2026

xAI Grok 4.20 — Multi-Agent Architecture with 4 Specialized Agents

Grok 4.20 features a 4-agent system (coordinator, research, logic, contrarian) working in parallel and cross-verifying outputs for unprecedented reliability.

Read more →
💰
Industry 13 Apr 2026

Q1 2026 AI Funding Shatters Records at $267.2B

Record-breaking VC quarter dominated by OpenAI, Anthropic, and major acquisitions. Over 30 new models launched in March alone.

Read more →
Infrastructure 13 Apr 2026

Google TurboQuant Slashes Model Memory 6x at Frontier Quality

New compression algorithm maintains frontier performance while cutting memory requirements by a factor of six — a game-changer for edge AI deployment.

Read more →

Video Learning Hub

Curated AI/ML tutorials updated weekly by AI agent

MLOps

MLOps Explained — What It Is, Why You Need It

TechWorld with Nana

Careers

How AI is Changing DevOps Careers in 2026

TechWorld with Nana

DevOps

The NEW ERA of DevOps Engineering & AI [2026]

Vishakha Sadhwani

Cloud Native

Keynote: The Future of Cloud Native Is Agentic

CNCF / Lin Sun

Agents

What is Agentic AI and How Does it Work?

IBM Technology

Interview

Crack DevOps Interviews: AWS & Kubernetes Deep Dive

Suresh Raju

Where I Engage & Learn

Active in the MLOps and AI engineering community — connecting, contributing, and sharing knowledge

🤗

Hugging Face

Exploring and sharing models, datasets, and spaces. Following cutting-edge model releases and community discussions.

Visit Profile
🐙

GitHub

Active open-source contributor. Forking, PR-ing, and starring repos across the MLOps, LLM, and cloud-native ecosystems.

GitHub Profile
💼

LinkedIn

Sharing insights on MLOps, AI engineering, and cloud infrastructure. Open to professional connections and collaborations.

Connect
🐦

X / Twitter

Following AI researchers, MLOps practitioners, and sharing quick insights on tools, papers, and engineering patterns.

Follow
✍️

Medium

Writing about MLOps, DevOps, and AI engineering. Sharing practical insights on Kubernetes, LLMs, CI/CD, and cloud-native infrastructure.

Read Articles
📖

MLOps Community

Member of the global MLOps community — attending virtual meetups, reading the blog, and participating in discussions.

Join Community
✍️

Medium / Dev.to

Writing tutorials and deep-dives on MLOps patterns, LLM deployment strategies, and cloud infrastructure best practices.

Read Articles

Code Contributions

Consistent open-source activity across AI, MLOps & DevOps repositories

Public Repos
Followers
Total Stars
Contribution Graph View on GitHub →
GitHub contribution chart
GitHub Stats
GitHub Streak
Loading repositories…
Recent Open-Source Pull Requests
Hire Me for a Project
See all 8 AI & automation services, pricing, and how we work together.
View Services →
🎬
AI Learning Videos
Curated LLM, MLOps and neural network videos — my personal learning library.
Watch Now →

Let's Build Together

Open to full-time roles, freelance projects, and open-source collaborations

I'd Love to Hear From You

Whether you're looking for an MLOps engineer to scale your ML infrastructure, a DevOps expert to streamline your CI/CD, or just want to chat about the latest in AI — my inbox is open!

I typically respond within 24 hours.