← Home
Shyam Sekhar

Shyam Sekhar

AI Platform Engineer Β· Distributed Systems Β· Cloud-Native / SRE
πŸ“ India

I build platforms end-to-end β€” distributed systems, cloud-native infrastructure, and the SRE tooling that keeps multi-tenant SaaS reliable. Behind that: ~5 years at CareStack automating a sharded, multi-region healthcare platform, alongside a set of flagship systems I've designed and shipped solo. Each entry below is what it does, the stack, the engineering that matters, and why.

Built / owned Co-developed Contributed

Flagship Personal Platforms

NeuralOps

Built / owned Document-Driven Agentic Ops Platform Β· Self-Hosted Kubernetes

A self-hosted Kubernetes platform in two layers: a Redis-backed task engine (priority queues, retries, dead-letter, cost-aware autoscaling) and an AI agent on top. Describe an operation in plain English and the agent either answers it β€” a read-only, human-approved query that returns a result and writes nothing β€” or changes something: it drafts schema-checked code, waits for human approval, and opens a real GitHub pull request. It follows an authored runbook when one fits and plans the change itself from the schema when none does, either way through the same guardrails. It drafts; it never applies to production on its own.

GoRedisPostgreSQLMinIOk3sHelmArgoCDTerraformGitHub ActionsPrometheusGrafanaLokiOpenTelemetryOllamaGroqInfisicalgit-syncSlack
NeuralOps architecture β€” clients, Traefik ingress, api, Redis queues, the WorkflowAgent pipeline, worker dependencies, targets, platform/GitOps and observability, with every interaction labelled.
Full architecture β€” every component and the interactions between them. Click to open full size.
End-to-end walkthrough: a plain-English request β†’ matched-or-AI-planned runbook β†’ human approval β†’ real PR (Change) or a read-only answer (Ask).
  • Distributed task engine (Go + Redis): priority queues (high/default/low) with weighted draining, exponential-backoff retries with jitter, a dead-letter queue, and at-least-once delivery backed by a crash-recovery reclaim loop. Load-tested at 728 enqueue requests/sec, 0% errors, ~10 ms median on a single replica.
  • The AI agent runs as a resumable job: it matches your request to a runbook (embeddings shortlist β†’ LLM re-rank by intent) or, when none fits, plans the change itself from the schema β€” down the identical pipeline of validation, policy, human approval, and PR-only. It drafts step by step and pauses at every approval gate β€” checkpointed, so a run survives a closed browser or a worker restart. Read-only "Ask" requests take the same gate but return an answer instead of a PR, and a change-shaped question typed in Ask is caught and offered a one-click switch to Change. Drafting runs on a per-request local (Ollama) or cloud (Groq) toggle with multi-key rotation and 429 failover.
  • Grounded in real schema, guarded against drift: generated SQL is grounded in a curated, multi-database schema document rather than live introspection; a daily check plus an ArgoCD post-sync hook pause the agent the moment the database drifts from that document, until it is reconciled.
  • Org policy, an eval loop, and ChatOps around the AI: every drafted SQL artifact is checked against org-authored rules before a PR can open β€” no irreversible DROP/TRUNCATE, GRANT only to allow-listed roles, migrations must carry a rollback, no unbounded UPDATE/DELETE β€” with violations surfaced at the approval gate and in the PR body. A regression suite gates content-repo CI on a model bump, a live reviewer-decision metric flags runbooks whose drafts keep getting rejected, and a pending gate pings Slack with a review deep link β€” auto-cancelling if left undecided past a configurable timeout.
  • Full platform-engineering spine: k3s delivered via Helm + ArgoCD GitOps, Terraform, and CI; Prometheus / Grafana / Loki / OpenTelemetry for observability; a cost-aware daemon that scales idle workers to zero; secrets managed by the Infisical operator. Engine and content are fully separated β€” workflows and schema live in their own repo, pulled at runtime by a git-sync sidecar with in-process hot-reload, so content changes ship with no rebuild or redeploy.
Why it matters: Full-stack platform engineering β€” distributed-systems correctness, GitOps/IaC, observability, and cost control β€” under a genuinely useful AI layer built with the right instincts: human-in-the-loop, drafts-never-applies, destructive-intent guarding, and a hard content/engine boundary.
β–Έ Design decisions & lessons from production

The architectural decisions I made building this, and the production issues that shaped them.

  • Human-gated, resumable jobs over blocking a worker: approval is a durable checkpoint (waiting_approval), not a held goroutine β€” a run survives a closed browser and a worker restart. That one primitive is what lets the whole agent run as a platform job.
  • Embeddings alone mis-routed intent β€” "list all tables" once matched DROP TABLE. I added a retrieve-then-LLM-rerank stage that selects by intent rather than forcing the nearest match, so a benign read never silently drafts a destructive change.
  • A runbook shouldn't be the price of admission. Backing up a table shouldn't require a pre-authored runbook. The safety floor is human review + PR-only + validation + policy β€” none of which depend on the runbook β€” so when nothing matches, the agent plans the change from the schema and runs it through the same gates. Authored runbooks still take precedence when they fit; ad-hoc planning fills the gap. On the read side, the mirror: a change-shaped prompt typed in Ask ("back up …", "how to migrate …") is detected and redirected to Change rather than quietly drafting a SELECT.
  • Grounding from a committed schema document, not live introspection: deterministic, reviewable, and it carries column meaning. A drift check pauses the agent when the database diverges from the document, so reconciliation is a deliberate review of the document rather than a scramble against a live schema.
  • A strict engine/content boundary, proven live: I pushed a new workflow to the content repo and a running worker served it in about a minute with zero restarts (git-sync sidecar + atomic hot-swap).
  • An operator that cached a dead credential: a persistent 401 that curl proved was a valid key. The Infisical operator had cached the bootstrap secret and only cleared it on restart; I root-caused and documented it.
  • exFAT meets distroless: baked files arrived mode 0700 owned by root, so the nonroot container couldn't read them and crash-looped. Fixed with COPY --chmod β€” a failure mode that only surfaces on a real deploy.
  • Measuring honestly: a poor P99 in the first load test turned out to be kubectl port-forward serializing traffic, not the api (728 req/s in-cluster vs 436 through the proxy). The real tail is the synchronous Postgres store-of-record write β€” durability chosen over enqueue-tail latency, and surfaced rather than hidden.

MedXCore

Built / owned AI-native Practice Management System Β· EMR for small clinics

An AI-native practice-management system and EMR for small clinics (≀5 doctors) and solo practitioners β€” capture, schedule, and follow up in one system. Every doctor belongs to a clinic account; live at medxcore.osforlife.in.

TypeScriptHonoZodPostgreSQLRow-Level SecurityDrizzleGroq AIpg-bossSSEReactViteTailwind PWACloudflare
MedXCore architecture β€” users, Cloudflare edge/PWA, the web app (doctor + patient), the Hono API with auth Β· RLS Β· RBAC, the AI / async-realtime / domain-service layers, PostgreSQL with row-level security and object storage, plus external integrations and cross-cutting foundations, with the request flow between them.
Full architecture β€” every layer and how requests flow: clients β†’ Cloudflare β†’ web app β†’ Hono API (auth Β· RLS Β· RBAC) β†’ AI Β· async/realtime Β· domain services β†’ PostgreSQL (RLS) & storage. Click to open full size.
  • AI clinical capture β€” Groq Whisper voice dictation, Llama-Vision OCR of paper prescriptions and lab reports, and manual entry, all funnelled through a human-in-the-loop review β†’ confirm loop; auto after-visit summaries (English + Malayalam), pre-visit AI briefings, and a clinical safety-net.
  • Live token queue (β€œwhere's my train”) over Postgres LISTEN/NOTIFY β†’ SSE, with a predictive ETA that blends the doctor's set per-patient time with a learned rolling average; async AI pipeline on pg-boss (202-accept + poll).
  • Security-first data model β€” Postgres Row-Level Security partitions clinical data per authoring doctor with patient-controlled, revocable cross-doctor sharing; layered RBAC staff profiles (Doctor Β· Nurse Β· Pharmacist Β· Front-office Β· Super-admin Β· Custom); append-only audit log on every clinical write; raw audio purged after transcription.
  • Scheduling & lifecycle β€” month + day (operatory) calendar with conflict-aware booking and a same-family overlap exception, versioned medical history, and a recall / 6-month review engine on a pg-boss cron; doctor community profiles (media + posts).
Why it matters: A production-shaped clinical system β€” AI capture, realtime, RLS-enforced privacy, RBAC, and lifecycle automation β€” built end-to-end and running live, with security and compliance designed in, not bolted on.

LifeOS

Built / owned AI-Assisted Cross-Platform Productivity Β· shipped to production

A cross-platform iOS + Android app that turns long-term goals into daily action β€” and it is shipped, in real users' hands.

React NativeNestJSTypeScriptPostgreSQLRedisGitHub Actions
  • Modular NestJS backend (Auth Β· Goals Β· Habits Β· Insights); JWT auth with refresh-token rotation (reuse detection β†’ revoke session family) and per-device sessions in Redis.
  • LLM goal decomposition (goal β†’ weekly milestones β†’ daily actions) with schema validation before persistence; automated weekly insight generation.
  • PostgreSQL time-series for habits/goals β€” streak calculation via gap-and-island window functions, rolling completion-rate aggregations on a (user_id, date) index.
  • React Native app with shared logic + platform-specific UI; push notifications. Shipped to production with GitHub Actions CI/CD.
Why it matters: Proof I take things all the way to done β€” clean domain design, real authentication, time-series analytics, an AI layer, and a mobile app actually in production.

Personal Side Projects

StockMarket

Built / owned NSE Swing-Trading Signal Dashboard

A dashboard that scans NSE stocks and ETFs, generates swing-trade signals, paper-trades them, and backtests the whole strategy β€” end to end.

PythonStreamlitpandasNumPyPlotlyyfinanceDockerDocker Compose
  • Pipeline: yfinance OHLCV/fundamentals β†’ EMA indicators β†’ buy/sell/hold signals + fundamental score β†’ portfolio tracker β†’ paper-trading simulation β†’ backtest engine.
  • Two Docker services (Streamlit UI + a separate scheduler container, TZ Asia/Kolkata, persistent volume) β€” interactive vs batch separation.
  • TTL cache shields the rate-limited data source from UI auto-refresh.
Why it matters: Quant plus data engineering β€” and the discipline behind it: knowing the difference between backtest, paper-trade, and live, and how to avoid lookahead bias and overfitting.

CodeNames Malayalam

Built / owned Realtime Multiplayer Web Game

An online multiplayer Codenames clone with a 1,000-word Manglish (Malayalam) word bank β€” playable in real time with friends.

ReactViteTypeScriptSupabasePostgresRealtimeRow-Level Security
  • No custom backend β€” the database is the trust boundary. Row-level security + a masked board view ensure operatives never receive secret card colors (hidden information enforced server-side in Postgres).
  • Game moves are atomic Postgres RPCs (cheat-resistant); Supabase Realtime fans out state to all players.
Why it matters: The senior insight up front β€” with no trusted server, the database itself (via row-level security) has to enforce hidden information. A real security idea, told through a fun game. (Live at games.osforlife.in.)

UPSC Study System β€” "Prayas"

Built / owned Semantic-Search Content Platform

A study platform that turns a syllabus-shaped notes library into a fast, searchable web app β€” in fact, the very site you are reading this on.

PythonFastEmbedONNX RuntimeSupabaseDockerRenderGitHub Actionsgit hooks
  • Local embeddings (FastEmbed/ONNX, free/CPU) β†’ semantic search; content + vectors synced to Supabase; the app reads content live.
  • Render buildFilter separates content-publish cadence from code-deploy cadence β€” content commits never redeploy the app.
  • CI validates content JSON on every push; password gate; secrets in the dashboard, never in the repo.
Why it matters: The same DNA as a production RAG / knowledge platform, built on a free-tier budget β€” and a genuinely sharp CI/CD detail in splitting content-publish cadence from code-deploy cadence.

CareStack β€” Internal Platforms

Heimdall

Co-developed Internal TechOps Automation Platform

The operational control plane behind CareStack's multi-tenant, sharded, multi-region dental SaaS β€” one place to automate service requests, data-patch workflows, incident tracking, and monitoring.

C#BlazorMudBlazorGitLab CIAzure BlobArgoFlyway
  • Self-healing data-patch pipeline: parameterised request β†’ pull script from GitLab β†’ substitute env vars β†’ pre-run validation gate β†’ peer/lead review or risk-proportional auto-merge β†’ on merge, GitLab CI pushes a queue message + uploads the script to Azure Blob β†’ an Argo job dequeues and executes against the correct shard via Flyway β†’ live status streamed β†’ post-execution validation β†’ automatic MR revert + compensating script on failure.
  • Led Sev1–Sev3 incident response; blameless post-mortems; integrated the Support User Access Tool.
Why it matters: My flagship platform-engineering story at scale: humans approve, machines execute; every action auditable by construction; self-healing instead of alert-and-page.

Deriviz

Co-developed Multi-Database ETL & Migration Platform

An internal .NET Core ETL and migration platform that replaced the SSIS-based tooling used to migrate customers off competitor systems.

.NET CoreMySQL (OneDB staging)SQL ServerSQLiteSQL AnywherePervasive SQLAzure SQL / AWS MySQL
  • Source-native stored procedures per engine behind a heterogeneous driver-abstraction layer.
  • Staging hop (OneDB) decouples N sources from the target transform (N extractors + 1 transform vs NΓ—M).
  • Configurable scheduler, retry logic, execution audit; post-migration reconciliation (counts/checksums/invariants).
Why it matters: A real build-vs-buy call, the N+1 staging architecture that tames it, and a clear definition of done β€” reconciliation passes.

Patient Entity Deletion System

Built / owned Distributed Right-to-Erasure

Completely removes a patient and all of their data across several polyglot microservice databases β€” without breaking integrity, tenant isolation, or analytics.

SQL ServerMySQLVerticaDorisDBdownstream ETL
  • An idempotent, ordered saga (no 2PC across heterogeneous engines); delete children-before-parents per store.
  • Every delete scoped to tenant_id + patient_id (no blind cascades β†’ co-tenant isolation).
  • Deletion propagated into analytics/ETL for aggregate consistency; tombstones to prevent re-add races; reconciliation to prove completeness.
Why it matters: Distributed-data correctness in one problem β€” sagas, idempotency, multi-tenant blast-radius control, transactional-vs-analytical consistency, and right-to-erasure compliance.

Configuration Management Service & Feature Flow Portal

Contributed

Centralized control over feature access and rollout eligibility, plus an internal portal for controlled feature-flag rollout, cohort segmentation, and A/B configuration across tenant groups.

  • Multi-tenant shard routing, HIPAA-aware audit logging across microservice boundaries, tenant-provisioning automation.
  • Phased/gradual rollouts and kill-switch feature flags.
Why it matters: Progressive-delivery experience β€” feature flags that decouple deploy from release, so shipping code and turning a feature on become separate, controllable events.

CareStack β€” Ops-Provisioning SRE Tools Β· Flagship

Production SRE tooling I built or co-built at CareStack β€” each written up as a full engineering deep-dive.

Support User Access Tool

Co-developed integrated into Heimdall

A CLI that grants and revokes support-engineer database access across regions and database engines β€” safely, and all-or-nothing.

C#.NET CLIMicrosoft.Data.SqlClientMySqlConnectorSerilogDI
  • Spans multiple regions (US/UK/AU/IE + sandboxes) and polyglot stores β€” sharded SQL Server PMS databases, MySQL IDP, global RCMaaS MySQL.
  • Coordinated unit-of-work: a per-store transaction across SQL Server + MySQL with all-or-nothing global rollback and per-database failure identification β€” practical atomicity without 2PC.
  • Pre-flight consistency check: reconciles the max support-user ID across 11+ shards in parallel, alerting on drift before mutating (reconcile-before-write).
  • Scope-aware revocation (global vs RCMaaS-linked = least privilege); Serilog audit trail.
Why it matters: Access management plus cross-database atomic writes and sharding awareness β€” the write-side sibling of the patient-deletion saga.

DLQ Recovery Tool

Built / owned RequeueDLQInBatches

Safely replays failed messages from an Azure Service Bus dead-letter queue back onto the topic, in controlled batches.

C#Azure.Messaging.ServiceBus
  • PeekLock + complete-only-after-successful-send β†’ zero message loss (at-least-once).
  • Preserves MessageId / CorrelationId / Subject / ApplicationProperties β†’ idempotency-safe replay.
  • Backpressure-aware: polls the subscription's active-message count and waits for it to drain between batches so replay never re-overwhelms consumers.
Why it matters: A textbook SRE remediation tool β€” detect, fix, replay, and verify the queue is drained, with zero message loss.

ClearingHouse Interim Switch Automation

Co-developed

Turns a multi-step clearing-house switchover into a single observable, self-notifying job.

C#.NETclean/hexagonal (DI)Google Sheets APIMySQLAzure QueueGoogle Chat
  • Read accounts from a Google Sheet β†’ switch routing config to DXC in MySQL β†’ push processing queue message β†’ monitor queue depth until drained (not a fixed sleep) β†’ switch back to CHC β†’ Google Chat success/failure notifications.
  • Ports-and-adapters (swappable, testable integrations); the revert doubles as the compensating action on failure.
Why it matters: Turns a fragile manual runbook into deterministic, observable, idempotent automation β€” coordinating on real system state and closing the loop back to operators.

Ops-Provisioning SRE Tools Β· Additional

More production SRE tooling I contributed to, at feature and area level. Contributed

Sanyl

Proactive DB capacity tracking β€” computes the average weekly appointment peak over the past month (with projections); on threshold breach, runs a secondary CPU-utilization check before alerting.
Python Β· Docker Β· Helm (per-region values) Β· GitLab CI

TrendAlerter

Analyzes Azure Log Analytics with week-over-week comparisons to detect anomalies in requests, exceptions, dependencies, endpoint performance, and newly emerging exceptions across workspaces; results to Google Chat + Azure Blob.
C# Β· Azure Log Analytics Β· Azure Blob Β· Docker

Configuration Drift Tracker

Detects configuration changes in Azure resources with region-based scheduling and resource-level baseline management.
Python Β· CLI

DNSVigilante

Detects dangling DNS / subdomain-takeover risk; auto-generates zone files for Azure DNS and GoDaddy and feeds them to SubdomainSleuth for checks.
Python

BinlogAnalyzer

Analyzes MySQL binary logs to detect updates to specific sensitive columns, comparing previous vs updated values in binlog events.
C# Β· MySQL binlog

Slow API Tool

Detects slow APIs and integrates with an issue tracker (auto-ticketing) + Google Chat logging.
C# Β· DbContext Β· issue-tracker

SQL Optimizer Tool

SQL Server database optimizer with a benchmark-JSON updater component.
C#

Azure WebApp Slot Swapper

PowerShell automation to swap Azure App Service deployment slots (blue/green deployment).
PowerShell Β· Az module

DLQ Trends Report

Reports dead-letter-queue depth/trends over time β€” the monitoring counterpart to the DLQ Recovery Tool.
Python Β· cron Β· Docker

ProfilePermissionMigrator

Migrates profile-permission documents in Cosmos DB between accounts within an environment.
C# Β· Cosmos DB

CosmosPerioBulkDelete

Bulk soft-delete of perio documents in Cosmos DB, driven by GUIDs from an Excel input (partition-key lookup + delete-status update).
C# Β· Microsoft.Azure.Cosmos Β· ExcelDataReader

EligibilityRuleUpdater

Updates eligibility-rules JSON in Azure Blob via multiple update services, with clean DI architecture and env-var config override.
C# Β· Azure.Storage.Blobs Β· Extensions.Hosting

JiraDataPushAlert

A bot that runs a Jira JQL query (rolling date window, configurable squad/status) and pushes results as Google Chat alerts.
C# Β· Jira REST Β· Google Chat

QuarterlyMembershipReport

Generates quarterly membership reports (scheduled business reporting).
C# Β· .NET

Broader Ops-Provisioning Estate

CareStack's Ops-Provisioning is a ~100-tool SRE/Platform monorepo. Beyond the tools above, I contributed at feature/area level across these categories. Contributed

Observability & Monitoring
carestack-observabilitycarestack-monitoring-toolscarestack.dailymonitoringcarestack.pulsecarestack.pingbotcoroototel-collectortelegrafssl_exportermetricexporters.chartssqlmonitoringsql-data-monitoring-toolcarestack.mqvigilante
Reliability & SRE Platform
carestack.sre.toolscarestack.reliability.docscarestackreliability.argo.appofappscarestack.automationrunbookssretools.chartscorrelationengine.chartsdependencymapper.charts
Alerting & Exceptions
exception-alerterRecurrentExceptionsjira.ticketerjira-ticket-creation-500-exceptions
Database Reliability
carestack.replica.trackercarestack.database.baselineArchive_Old_Data_From_History_TablesRefreshSystemVersioningHistoryTablesCleanSweepcosmoscleanupaudit-trail-purge-jobdoris-ansible
Cloud Governance & Security
azure.rbacazure-tagingCareStack.Key.Rotationremove-expired-certificates-from-webappsappservicemanagedcertificatecarestack.wildcardthumbprintwebappnexus_npm-tokenGENoidc.aws.charts
Infrastructure as Code
carestack.aws.iaccarestack.azure.iaccarestack.aws.terraform.modulescarestack.terraform.modulespulumipacker-buildvmss-tfcarestack.atlantiscarestack.environment.template
Provisioning & Account/Domain Migration
AccountMigratoraccountcreationtoolcarestack.accountcreatorcarestack.salesaccountcreationtoolbulk-user-creatorcarestack-patient-engagement-account-creatorcarestack.domainmigrator
Deployment & CI/CD
octopus.automationoctopus-scriptsgitlabprerecievehookscarestack.release.branchchef-cs-gitlab-envchef-cs-gitlab-runner
Reporting & Analytics
carestack.scheduledcustomreportsrcmaas-daily-eligibility-reportcarestack.trendanalyzerkusto

Top 10 Most-Relevant SRE / Platform Tools

The ten highest-value tools curated from the broader estate β€” spanning security, database reliability, observability, incident tooling, and IaC/GitOps.

  1. CareStack.Key.Rotation β€” automated rotation of secrets, keys, and credentials on a schedule; containerized job with Helm charts. Eliminating long-lived credentials is a top breach-prevention control.
  2. carestack.mqvigilante β€” message-queue vigilance: watches topic/queue depth, backlog growth, and consumer health to catch stuck queues before they become incidents. Proactive message-queue reliability.
  3. carestack.replica.tracker β€” tracks database replication lag across primary/replica pairs and alerts when replicas fall behind. Replica lag means stale reads and data-loss-on-failover risk.
  4. carestack.automationrunbooks β€” Azure Automation runbooks managed as code (Terraform + GitOps PowerShell sync), versioned and deployed declaratively. The runbook-to-automation, toil-reduction arc as IaC/GitOps.
  5. carestack.atlantis β€” Atlantis for safe, collaborative Terraform: runs plan/apply from merge requests with approval gates. Gated, auditable IaC change management.
  6. otel-collector β€” OpenTelemetry Collector pipeline (Emissary-Ingress + OTel Operator on Kubernetes) ingesting traces/telemetry across services. The observability ingestion backbone for distributed tracing.
  7. correlationengine.charts β€” Helm-deployed event/incident correlation engine grouping related alerts to cut noise and speed RCA. Directly fights alert fatigue.
  8. exception-alerter β€” queries Azure Application Insights for production exceptions and pushes alerts. Symptom-based production error alerting.
  9. ssl_exporter β€” a Prometheus exporter for TLS-certificate expiry (Python, Dockerized, Helm chart). Expired certs are a classic outage cause; this prevents them.
  10. azure.rbac β€” Azure RBAC governance automation: role assignments and least-privilege access as code. Identity and access governance at cloud scale.
osforlife.in Β· Shyam Sekhar Β· AI Platform Engineer / SRE