Skip to content

Rahul Sunil

AI Platform & Agent Infrastructure Engineer

About Me

I work on the unglamorous half of applied AI.

Most of what makes an LLM system usable in an enterprise has very little to do with prompt tuning. It is whether the document you uploaded was actually parseable. Whether the citation in the output points at real text or at something plausible the model invented. Whether tenant A's evidence can ever surface in tenant B's assessment. Whether a run that takes twelve hours can be made to take one. Whether you can prove, before you cut over, that the new code path produces the same answers as the old one. That is the layer I architect.

At Certa, my primary responsibility was architecting the complete production system for Risk Agent — taking it from early concepts into a reliable, enterprise-grade compliance product. Rather than just focusing on model accuracy or prompt logic, I owned the overall system architecture: the agent orchestration, production infrastructure, service design, scalability, multi-tenant vector isolation, and operational reliability required to process vendor evidence at scale. Today, Risk Agent evaluates vendor SOC 2, PCI DSS, and pentest reports across 21 risk domains and 840 controls, replacing 10–12 hours of manual analyst review per assessment with under 10 minutes of automated execution. My contribution wasn't just making an AI capability accurate — it was architecting the complete production system that made that capability usable as a real enterprise product.

Working on Risk Agent, Contracts Agent, and helping architect Data Agent revealed a clear pattern: every new agent team was rebuilding the same foundational plumbing from scratch — separate ingestion pipelines, separate tenant isolation schemes, and separate operational infrastructure. Olympus was not created because someone explicitly requested it; it emerged from those production lessons as a platform-level engineering initiative. Designed to power more than six agents once live, Olympus provides production-grade capabilities — unified agent execution, tenant isolation, error taxonomies, and cost/usage telemetry — from Day One. Instead of spending months building infrastructure, Product and Engineering teams can take new agent ideas into production in weeks, focusing their effort on business logic and agent-specific behavior while building on a flexible, reusable foundation.

I applied that same end-to-end production ownership to Contracts Agent, taking it from an n8n proof-of-concept idea into a fully production-ready service in approximately 1.5 months. I owned the complete path to production: designing the standalone microservice architecture, implementing async job models with idempotency guards and bounded retries, building structural multi-tenant isolation in Qdrant, and establishing operational infrastructure for load balancing, monitoring, and uptime. The service was deployed directly into our first enterprise client's live contracting workflow, while a subsequent pipeline optimization cut LLM inference cost per contract by roughly 60%.

Earlier at Certa, my work on DesignAI marked a major turning point, helping pivot the company toward an AI-first direction that contributed to securing $35M Series B funding. Facing a fundamental architectural challenge in workflow automation, I tackled a monolithic, non-deterministic AI routing approach and transformed it into a deterministic logical routing system with well-defined classification. By taking an opaque prompt apart into three structured classification problems behind a routing layer, accuracy leaped from 62% to 97%. This work led to a patent filed in the US and India as sole inventor and earned a co-win of Certa's first-ever company-wide Genius Award, demonstrating my experience identifying fundamental AI architecture bottlenecks and making complex AI systems deterministic, structured, and controllable.

Before Certa, I was a research intern and project lead at Microsoft, leading a team engineering non-invasive wildlife-monitoring systems using unmanned ground vehicles — authoring long-range telemetry libraries and field robotics software. I also co-founded AgriVision, building early computer vision and data pipelines for crop-disease detection, and developed multi-tenant security microservices at Accubits.

I spoke at Google DevFest 2024 about running large language models in production, contributed to the PyCon India 2023 website, and serve as a member of the Kerala Police Cyberdome technology group.

I build the layer underneath AI agents — document ingestion and RAG, agent runtime, LLM routing, evals and multi-tenant isolation — so product teams ship prompts and business logic instead of rebuilding plumbing.

Architecture Principles & Tenets

01

Documents are tenant assets, not agent assets

Key documents by content hash plus tenant ID. Ingest, parse, and embed once so multiple agents can evaluate evidence without redundant pipelines, while isolating access strictly by tenant scope.

02

Take non-judgement tasks away from the model

When an AI output must be trustworthy, identify every subtask that does not require subjective reasoning — URL generation, citation grounding, schema validation — and enforce it deterministically in code.

03

Output-neutrality before cutover

For AI systems, the critical test is not "is the output good", it is "is the output identical to the system we already trust". Use golden-set recorded cassettes and dual-run CI harnesses before cutting over.

04

Cost anomalies are control-loop problems

A cost surge is rarely a pricing problem; it is a rate limit or timeout boundary collision showing up on an invoice. Mandatory token and cost telemetry on every call makes invisible spend visible.

05

Know when to reject generic orchestrators

General-purpose workflow engines excel at linear branching, but struggle with vector search, token streaming, and dynamic agentic loops. Standalone, purpose-built microservices often win on latency and debuggability.

The Arc — Four Acts

Act I2023 → Early 2024

Foundations

"Engineering discipline in AI codebases"

Established testing pipeline (0 → 75% coverage), CI quality gates, and PR root-cause analysis. Introduced Portkey LLM gateway pattern company-wide. Evaluated Anthropic vs GPT-4 (~2× faster, ~11× cheaper).

Act II2024

Invention & Rigorous Rebuild

"Inventing, patenting, and systematically rebuilding"

Invented Workflow Context Extractor and filed a patent in the US and India as sole inventor. When accuracy degraded to 62% under client scale, dismantled the monolithic prompt into 3 structured classification problems behind a logical routing layer, achieving 97% accuracy and building a CI eval harness. Keynote speaker at Google DevFest 2024 on running large language models in production.

Act III2025

Agents at Scale

"Owning metrics and operational reliability"

Shipped 5 specialized compliance agents (PCI-DSS, Reflection, Generic, ISO V2, AI Governance). Migrated 2 services off serverless to FastAPI. Implemented deterministic citation grounding and owned the accuracy program. Awarded company-wide Certa-fied Genius Award.

Act IV2026

Platform Leadership

"Architecting the foundation multiple products run on"

Productionized Contracts Agent from n8n canvas into Python service deployed into the first enterprise client's live legal and contracting workflow; cut cost by roughly 60%. Throughput-modelled Azure to Bedrock migration at 10.6×. Authored and led Olympus AI Agent Platform across 5 milestones with org-wide sign-off; shipped M1 and deleted 2 bespoke LLM stacks.

Now — September 2026

Leading Milestone 2 of Olympus, our shared AI agent platform: the document platform layer, where ingestion, parsing and multi-tenant retrieval move out of individual agents and become shared infrastructure. Also scaling SOC 2 accuracy benchmarking across enterprise compliance datasets.

Skills & Expertise

Core & Backend Engineering

PythonFastAPICelery & SQSasyncio & PydanticDjangoDocker & Microservicesuv Workspace MonoreposGraphQL & REST APIsPytest & TDDTypeScript & JavaScriptSQLLinux & Bash

AI & Agent Systems

LangGraphPydanticAIAWS BedrockAzure OpenAIAgentic RAGLlamaParsePortkey AI GatewayStructured Output & Tool CallingEmbeddings & Vector SearchFine-TuningPyTorch & TensorFlow

Evaluation & Observability

DeepEval & RagasLangSmith & PhoenixLLM-as-Judge ScoringGolden-Set RegressionDeterministic Citation GroundingToken & Cost TelemetryDatadog APM & OpenTelemetrySentry & structlog

Cloud & Data Infrastructure

AWS (ECS, Fargate, Lambda, S3)Qdrant (Vector DB)MongoDBPostgreSQLRedisElasticsearchServerless ArchitectureCI/CD (GitHub Actions)Git

Education

B.Tech in Computer Science

APJ Abdul Kalam Technological University

8.37/102022

CBSE Computer Science - 12th Grade

Kendriya Vidyalaya, Pattom (2nd Shift)

87%2018

Key Achievements

  • August 2025: Certa-fied Genius Award Co-winner in the first-ever cycle; inducted into Hall of Fame for Workflow Context Extractor v2 (62% → 97% accuracy).
  • Dec 2024: Certa Patent Program Award ($1,000) Awarded as sole inventor of Workflow Context Extractor for GenAI Large Workflow Management.
  • Dec 2024: Featured Speaker, Google DevFest 2024 Delivered "Large Language Models in Production" keynote at GDG Technopark.
  • Sep 2021: Winner, Hac'KP International Hackathon (5th Edition) Kerala Police Cyberdome dark web intelligence hackathon winner (₹10 Lakh national prize).
  • Jun 2021: Best Engineer '21 Awarded by Indian Society for Technical Education.
  • Mar 2021: Qualified GATE 2021 Cleared the Graduate Aptitude Test in Engineering in third year of undergraduate study.
  • Jan 2021: Winner, HackX First prize at National Institute of Technology Calicut hackathon.
  • Sep 2020: Best Project & Seed Funding — BitMedi Won Best Project at Cisco ThingQbator India with a seed grant.
  • Sep 2020: Top 15 International Projects Recognized in Youth Tech Competition by startAD & Abu Dhabi Government.
  • Jan 2020: KSCSTE State Research Grant Winner Funded research project for IoT-based Accident Alert System.

Leadership & Community

Technical Lead — Olympus AI Agent Platform

Certa

2026 - Present

Cyberdome Volunteer

Kerala Police Cyberdome

Feb 2021 - Present

Chief Executive Officer

IEDC, MBCET

Oct 2021 - August 2022

Chief Technical Officer

IEDC, MBCET

May 2021 - Jun 2022

Artificial Intelligence Community Head

IEDC, MBCET

May 2019 - Sep 2020

Vice Chairman

IEEE CS MBCET

Jan 2019 - Feb 2020