Role Title: Senior AI Engineer
Location : Bangalore (Hybrid)
Contract duration: 6 Months
Minimum Experience
8+ years AI/ML/software engineering, 2+ years LLMOps/GenAI experience
Key Skills
AI/ML, GenAI, LLMOps, Routing Intelligence, Intent Classification, Token Governance, Cost Optimization, AI Observability
Role Summary
We are looking for a Senior AI Engineer to design and build App Routing Intelligence Layer and AI cost governance capabilities.
The routing layer should determine whether a user request can be handled by a deterministic API, guided workflow, cached response, clarification step, or MuleSoft Agent Fabric. This role is responsible for building the intelligence that enables App to route requests efficiently without making unnecessary LLM calls.
The ideal candidate should have strong experience with intent classification, AI routing, LLMOps, evaluation, observability, cost controls, and enterprise AI governance.
Key Responsibilities
- Design and build the App Routing Intelligence Layer.
- Implement API-first routing logic to reduce unnecessary LLM usage.
- Build intent classification and routing strategies using rules, catalogs, lightweight classifiers, and confidence scoring.
- Define when ARMI should route to:
- API Engine
- Guided workflow
- MuleSoft Agent Fabric
- Notification Engine
- Clarifying question
- Access denied / policy block
- Define and manage the intent catalog, API action catalog, agent catalog, and routing rules.
- Build cost-aware routing logic to minimise token consumption.
- Design token usage tracking across users, teams, business groups, channels, agents, and models.
- Build telemetry requirements for the token dashboard.
- Define metrics such as LLM avoidance rate, API-first completion rate, agent escalation rate, cache hit rate, and cost per interaction.
- Build evaluation datasets to test routing quality and prevent regressions.
- Collaborate with the Full Stack Developer to implement routing APIs and telemetry persistence.
- Collaborate with the Agent Orchestration AI Engineer to ensure proper handoff into MuleSoft Agent Fabric.
- Define caching, summarisation, memory selection, and prompt optimisation strategies where AI is used.
- Establish model selection guidelines and cost-control policies.
- Support governance, auditability, and explainability of routing decisions.
Required Skills
- Strong experience with AI/ML engineering, LLM applications, or intelligent routing systems.
- Strong Python experience.
- Experience building intent classification, semantic routing, rules-based routing, or hybrid routing systems.
- Strong understanding of LLM cost drivers, token management, prompt optimisation, and context management.
- Experience designing AI observability and LLMOps processes.
- Experience with AI evaluation, test datasets, regression testing, and quality metrics.
- Understanding of API-first architecture and enterprise workflow automation.
- Experience with embeddings, vector search, semantic similarity, or lightweight classification techniques.
- Experience designing routing decision objects and confidence-based routing.
- Experience with telemetry, analytics, dashboards, and usage reporting.
- Understanding of RBAC, policy checks, data security, and enterprise governance.
- Ability to design systems that avoid LLM calls unless they are truly needed.
Preferred Skills
- Experience with MuleSoft, MuleSoft Agent Fabric, or enterprise integration platforms.
- Experience with Microsoft AI Foundry, AWS Bedrock, Databricks, or OpenAI-compatible AI services.
- Experience with model gateways, AI gateways, or centralised LLM access layers.
- Experience with prompt management, model routing, and cost optimisation.
- Experience with tools such as LangChain, LlamaIndex, Semantic Kernel, MLflow, Weights & Biases, Arize, LangSmith, or OpenTelemetry.
- Experience with dashboard tools such as Power BI, Grafana, Tableau, or custom analytics dashboards.
- Experience implementing AI guardrails, policy engines, or governance workflows.
- Experience with enterprise search, knowledge bases, and RAG evaluation.
- Experience with ServiceNow, SuccessFactors, Microsoft Graph, or similar enterprise APIs.
Ideal Candidate Profile
The ideal candidate is a senior AI engineer who is highly practical and cost-conscious. They should understand that not every user request requires an LLM and should be capable of designing intelligent, governed routing that prioritises APIs, workflows, and deterministic execution before using AI agents.
Best regards,
Swapnil Thakur
Recruitment & Delivery Lead
iPeople Infosystems LLC
Contact No: +91 7972726448
Email ID: [email protected]
Visit us at www.ipeopleinfosystems.com
Pay: ₹180,000.00 - ₹210,000.00 per month
Work Location: Hybrid remote in Bengaluru, Karnataka
