XenonStack is the fastest-growing Data and AI Foundry for Agentic Systems, enabling enterprises to gain real-time and intelligent business insights.
We deliver innovation through:
Agentic Systems for AI Agents akira.ai
Vision AI Platform xenonstack.ai
Inference AI Infrastructure for Agentic Systems nexastack.ai
Our mission is to accelerate the world’s transition to AI + Human Intelligence by making AI agents reliable, explainable, and enterprise-ready.
We are seeking an LLM Reliability & Evaluation Engineer to ensure that large language models (LLMs) and agentic AI systems meet enterprise-grade standards of accuracy, safety, and trustworthiness.
This role focuses on evaluating, benchmarking, and stress-testing LLMs in real-world workflows, building frameworks for reliability, robustness, and continuous improvement. If you thrive at the intersection of AI research, applied testing, and responsible deployment, this is the role for you.
Must-Have
3–6 years in AI/ML, NLP, or applied model evaluation.
Strong understanding of LLM architectures, prompt engineering, and failure modes.
Hands-on with evaluation frameworks (Eval harnesses, Ragas, OpenAI Evals, DeepEval).
Proficiency in Python and libraries like LangChain, LangGraph, LlamaIndex, Hugging Face.
Experience with vector databases, RAG pipelines, and knowledge graph integration.
Familiarity with bias/fairness testing and Responsible AI frameworks.
Good-to-Have
Experience with reinforcement learning (RLHF, RLAIF) and reward modeling.
Exposure to agentic evaluation frameworks (multi-agent stress testing, synthetic user simulators).
Knowledge of compliance and safety requirements for BFSI, GRC, or SOC use cases.
Contributions to open-source evaluation libraries or research papers.
Agentic AI Product Company
Ensure reliability in cutting-edge AI platforms that are redefining enterprise adoption.
A Fast-Growing Category Leader
Be part of one of the fastest-growing AI Foundries, powering Fortune 500 enterprises with trustworthy AI.
Career Mobility & Growth
Grow into roles such as AI Systems Architect, Responsible AI Engineer, or Reliability Engineering Lead.
Global Exposure
Work on enterprise-scale evaluation challenges across BFSI, Healthcare, Telecom, and GRC.
Create Real Impact
Your evaluations will directly shape production-grade AI agents used in mission-critical systems.
Culture of Excellence
Our values — Agency, Taste, Ownership, Mastery, Impatience, and Customer Obsession — empower you to innovate fearlessly.
Responsible AI First
Join a company that prioritizes trustworthy, explainable, and compliant AI.
At XenonStack, we believe in shaping the future of intelligent systems. We foster a culture of cultivation built on bold, human-centric leadership principles, where deep work, simplicity, and adoption define everything we do.
Our Cultural Values
Agency – Be self-directed and proactive.
Taste – Sweat the details and build with precision.
Ownership – Take responsibility for outcomes.
Mastery – Commit to continuous learning and growth.
Impatience – Move fast and embrace progress.
Customer Obsession – Always put the customer first.
Our Product Philosophy
Obsessed with Adoption – Making AI accessible, reliable, and enterprise-ready.
Obsessed with Simplicity – Turning complex evaluation challenges into seamless, automated frameworks.
Be part of our mission to accelerate the world’s transition to AI + Human Intelligence — by making AI agents not just powerful, but trustworthy and reliable.
