AI QUALITY ENGINEER
- Job Title: AI Quality Engineer
- Location: Hybrid (66% On-site)
- Employment Type: Full-Time
- Experience: 2 - 4 Years
- Department: Engineering
About Smarter.Codes
Smarter.Codes is an AI Startup Studio with 12 years of experience building AI-powered products. Our work has been adopted by organizations including the US Airforce, Johnson & Johnson, SGS Group, Finland Government, and thousands of SMBs worldwide.
Beyond building startups for clients, we are actively investing in our own ventures focused on:
- Developer Tools for AI Entrepreneurs
- Vertical AI Products
- Horizontal AI Solutions
- AI Infrastructure
- B2C Startups
Role Overview
We are seeking a detail-oriented and analytical AI Quality Engineer to build and scale quality systems for AI-powered software products.
This is not a traditional manual QA role. The position combines:
- Automation Engineering
- AI Evaluation & Benchmarking
- Document Fidelity Testing
- Product Quality Strategy
- Functional & Regression Testing
You will play a key role in ensuring our products are reliable, accurate, scalable, and enterprise-grade.
Key ResponsibilitiesSoftware & Product Quality
- Design, execute, and maintain test cases for Web Applications, APIs, and AI-driven Systems
- Perform Functional Testing and Regression Testing
- Ensure product Consistency, Reliability, Usability, and Performance
AI Evaluation & Validation
- Validate AI-generated outputs using scoring systems and benchmarking methodologies
- Conduct Semantic and Logical Validation of AI responses
- Evaluate quality, accuracy, and consistency of AI-generated content
Automation & Engineering
- Develop and maintain Automation Testing Scripts and Frameworks using Python
- Support quality validation within CI/CD Pipelines
- Collaborate with engineering teams to identify and resolve defects
Documentation & Analysis
- Create Task Analysis Stories
- Maintain structured QA documentation
- Analyze product behavior and proactively recommend quality improvements
Required Skills & QualificationsTechnical Skills
✔ Strong understanding of Software Testing Fundamentals
✔ Experience with API Testing and Regression Testing
✔ Familiarity with Automation Testing Frameworks
✔ Proficiency in Python Scripting for Testing and Automation
✔ Experience validating Complex Document Formats
✔ Familiarity with CI/CD Pipelines and Quality Validation Processes
✔ Understanding of Structured Data Validation Techniques
✔ Knowledge of AI Evaluation Methodologies and Benchmarking Concepts
Good to Have
- Experience with Document Parsing Libraries
- Familiarity with DOCX and PDF Rendering Systems
- Experience working with Enterprise SaaS Products
- Exposure to AI Products or LLM-based Systems
- Knowledge of Prompt Engineering
- Familiarity with Selenium or Playwright
Desired Traits
- Ownership Mindset with accountability for outcomes
- Strong Documentation and Reporting Skills
- "Question Everything" approach to validation and problem-solving
- Ability to thrive in a Fast-Paced Startup Environment
Compensation₹6 LPA – ₹9 LPA+
(Subject to performance during the selection process)
Why Join Us?
✅ Build products that are shaping the future of AI
✅ Work on Vertical AI, Horizontal AI, and AI Infrastructure
✅ Gain exposure to multiple startups and product environments
✅ Opportunity to grow from a Contributor to a Future Co-Founder
✅ Be part of building the next generation of world-class AI companies
Ability to commute/relocate:
- Panchkula, Haryana (Panchkula): Reliably commute or planning to relocate before starting work (Preferred)
Application Question(s):
- Do you have hands-on experience with automation testing? If yes, please specify your total years of experience in this area.
- Please share your current CTC and your expected CTC for this opportunity.
Work Location: Hybrid remote in Panchkula, Haryana (Panchkula)
