SME Careers is hiring approximately 30 skilled Python Experts to join our remote AI training and evaluation team.
About the Role
As a Python Expert, you will review and evaluate AI-generated Python solutions for technical accuracy, code quality, reasoning, debugging, edge cases, complexity, and adherence to instructions.
You will help improve AI systems by identifying coding errors, evaluating multiple solutions against clear rubrics, creating high-quality Python problems and reference solutions, and providing concise technical feedback.
Required Qualifications
- Bachelor’s/Master’s degree or equivalent practical experience in Computer Science, Software Engineering, IT, or a related field.
- 2–5 years of relevant experience in Python development, code review, debugging, QA, or technical problem-solving.
- Strong working knowledge of Python 3.x, including data structures, functions, modules, exceptions, OOP, and debugging.
- Ability to evaluate correctness, edge cases, time/space complexity, readability, and code quality.
- Strong analytical and problem-solving skills.
- Strong English communication and written feedback skills.
- Ability to follow detailed guidelines and apply evaluation rubrics consistently.
- Experience with AI Training, LLM Evaluation, Data Annotation, or AI-generated content review is highly preferred.
- Detail-oriented, reliable, and comfortable working independently in a remote environment.
Key Skills
Python | Python 3.x | Software Development | Code Review | Debugging | Technical QA | AI Training | LLM Evaluation | Data Annotation | Technical Evaluation | Problem Solving
Key Responsibilities
- Review and evaluate AI-generated Python code and explanations.
- Identify coding errors, incorrect logic, bugs, and unsupported technical claims.
- Assess edge cases, complexity, maintainability, and Python best practices.
- Compare and rank multiple AI responses using defined evaluation rubrics.
- Create Python prompts, coding problems, reference solutions, and evaluation criteria.
- Provide clear and concise technical feedback.
- Identify recurring error patterns and quality issues.
- Support AI model improvement through accurate and consistent technical evaluation.
Position Details
Company: SME Careers
Positions: ~30
Work: Remote
Type: Hourly Contractor
Interview Language: English
Schedule: Flexible hours
Note: This is a technical role. Candidates must have genuine hands-on Python knowledge and strong coding, debugging, and technical reasoning skills.
Pay: ₹3,000.00 - ₹4,500.00 per hour
Expected hours: 40.0 per week
Application Question(s):
- Why do you want to join our company?
Education:
Experience:
- Python Expert: 1 year (Preferred)
Language:
Location:
Work Location: Remote
