Computer Science Domain Expert (PhD) – AI Model Evaluation (Remote)
Job Type: Short-Term Contract (3 Months)
Work Mode: Remote
Start Date: Immediate
Task Duration: 6–8 hours on average
Commitment: Full-time (8 hours/day) with 4-hour PST overlap
About the Role
We are looking for PhD-level Computer Science experts (completed or currently pursuing) to contribute to the evaluation and fine-tuning of advanced large language models, including systems similar to ChatGPT.
This role focuses on designing challenging conceptual computer science problems and evaluating AI reasoning across advanced domains such as algorithms, systems design, cybersecurity, databases, networking, and theory.
This is an ideal opportunity for candidates with strong academic and research backgrounds who enjoy deep technical reasoning and problem design.
Key Responsibilities
- Design advanced conceptual computer science problems to evaluate AI model reasoning.
- Develop structured, step-by-step reference solutions with strong logical reasoning.
- Review AI-generated outputs for correctness, completeness, and reasoning quality.
- Identify flaws, logical gaps, assumptions, and edge cases in AI responses.
- Collaborate with researchers to refine evaluation benchmarks across undergraduate to PhD-level computer science topics.
- Provide structured feedback to improve AI benchmark quality and model performance.
Required Qualifications
- PhD (completed or pursuing) in Computer Science or a closely related field.
- Alternative: Master’s degree with 3+ years of professional experience in Computer Science/Engineering along with research experience.
- Strong expertise in advanced computer science domains.
- Strong problem-solving and reasoning skills.
- Ability to design challenging conceptual problems (not just coding-based).
- Excellent written communication and technical explanation skills.
- Strong analytical mindset with attention to detail.
- Ability to evaluate assumptions, definitions, edge cases, and solution validity.
Preferred Areas of Expertise
- Algorithms & Data Structures
- Operating Systems
- System Design
- Cybersecurity
- Database Systems
- Computer Networks
- Distributed Systems
- Theory of Computation
- Machine Learning Foundations
Pay: ₹2,000,000.00 - ₹2,300,000.00 per day
Experience:
- computer science, research experience, Engineering plus: 3 years (Required)
Work Location: Remote
