About the Role
We are looking for an experienced Python Software Engineer / Tech Lead to work on an AI-focused software engineering project involving real-world open-source repositories and LLM evaluation.
You will work hands-on with Python codebases, GitHub issues, Docker environments, testing, and software quality evaluation while helping assess how effectively AI/LLM systems can understand and modify real-world code.
Key Responsibilities
- Analyze and triage GitHub issues across open-source Python libraries.
- Set up and configure software repositories and development environments.
- Dockerize repositories and manage local development environments.
- Evaluate unit-test coverage and test quality.
- Run, modify, debug, and test real-world Python codebases locally.
- Assess LLM performance in software bug-fixing scenarios.
- Identify challenging repositories and issues for LLM evaluation.
- Collaborate with researchers on AI/LLM evaluation projects.
- Potentially lead and guide junior engineers.
Required Skills
- 5+ years of overall software engineering experience
- Strong hands-on experience with Python
- Good knowledge of Git and GitHub
- Hands-on experience with Docker
- Understanding of software development pipelines
- Ability to understand and navigate complex codebases
- Strong experience running, modifying, debugging, and testing projects locally
- Open-source contribution or evaluation experience is a plus.
Nice to Have
- Experience with LLM research or evaluation
- Experience building/testing developer tools or automation agents
- Experience working with open-source projects
- Experience working in a fully remote environment.
Contract Details
- Contract Duration: 3 months
- Commitment: Minimum 40 hours per week / 8 hours per day
- Time Zone: Minimum 4 hours overlap with PST
- Employment Type: Contractor assignment
- Leave: No medical/paid leave.
Ideal Candidate
We are looking for a strong Python engineer who is comfortable working directly with complex codebases, debugging and testing existing projects, using Git/Docker, and interested in AI/LLM evaluation.
Pay: Up to ₹1,500,000.00 per year
Benefits:
Application Question(s):
- How many years of experience do you have with Git/GitHub?
- Have you worked with complex open-source codebases?
Experience:
- Python: 5 years (Required)
Work Location: Remote
