About the Role
Were hiring a Code Reviewer with deep Python expertise to review evaluations completed by data annotators assessing AI-generated Python code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.
Responsibilities
- Review and audit annotator evaluations of AI-generated Python code.
- Assess if the Python code follows the prompt instructions, is functionally correct, and secure.
- Validate code snippets using proof-of-work methodology, including Docker-based execution environments when applicable. - Identify inaccuracies in annotator ratings or explanations.
- Provide constructive feedback to maintain high annotation standards.
- Work within Project Atlas guidelines for evaluation integrity and consistency.
Required Qualifications
- 57+ years of experience in Python development, QA, or code review.
- Strong knowledge of Python syntax, debugging, edge cases, and testing.
- Comfortable using code execution environments and testing tools, including Docker containers for environment isolation and reproducibility.
- Excellent written communication and documentation skills.
- Experience working with structured QA or annotation workflows.
- English proficiency at B2, C1, C2, or Native level.
Preferred Qualifications
- Experience in AI training, LLM evaluation, or model alignment.
- Familiarity with annotation platforms. - Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines.
- Working knowledge of Docker for replicating or reviewing complex code environments is a plus.
You must take the necessary steps to safeguard the integrity, security, and confidentiality of shared confidential information.
For additional information on Hurix, please visit: https://www.hurix.com/life-at-hurix/
Keyskills: Docker Coding Ai Platform Python Python Development
Hurix Systems Private Limited Hurix is a content and mobility solutions provider. We build, distribute and manage compelling and engaging digital content across traditional and new mobile platforms, formats and devices. As a leading solution provider, we provide an array of digital services, in...