Easy Apply Now

A bit about us:

We are a fast-growing team working at the intersection of AI and software development. Our mission is to elevate the performance and reliability of AI-generated code through rigorous human evaluation. We're seeking experienced Python professionals who are passionate about code quality and want to make an impact in the future of AI.


Why join us?

Influence the development of cutting-edge AI systems through expert code review

Collaborate remotely with a high-caliber global team

Contribute to safer, more accurate AI code generation

Gain exposure to AI training workflows and evaluation techniques

Enjoy milestone-based delivery and competitive compensation

Job Details

Review annotator evaluations for AI-generated Python code, ensuring instruction alignment and functional accuracy

Audit code for security, correctness, and prompt adherence, using tools like Docker for testing

Identify and flag discrepancies in code ratings or feedback explanations

Provide structured, written feedback to uphold evaluation quality standards

Work within established QA and annotation frameworks to maintain consistency and integrity
Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.
Easy Apply Now