Freelance Agent Evaluation Engineer position involves creating challenging tasks and evaluation criteria for AI coding agents. Requires experience in software development, particularly in Python and React, with a focus on building realistic simulated environments and designing effective tests.

Requirements

  • Degree in Computer Science, Software Engineering, or related fields
  • 5+ years in software development, primarily Python
  • Background in full-stack development
  • Experience writing tests
  • Familiarity with Docker containers and infrastructure tools
  • CI/CD understanding
  • English proficiency - B2

Benefits

  • Flexible part-time work arrangement
  • Opportunity to work on challenging AI projects
  • Potential to earn up to $50 per hour