Freelance Agent Evaluation Engineer to create challenging tasks and evaluation criteria for AI coding agents, requiring experience in software development, testing, and evaluation of AI systems.
Requirements
- Degree in Computer Science, Software Engineering, or related fields
- 5+ years in software development, primarily Python
- Background in full-stack development, with experience building React-based interfaces and robust back-end systems
- Experience writing tests (functional, integration)
- Docker containers, and familiarity with infrastructure tools (Postgres, Kafka, Redis)
- CI/CD understanding (GitHub Actions as a user: triggers, labels, reading results)
- English proficiency - B2
Benefits
- Up to $21 per hour equivalent