IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder.
This is a fully remote position, open to candidates based in Netherlands.
Pay: $50–$70/hr
Role Title: Software Engineer
Role Type: Contractor
Location: Remote
We are engaging Software Engineers to contribute their technical expertise to a customer-centric project focused on enhancing development workflows and process automation. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
Execute structured evaluation assignments that simulate authentic developer activities, including version control, code review, issue tracking, and CI/CD workflow execution utilizing AI-powered tools.Assess and grade the technical correctness of outputs, verifying results hands-on within relevant development environments and tools.Design, seed, and maintain reproducible test environments—such as code repositories with real commit histories and CI workflows—to ensure reliable and realistic task contexts.Configure, document, and troubleshoot integrations and authentication flows across multiple software services, ensuring seamless connectivity.Investigate and document undocumented product behaviors through hands-on exploration and systematic testing.Participate in calibration sessions to ensure consistent evaluation methods and grading across the contributor group.Preferred Qualifications
Minimum of 3 years of professional experience in software engineering, demonstrating strong command of Git/GitHub workflows (pull requests, code review, branching, analyzing diffs, CI log diagnostics).Proficient with CI/CD systems—ideally GitHub Actions—including authoring custom workflows and ensuring reproducible build processes.Versed in using connectors across Claude and ChatGPT.Advanced scripting abilities in Python or Bash, with comfort in automating environment setup and reset tasks; solid understanding of REST APIs, OAuth, and webhook integrations.Fluency with major enterprise SaaS platforms such as Slack, Google Workspace, or Microsoft 365; administrative experience in cloud workspaces is advantageous.Experience leveraging AI assistants or agent tools in everyday developer tasks; any familiarity with agent tool-calling or the Model Context Protocol (MCP) is a plus.Background in technical QA, evaluation, or data annotation—demonstrating consistency in applying rubrics and identifying nuanced edge cases.Exceptional attention to detail, disciplined adherence to defined processes, and outstanding written and verbal communication in English. How to apply
Apply here with your profile. We will then email you a link to complete your application on the hiring platform — your application is only considered once that final step is done.