DevOps Engineer – AI Model Evaluation (Remote)

About the role

Mercor is looking for a DevOps Engineer to work with frontier AI coding agents and evaluate complex infrastructure engineering tasks. This remote contract position focuses on reviewing model‑generated implementations across cloud platforms, Kubernetes, CI/CD pipelines, and observability tools.

Key responsibilities

• Use AI coding agents (e.g., Cursor, Claude Code, Codex, Windsurf, Gemini CLI) to complete and assess infrastructure engineering tasks.
• Review and validate model‑generated code for cloud platforms, Kubernetes, Terraform, CI/CD, and monitoring solutions.
• Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
• Compare outputs from multiple AI models to determine strengths and weaknesses.
• Apply professional engineering judgment to realistic production scenarios.

Required profile

• Minimum 2 years of professional experience in DevOps, SRE, or Cloud Engineering.
• Hands‑on experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, and observability tooling.
• Regular use of AI coding agents for infrastructure tasks.
• Ability to critically evaluate model‑generated solutions and suggest improvements.

Required skills

• AWS
• Azure
• Google Cloud Platform (GCP)
• Kubernetes
• Terraform
• CI/CD pipelines
• Observability tooling
• AI coding agents (Cursor, Claude Code, Codex, Windsurf, Gemini CLI)

What we offer

• Contract rate of $85 per hour.
• Additional $400 per accepted task.
• Fully remote work environment.