Senior Software Engineer & LLM Code Trainer (Remote – Latin America)

About the role

We are seeking a Senior Software Engineer who will also act as an LLM Code Trainer, helping to create and evaluate high‑quality AI training data for a leading human‑in‑the‑loop platform. This remote position focuses on bridging software engineering expertise with AI model evaluation to improve the safety and capability of large language models.

Key responsibilities

• Create and review coding tasks that reflect real‑world engineering scenarios, including debugging, refactoring, API usage, testing, performance, and security.
• Write clear, correct, and testable reference solutions that meet task requirements.
• Evaluate AI‑generated code using structured rubrics, assessing correctness, clarity, security, performance, maintainability, and instruction‑following.
• Compare multiple model outputs, select the best answer, and justify the choice with technical reasoning.
• Identify bugs, hallucinated APIs, missing edge cases, weak explanations, and poor engineering decisions in AI outputs.
• Work with terminal‑based workflows: run tests, debug, manage dependencies, and navigate repositories.
• Follow detailed guidelines consistently and participate in calibration activities to ensure reliable evaluations.

Required profile

• 5+ years of professional software engineering experience in backend, full‑stack, or systems roles.
• Strong proficiency in at least one core language (e.g., Python, JavaScript/TypeScript, Go, Java, C++, SQL).
• Hands‑on experience with Terminal‑Bench or similar terminal‑based evaluation tools.
• Comfortable using Git, command‑line interfaces, and standard development workflows.
• Excellent written and verbal English communication.
• Ability to work independently in a remote, asynchronous environment.

Required skills

• Python
• JavaScript / TypeScript
• Go
• Java
• C++
• SQL
• Git
• Terminal‑Bench
• Docker
• Linux
• Bash
• Automated testing frameworks