Automation Test Engineer

About the role

An Automation Test Engineer position based in San Jose, Costa Rica, working in a hybrid setup. The role covers the design and maintenance of automated test frameworks, integration of testing into CI/CD pipelines, and collaboration with developers on quality assurance.

Key responsibilities

• Design, develop and maintain automated test frameworks and test suites.
• Build quality assurance processes aligned with Agile development practices.
• Develop end-to-end, integration, functional, API and regression test coverage.
• Integrate automated testing into CI/CD pipelines using GitHub Actions.
• Validate application functionality, performance, scalability and reliability.
• Collaborate with developers to identify and resolve defects early in the development lifecycle.
• Support Kubernetes and containerized application testing.
• Develop AI-assisted quality engineering capabilities and testing solutions.
• Take part in backlog refinement, sprint planning, reviews and retrospectives.
• Create and maintain detailed test documentation and quality metrics.

Required skills

• Test automation and QA: Playwright, GitHub Actions, automated testing framework design, API testing and validation, defect management, test strategy development.
• AI and advanced quality engineering: multi-agent autonomous testing architecture, DeepEval, Ragas, LLM evaluation and benchmarking, hallucination detection, faithfulness and semantic relevance testing, AI testing in CI/CD pipelines.