Senior Systems Engineer - CI/CD, IaC and Cloud Data Platforms

About the role

This role designs, builds and manages CI/CD pipelines and infrastructure-as-code (IaC) automation, with a focus on systems for data processing, data pipelines and machine learning (ML) model deployment. It works closely with data engineers and data scientists to streamline complex data workflows and apply DataOps/MLOps best practices in cloud environments.

Key responsibilities

• Design, build and manage CI/CD pipelines for data workflows and ML models, automating data processing and model deployment
• Apply IaC to provision and manage data-intensive infrastructure on cloud platforms
• Build scalable, resilient data infrastructure on AWS, Azure or GCP, integrating services such as S3, Glue, Redshift, EMR, SageMaker, Azure Data Factory, Synapse, Dataflow, BigQuery and AI Platform
• Deploy and manage containerized data pipelines and ML models using Docker and Kubernetes
• Collaborate with data engineers and data scientists, translating MLOps/DataOps requirements into technical solutions and communicating system capabilities to stakeholders

Required profile

• Bachelor's degree in Computer Science or equivalent experience
• 3 to 5 years of experience
• Hands-on experience with CI/CD for data, IaC and cloud data platforms is mandatory

Required skills

• CI/CD pipelines for data and ML models
• IaC tools such as Terraform, CloudFormation and Ansible
• Cloud platforms (AWS, Azure, GCP) and containerization (Docker) and orchestration (Kubernetes)
• Preferred: Python scripting, monitoring/logging tools (Prometheus, Grafana, ELK, CloudWatch, Datadog), pipeline orchestration (Airflow, Kubeflow Pipelines), ETL/ELT, Spark, Kafka, MLOps principles and data security in CI/CD