Senior Data Engineer – Spark, Scala & Microsoft Fabric

About the role

The Coca-Cola Company is looking for a Senior Data Engineer to shape how data flows across its enterprise ecosystem. The role uses deep expertise in Spark, Scala and JVM-based engineering to design and implement integration frameworks that power batch and streaming workloads on Microsoft Fabric and Synapse Analytics.

Key responsibilities

• Design and develop data integration pipelines and backend services for structured and unstructured data using Apache Spark with Scala.
• Build and optimize distributed computing applications delivering scalable batch and streaming workloads in Microsoft Fabric.
• Tune Spark performance: partitioning strategies, memory configuration, query optimization and workload balancing.
• Develop REST-based microservices and APIs on the JVM for internal and external system interoperability.
• Write clean, modular, testable Scala code following functional programming principles and SOLID principles.
• Optimize workflows through data partitioning, storage formats and platform configurations.
• Architect and maintain CI/CD pipelines with GitHub Actions, Maven and SBT to automate testing, deployment and configuration.

Required profile

• Strong Scala proficiency, including functional programming, concurrency models and modular system design.
• 3+ years of hands-on Spark experience (Scala/Java preferred) building, debugging and optimizing distributed applications.
• Experience designing data models (STAR, Vault, Tabular) for analytics and building REST microservices on the JVM.
• 3+ years of combined experience with Synapse/Fabric, including Azure Data Services (Synapse, ADF, Azure Functions, ARM templates).
• Proven ability to build automated release cycles; hands-on Git, GitHub Actions, Maven and SBT.
• Experience with big data ecosystems such as Hadoop, Delta Lake or similar on cloud platforms (AWS, Azure, GCP).
• Agile delivery (Scrum, lean techniques) and collaboration with global engineering teams.