Senior Data Engineer (Azure Databricks)

About the role

Applaudo Studios is looking for a Senior Data Engineer based in San José to build scalable, production-grade data pipelines and turn complex data from many sources into reliable, business-ready datasets. The role uses Azure Databricks, Python and Spark to connect data across business platforms and support enterprise data ecosystems, with collaboration with a US-based team.

Key responsibilities

• Design, build and maintain production-grade data pipelines using Azure Databricks and Python.
• Develop scalable transformations with PySpark or Spark SQL to integrate data from multiple business systems.
• Ingest and process data from APIs, relational databases, cloud storage and SFTP sources.
• Integrate data from ticketing, CRM, marketing, retail and other enterprise platforms into a centralized Data Hub.
• Build and maintain data warehouse structures, dimensional models and data marts.
• Write, optimize and maintain SQL transformations, and implement data quality checks and consistency validations.
• Maintain outbound data feeds for third-party systems and document pipelines and their dependencies.
• Troubleshoot pipeline failures and data discrepancies, and communicate progress and blockers proactively.

Required profile

• 5+ years of professional experience in data engineering, designing and maintaining production pipelines.
• Experience integrating data from multiple sources and implementing data quality checks.
• Ability to work autonomously, follow engineering practices and documentation standards, and communicate clearly in English with a US-based team.
• Nice to have: experience migrating SQL-based workloads to Azure Databricks.

Required skills

• Azure Databricks, Python and Apache Spark (PySpark and/or Spark SQL)
• Advanced SQL, including query performance optimization
• Data warehousing and dimensional modeling (facts, dimensions, data marts)
• Microsoft Azure data services for ingestion, storage and integration