Databricks Data Engineer & Analyst for Real‑Time Lakehouse

About the role

We are looking for an experienced Data Engineer / Data Analyst to help a high‑performance motorsport client build a real‑time Databricks Lakehouse platform. You will be responsible for profiling incoming high‑frequency telemetry, optical tracking, and timing data, and establishing the data quality rules that ensure trustworthy information for engineers, analysts, and race officials.

Key responsibilities

• Profile raw sensor data in the Bronze layer, measuring distributions, null rates, cardinality, schema drift, and latency.
• Collaborate with race engineers, analysts, and competition officials to translate domain knowledge into concrete data quality expectations.
• Define, document, and codify validity, completeness, uniqueness, timeliness, and range checks for Bronze‑to‑Silver promotion.
• Build and maintain transformation pipelines that enforce schema, deduplicate, standardize, and quarantine records that fail quality checks.
• Implement data‑quality enforcement using Databricks native tools (Delta Live Tables / Lakeflow) or frameworks such as Great Expectations or Databricks DQX.
• Establish data contracts and maintain clear documentation of expected schemas and semantics.
• Monitor data‑quality metrics over time and generate alerts for rule violations.

Required profile

• Proven experience as a Data Engineer or Data Analyst working with high‑frequency data streams.
• Strong understanding of data‑quality concepts and ability to translate business requirements into testable rules.
• Experience collaborating with domain experts to define trustworthy data standards.

Required skills

• Databricks platform
• Delta Live Tables
• Lakeflow Declarative Pipelines
• Great Expectations
• Databricks DQX

What we offer

• Opportunity to work on cutting‑edge telemetry data for a world‑class motorsport team.
• Collaborative environment with global teams focused on technical excellence.