Senior Python and Kafka Engineer

About the role

Fujitsu is seeking a hands‑on Senior Python and Kafka Engineer to enhance a correctness‑critical, event‑driven digital repository processing platform. The role focuses on improving structured logging, event visibility, reconciliation, and Kafka delivery reliability within an existing production system.

Key responsibilities

• Implement a consistent structured JSON logging standard across Python services.
• Improve Kafka producer and consumer reliability, including offset handling, consumer‑group stability, retries, dead‑letter topics and duplicate‑processing safeguards.
• Instrument services to provide end‑to‑end event lineage and develop reconciliation and completion‑tracking capabilities.
• Develop telemetry using OpenTelemetry and contribute to an OpenLineage‑based lineage solution (Marquez).
• Maintain Python services that interact with Kafka, PostgreSQL, MongoDB, object storage and external APIs, and support deployment via Kubernetes, Kustomize and ArgoCD.

Required profile

• Strong production‑level experience with Apache Kafka, including producer/consumer semantics, offset management and troubleshooting.
• Advanced Python engineering skills with expertise in concurrency, threading and building maintainable, testable code.
• Proven ability to define and implement structured logging standards and observability practices for distributed systems.
• Solid working knowledge of PostgreSQL, including JSON capabilities and data modeling for operational tracking.

Required skills

• Python
• Apache Kafka
• PostgreSQL
• MongoDB
• OpenTelemetry
• OpenLineage (Marquez)
• Kubernetes (deployment, troubleshooting)
• Kustomize
• ArgoCD
• Grafana / Loki