• Contract B2B, 32 weeks

  • Rate: hourly

  • Full-time, typical core hours

  • Working model: remote

  • Language: English

  • Start: 1.12.2026

This role involves building and maintaining data pipelines and core data products using Databricks, ensuring they are sustainable and manageable by the engineering team.

Responsibilities:

  • Build bronze, silver, and gold pipelines in PySpark and SQL to the agreed patterns.

  • Implement core data products with data contracts, tests, and documentation.

  • Make pipelines idempotent and re-runnable; handle replay, backfill, and late-arriving data.

  • Deploy through CI/CD with Databricks Asset Bundles, including unit tests and data-quality checks.

  • Tune performance and costs through Delta optimization, liquid clustering, and compute sizing.

  • Reconcile migrated data against Oracle sources.

  • Collaborate with data engineers and document everything through runbooks.

Must Haves:

  • Experience with Databricks and building data pipelines.

  • Proficiency in PySpark and SQL.

  • Strong understanding of CI/CD processes.

  • Ability to implement data quality checks and tests.

Nice to Haves:

  • Experience with Delta Lake and data optimization.

  • Familiarity with Oracle databases.

  • Knowledge of data governance and documentation practices.