Skip to content
Apply now
Craftware

Senior Data Engineer (Python, Databricks)

Craftware Show all offers
Warszawa
Expires Nov 22, 2026
5 days ago

In short

Senior Data Engineer role at Craftware. Responsibilities include building and maintaining DAB pipelines, ensuring environment consistency, assessing data sources, developing PySpark transformations, and defining data reconciliation. Requires Azure Databricks, PySpark, Delta Lake, advanced SQL, CI/CD (Azure DevOps, Git), and data profiling skills. Offers B2B contract, remote work, project variety, and skills development budget.

Keywords

databricks pyspark delta lake sql ci/cd azure devops git data pipelines yaml

AI-written summary based on the listing content.

Craftware is a technology company of over 500 experts, empowering large organizations to solve complex business challenges with modern IT solutions - from sales systems and automation to data platforms and AI. We operate where technology must be reliable, secure, and scalable. We deliver end-to-end projects: from analysis and architecture through implementation to development and maintenance. We are a trusted partner of industry leaders such as Salesforce, Veeva, UiPath, and Databricks.

Model: remote

Engagement:: full-time

Responsibilities

  • Build and maintain DAB pipelines and YAML-based transformation configuration; migrate toward native Databricks Asset Bundle patterns
  • Keep DEV / QAS / PRD environments consistent and drift-free across delivered markets
  • Assess new data sources before sprint commitment — shape, volume, quality risks — and write feasibility notes that gate scope entry
  • Develop PySpark transformations across Raw, Quality Integration, and Curated zones following CDA layer standards
  • Define and run data reconciliation and acceptance criteria so business users aren't the primary quality gate at UAT

Requirements

  • Azure Databricks & PySpark — senior hands-on: jobs, clusters, Unity Catalog, transformation logic, unit testing
  • Delta Lake — schema evolution, MERGE, time travel; DAB — YAML config and bundle deployment
  • SQL — advanced; able to read 10-year-old stored procedures without help
  • CI/CD — Azure DevOps, Git branching strategy, PR discipline — practised, not theoretical
  • Ability to profile source data, define acceptance criteria, and take a data problem from source assessment to UAT sign-off — without a BA intermediary
  • Comfortable with incomplete documentation and evolving scope — you document decisions so others don't need a handover call

We offer:

  • B2B contract
  • Fully remote service delivery
  • Broad range of projects (internal, international) - genuine variety of clients and tasks
  • Budget for skills development and certifications as part of the collaboration
  • Regular collaboration reviews and discussion of project scope
  • Additional benefits available as part of the collaboration
  • Networking and team-building events for project teams
Published 2026-10-29
Source

Hexjobs App

Tools tailored to this listing.