Senior Data Engineer (Python & Databricks)

Senior Data Engineer (Python & Databricks)

Cyclad

140 - 160 PLN / HOUR
Warszawa
Warszawa, Masovian
B2B
Python
PySpark
Databricks
SQL
Data Modeling
Medallion Architecture
OOP
Azure Data Factory
CI/CD

Hexjobs Insights

Senior Data Engineer role focusing on SQL to Databricks migration, Python/PySpark coding, and data modeling. Benefits include remote work and private medical care.

Słowa kluczowe

Python
PySpark
Databricks
SQL
Data Modeling
Medallion Architecture
OOP
Azure Data Factory
CI/CD

Benefity

  • Remote working model
  • Private medical care with dental care
  • Multisport card
  • Life insurance

Technologies we use

About the project

Your responsibilities

  • Support a large-scale transformation from SQL Server–based systems to a Databricks / Delta Lake platform
  • Transform complex, business-critical SQL logic (stored procedures) into clean, maintainable, and scalable Python / PySpark code
  • Redesign and implement this logic in Python / PySpark within Databricks
  • Contribute to a large, long-running data engineering codebase used by multiple teams
  • Develop production-grade transformation code (packages, modules, reusable components)
  • Design and evolve data models within a Medallion Architecture (Bronze / Silver / Gold) across multiple data layers
  • Ensure software engineering quality, reusability, and long-term maintainability
  • Apply software engineering best practices (clean code, OOP, modularization, refactoring)
  • Work with very large data volumes and highly parallel, event-driven transformations
  • Actively participate in code reviews and technical design discussions
  • Support orchestration workflows (e.g., Azure Data Factory)

Our requirements

  • Very strong Python and PySpark skills; proven experience with Databricks and Delta Lake
  • Experience working in large, shared codebases (beyond notebooks)
  • Strong SQL skills, especially reading and understanding complex logic
  • Solid object-oriented programming experience, clean code principles
  • Strong data modelling background (transactional and analytical)
  • Experience in redesigning models during platform migrations
  • Familiarity with layered data architectures (Bronze / Silver / Gold)
  • Very good English skills

Optional

  • Azure Data Factory (orchestration)
  • Azure DevOps, Git, CI/CD pipelines
  • Power BI or analytics tooling
  • Infrastructure / DevOps knowledge (not mandatory)

This is how we organize our work

This is how we work

This is how we work on a project

Development opportunities we offer

What we offer

  • Remote working model
  • Full-time job agreement based on b2b and employment contract
  • Private medical care with dental care (covering 70% of costs) + rehabilitation package. Family package option possible
  • Multisport card (also for an accompanying person)
  • Life insurance

Benefits

Wyświetlenia: 4
Opublikowana23 dni temu
Wygasaza 7 dni
Rodzaj umowyB2B
Źródło
Logo
Logo
Logo
Logo

Podobne oferty, które mogą Cię zainteresować

Na podstawie "Senior Data Engineer (Python & Databricks)"

Nie znaleziono ofert, spróbuj zmienić kryteria wyszukiwania.