Senior Data Engineer (Databricks)

RemoDevs Усі вакансії

Szczecin

Gdynia

5 днів тому

Коротко

Senior Data Engineer (Databricks) needed for a 12-month project in financial services. Responsibilities include designing & maintaining data pipelines, building ETL/ELT, using PySpark, Python, SQL, and Delta Lake. Requires 5+ years of data engineering, 3+ years with Databricks, and C1 English.

Ключові слова

Databricks Apache Spark PySpark Python SQL ETL ELT Delta Lake Data Engineering Data Pipelines

Стислий виклад підготував ШІ на основі тексту оголошення.

Senior Data Engineer (Databricks) – Financial Services

We are looking for an experienced Senior Data Engineer to join a long-term project for a client in the financial services industry. The ideal candidate has strong hands-on experience with Databricks, modern data engineering technologies, and building scalable data solutions in enterprise environments.

Project Details

Position: Senior Data Engineer (Databricks)
Industry: Financial Services
Seniority: Senior
Start Date: December 2026
Duration: 12 months
Language: English C1

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Databricks.
Build and optimize ETL/ELT processes for large-scale data processing.
Develop data transformation solutions using PySpark, Python, and SQL.
Implement and optimize Delta Lake architectures.
Design and maintain reliable data ingestion and integration processes.
Improve data quality, performance, and reliability across data platforms.
Collaborate with Data Architects, Analysts, and business stakeholders to deliver data solutions.
Ensure data security, governance, and compliance with financial industry standards.
Troubleshoot and optimize existing data engineering workflows.

Must-Have Requirements

5+ years of commercial experience in Data Engineering.
Minimum 3 years of hands-on experience with Databricks.
Strong practical knowledge of Apache Spark and PySpark.
Advanced SQL and Python programming skills.
Experience designing and implementing ETL/ELT pipelines.
Solid understanding of Delta Lake and Lakehouse architecture.
Knowledge of data modeling, data warehousing, and data integration.
Experience optimizing data processing performance and managing large datasets.
English proficiency at C1 level.

Nice to Have

Previous experience in banking or financial services.
Experience with Azure Data Factory.
Experience with CI/CD pipelines and Infrastructure as Code.
Databricks certifications.
Understanding of data governance, security, and regulatory requirements in financial environments.