
Azure Databricks Data Engineer
Capgemini Polska
Warszawa
Warszawa, Masovian
Hybrydowa
ETL
ELT
Databricks
Delta Lake
Spark
SQL
Python
data governance
data warehousing
MLflow
Status
Hexjobs Insights
Role: Azure Databricks Data Engineer. Responsibilities include developing ETL/ELT pipelines, managing data architectures, and ensuring data quality. Requirements include experience with Databricks, SQL, Python.
Słowa kluczowe
ETL
ELT
Databricks
Delta Lake
Spark
SQL
Python
data governance
data warehousing
MLflow
Benefity
- Well-being culture with medical care, life insurance, sports card.
- Access to over 70 training tracks and certification opportunities.
- Continuous feedback and performance discussions through a performance management tool.
- Hybrid working model with ergonomic home office package.
Technologies we use
About the project
Your responsibilities
- Design, develop, and maintain ETL/ELT pipelines and workflows using Databricks.
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality datasets.
- Build and manage data lake and data warehouse architectures to support analytics and reporting.
- Optimize data workflows for performance, scalability, and cost efficiency.
- Ensure data quality, consistency, and reliability across all data platforms.
- Apply data governance and security standards, leveraging tools such as Unity Catalog.
- Integrate Databricks with enterprise systems and tools (e.g., Delta Lake, MLflow, Power BI, Mosaik SDK, Agent Bricks).
- Monitor, test, and troubleshoot data pipelines to ensure production stability and performance.
- Contribute to best practices in data engineering and participate in code reviews.
Our requirements
- Hands-on experience designing and developing data pipelines with Databricks.
- Strong working knowledge of Delta Lake, Spark, and Databricks notebooks.
- Proficiency in SQL and Python for data transformation and analysis.
- Familiarity with data modeling, data warehousing, and data architecture principles.
- Understanding of data governance and security frameworks (experience with Unity Catalog is a plus).
- Experience with tools such as MLflow, Power BI, or similar technologies.
- Solid problem-solving and troubleshooting skills for data and pipeline issues.
- Effective communicator and collaborator in cross-functional environments.
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field.
- Databricks certification (e.g., Databricks Certified Data Engineer Associate or Professional) is an advantage.
What we offer
- Well-being culture: medical care with Medicover, private life insurance, and Sports card. But we went one step further by creating our own Capgemini Helpline offering therapeutical support if needed and the educational podcast "Let's talk about wellbeing" which you can listen to on Spotify.
- Access to over 70 training tracks with certification opportunities (e.g., GenAI, Excel, Business Analysis, Project Management) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, Pluralsight, TED Talks, Coursera and Udemy Business materials and trainings.
- Continuous feedback and ongoing performance discussions thanks to our performance management tool GetSuccess supported by a transparent performance management policy.
- Enjoy hybrid working model that fits your life - after completing onboarding, connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details.
Benefits
Wyświetlenia: 5
| Opublikowana | 11 dni temu |
| Wygasa | za 19 dni |
| Tryb pracy | Hybrydowa |
| Źródło |
Podobne oferty, które mogą Cię zainteresować
Na podstawie "Azure Databricks Data Engineer"
Nie znaleziono ofert, spróbuj zmienić kryteria wyszukiwania.