Data Engineer

Data Engineer

emagine Polska

Praca zdalna

Lokalizacja
Lisbon
Rodzaj umowy
B2B, Praca stała
B2B
Praca stała
ETL
ELT
Spark
SQL
Python
Delta Lake
Azure Fabric
data quality
data architecture
data automation

Hexjobs Insights

Praca dla Data Engineera w Lisbonie, odpowiedzialność za architekturę i optymalizację pipeline'ów danych. Wymagana znajomość Spark, SQL, Python oraz doświadczenie w budowie ETL/ELT.

Słowa kluczowe

ETL
ELT
Spark
SQL
Python
Delta Lake
Azure Fabric
data quality
data architecture
data automation

Introduction & Summary: We are seeking a Data Engineer who has experience building, optimizing, and maintaining data pipelines (ETL/ELT), as well as strong knowledge of technologies such as Spark, SQL, and Python. This role is fundamental to ensuring the reliability, security, and efficiency of data handling processes, with a focus on innovation and continuous system evolution.Main Responsibilities:The Data Engineer will be responsible for technical and data architecture;Building, optimizing, and maintaining data pipelines;Defining pipeline architecture and governance standards;Coordinating the technical deployment of pipelines;Ensuring technical execution, performance, and code reliability;Balancing technical and product vision, acting as a bridge between stakeholders;Implementing data tests and validations, handling errors and corrupted data;Automating and monitoring processes for continuous improvement;Evaluating and proposing new architectural approaches;Stimulating innovation and promoting new solutions.Key Requirements:Experience in building and maintaining data pipelines (ETL/ELT);Proficiency in Spark, SQL, and Python;Knowledge of Delta Lake and data architecture;Experience with Azure Fabric;Ability to implement tests and ensure data quality;Ability to define and follow security standards and access policies.Nice to Have:Experience with tools for data automation and monitoring.Knowledge of big data frameworks.Skills in data analysis and visualization.Experience in promoting Proof of Concepts (POCs) and the adoption of new technologies.Other Details: This is a hybrid working model job, long-term position.

Zaloguj się, aby zobaczyć pełne szczegóły

Utwórz darmowe konto, aby uzyskać dostęp do pełnego opisu oferty i zaaplikować.

Wyświetlenia: 28
Opublikowana4 dni temu
Wygasaza około 2 miesiące
Rodzaj umowyB2B, Praca stała
Źródło
Logo

Podobne oferty, które mogą Cię zainteresować

Na podstawie "Data Engineer"

Nie znaleziono ofert, spróbuj zmienić kryteria wyszukiwania.