
Data Engineer
emagine Polska
Status
Hexjobs Insights
Data Engineer position in an international financial project focusing on data engineering in Azure. Requires 4+ years experience with Databricks and strong Python/SQL skills. Fully remote role based in Lisbon.
Słowa kluczowe
The project:International project in the financial sectorData platform in Azure, with ADF and Databricks as coreStrong focus on data engineering, governance and qualityCritical platform in production, with high reliability and stability requirementsResponsibilitiesDevelop and maintain data pipelines in Azure Databricks (PySpark / Spark SQL).Implement and optimize Delta Lake tables (ETL/ELT, medallion architecture).Collaborate in the design of analytical datasets.Integrate Databricks workloads with Azure Data Factory (orchestration).Apply good practices in data performance, quality and reliability.Contribute to the evolution of the platform for analytics and AI scenarios.RequirementsAt least 4 years of experience as a Data Engineer.Hands-on experience with Azure Databricks and Apache Spark.Good knowledge of Python (PySpark) and SQL.Experience with Delta Lake.Experience with Azure services:Azure Data Lake Storage (ADLS Gen2),Azure Data Factoryfluent English (oral and written).Preferred:Experience with CI/CD for data platforms (Azure DevOps, Git).Notions of data governance (e.g., Unity Catalog, Purview).Sensitivity to safety, quality and regulated environments.Experience in international projects or distributed teams.
| Opublikowana | 8 dni temu |
| Wygasa | za 2 miesiące |
| Rodzaj umowy | B2B, Praca stała |
| Źródło |
Podobne oferty, które mogą Cię zainteresować
Na podstawie "Data Engineer"
Nie znaleziono ofert, spróbuj zmienić kryteria wyszukiwania.