Requirements

Expected technologies

Databricks

AWS

Python

PySpark

ETL

Microsoft Azure

Operating system

macOS

Our requirements

• Minimum 5 years of experience working with data.
• Solid knowledge of Azure Databricks.
• Practice with ETL / ELT processes.
• Interest in AI

Your responsibilities

• Design and optimize scalable data pipelines.
• Deploy and build AI artifacts.
• Develop and automate ETL/ELT processes.
• Collaborate with Data Science teams on machine learning projects, including text/image processing and predictive model development.
• Contribute to the design and implementation of a lakehouse data architecture, ensuring automation, performance, and standardization.