Senior Databricks Engineer

We’re looking for specialists open to cooperate on B2B basis, for our customer – Avanade Poland.

Avanade website; Privacy policy

This role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow).

Position:

As Senior Databricks Engineer, you will be working in projects for various domains and industries, focused mostly around Databricks and Azure cloud. Among your tasks there will be:

Designing, building, and maintaining scalable, efficient, and reliable data pipelinesEnd-to-end development of data architectures and ETL processes

• Collaborating with data scientists, analysts, and other engineering teams to ensure data integration and optimization
• Implementing best engineering practices across data systems
• Optimizing performance of data workflows and ensuring the reliability of data solutions
• Staying up-to-date with the latest developments in data engineering world
• Acting as a Team Lead in the project if needed
• Possibility to develop yourself in AI engineering
• Required skills:

For this role, we require commercial experience with:

Databricks

Azure cloud and services (e.g. Azure Data Factory, Data Lake, SQL Database, Azure Databricks)

Python and PySpark

• SQL
• Data Engineering concepts such as ETL, data modeling, data warehousing, data governance
• Docker and Kubernetes
• English (B2)

Nice to have:

Knowledge of OCR and corresponding libraries (e.g. easyOCR)

Any experience in data science areaIf you want to ask any questions before applying, feel free to reach out via LinkedIn!