Requirements

Expected technologies

Python

SQL

Our requirements

• are proficient in Python, PySpark, and SQL
• have hands-on experience with Databricks
• have good understanding of data modeling principles

Optional

• experience with unit testing in Python
• familiarity with Power BI for data visualization
• knowledge of cloud services (e.g., Azure, AWS, GCP)
• exposure to CI/CD pipelines using Azure DevOps
• understanding of data governance and compliance frameworks
• familiarity with Databricks Asset Bundle

Your responsibilities

• Develop and maintain data pipelines using modern data engineering tools and frameworks
• Integrate data from various sources into Databricks
• Design and implement data models to support analytics and reporting
• Collaborate with analysts, data scientists, and business stakeholders to understand data requirements
• Ensure data quality, consistency, and compliance with governance standards
• Optimize data workflows for performance and scalability