Requirements

Expected technologies

PostgreSQL

Python

SQL

Docker

Kubernetes

Our requirements

• Strong proficiency in Python for ETL processes and automation.
• Practical knowledge of AWS Cloud services and Terraform.
• Familiarity with Docker and Kubernetes (EKS) for containerization.
• Understanding of workflow engines like Argo Workflows or AirFlow.
• Knowledge of PySpark and Databricks as a plus.
• Ability to apply best practices and design patterns in development.
• Strong teamwork and communication skills for collaboration in DevOps teams.
• Fluent in English, both written and spoken.

Your responsibilities

• Design, develop, and optimize ETL workflows and data pipelines to support data migration and consolidation, leveraging API and Python.
• Implement data processing and transformation logic using Pandas and SQLAlchemy, with PySpark and Databricks knowledge as a plus.
• Develop and maintain relational database solutions, particularly with PostgreSQL.
• Collaborate with business analysts, data engineers, and IT teams to define ETL strategies and understand requirements.
• Utilize best practices and design patterns to ensure efficient and scalable development.
• Troubleshoot and resolve issues throughout the entire software lifecycle, ensuring readiness for go-live.
• Engage actively with data scientists, IT product managers, and IT Architects throughout the product lifecycle.