Middle Data Engineer

N-iX

+6 więcej
18144 - 20664 PLN
B2B
☁️ AWS
💼 B2B
🐍 Python
SQL
Snowflake
ETL
☁️ AWS S3
SQL Server
Looker
DBT

Must have

  • AWS

  • Snowflake

  • AWS S3

  • SQL

  • dbt

  • Python

  • English (B2)

Nice to have

  • ETL

  • Oracle

  • PostgreSQL

  • MySQL

  • Looker

Requirements description

Must-Have Technologies:

  • Experience with cloud data warehouse technologies, including Snowflake and AWS S3.
  • Solid SQL skills; experience migrating legacy environments to cloud platforms.
  • Familiarity with ETL frameworks and tools (preferably SSIS, dbt).
  • Proficiency in Python for data pipeline development and automation.
  • Strong documentation and communication skills; able to work in cross-functional teams.

Nice to have:

  • Prior experience in large-scale data migration projects.
  • Background working with varied database platforms ( SQL Server, Oracle, PostgreSQL, MySQL).
  • Knowledge of reporting platforms such as Looker is a plus.

Offer description

Position Overview:

As a Middle Data Engineer, you will support the migration of legacy on-premises SQL Server data warehouse to a cloud-based Snowflake environment. The project involves integrating various data sources, refactoring ETL processes, and ensuring efficient, reliable data movement for analytics and reporting.

Your responsibilities

  1. Build and modify data pipelines to migrate data from SQL Server and other databases (Azure SQL, Oracle, Aurora) to AWS S3 and Snowflake.
  2. Refactor legacy ETL jobs (SSIS, Transact-SQL) for use in cloud environments.
  3. Implement data transformations and staging using dbt and/or similar tools.
  4. Optimize the performance and costs of cloud data processing and storage.
  5. Work collaboratively with client’s and N-iX engineers, ensuring smooth handoff and documentation.
  6. Participate in QA, testing, deployment, and post-migration validation.
Wyświetlenia: 5
Opublikowana28 dni temu
Wygasaza 24 dni
Rodzaj umowyB2B
Źródło
Logo
Logo

Podobne oferty, które mogą Cię zainteresować

Na podstawie "Middle Data Engineer"