Senior GCP Data Engineer

emagine Polska Zobacz wszystkie oferty

Warsaw

13 godzin temu

W skrócie

Senior GCP Data Engineer role in Telecommunications. Build scalable batch/real-time data platforms and streaming pipelines. Requires GCP, Kafka, Flink, Python, Spark, PySpark, SQL, Hadoop, Snowflake. Remote, B2B contract, 12 months. Fluent English needed.

Słowa kluczowe

GCP Apache Kafka Apache Flink Python Spark PySpark SQL Hadoop Snowflake Data Engineering

Skrót przygotowany przez AI na podstawie treści ogłoszenia.

Details:

Industry: Telecommunications

Work model: Remote

Team Size: Approximately 10 people

Assignment type: B2B

Project Duration: 12 months, starting ASAP

The role of the Senior GCP Data Engineer revolves around building scalable data platforms for the telecommunications industry, contributing to a critical project at the onset of team development.

Responsibilities:

Design and build scalable batch and real-time data platforms.
Develop high-throughput, event-driven streaming pipelines processing large volumes of events per second.
Implement end-to-end streaming architectures.
Work with temporal joins, watermarks, state management, checkpointing, and exactly-once processing.
Monitor backpressure and optimize pipeline performance.
Design and develop data lakes, ETL/ELT pipelines and analytics-ready data platforms.
Write production-ready code and successfully complete live coding assessments.

Must Haves:

Strong Google Cloud Platform (GCP) Data Engineering experience.
Strong hands-on coding skills.
Proven streaming experience.
Experience with Apache Kafka and Apache Flink.
Proficiency in Python, Spark, PySpark, and SQL.
Experience with Hadoop and Snowflake, including data lakes and ETL/ELT pipelines.
Fluent in English.

Nice to Haves: