Data Platform Engineer (AWS)

Data Platform Engineer (AWS)

emagine Polska

Praca zdalna

170 - 170 PLN / godzina
Warsaw
B2B
data engineering
cloud-based
data lakehouse
AWS
SQL
Python
stream processing
graph databases
Terraform
Airflow

Hexjobs Insights

Data Platform Engineer (AWS) needed to design cloud data lakehouse platforms. Requires 5+ years in data engineering, AWS experience. Fully remote, B2B, 170 PLN/h.

Słowa kluczowe

data engineering
cloud-based
data lakehouse
AWS
SQL
Python
stream processing
graph databases
Terraform
Airflow

Industry: automotiveRate: up to 170 pln/h net + VAT, B2BLocation: fully remoteWe are seeking an experienced Data Platform Engineer to design and implement a cloud-based data lakehouse platform ingesting engineering and security data, transforming it across medallion layers, and serving it to analytics dashboards and AI agents.Responsibilities:Design and build cloud-based data lakehouse architectures.Ingest and transform engineering and security data through multiple layers.Deliver production-grade data platforms to support analytics and AI functionality.Collaborate with data scientists and DevOps engineers to optimize data workflows.Explain technical trade-offs to non-technical stakeholders.Required Experience5+ years in data engineering2+ years building lakehouse architectures (Bronze/Silver/Gold or equivalent)Delivered production-grade data platformsExperience with graph databases (Neo4j, Amazon Neptune, TigerGraph)Hands-on with stream processing (Kafka, Flink, Spark Streaming, Kinesis)Core Technical SkillsCloud: AWS (S3/Blob, RDS/SQL DB, Managed Kafka, Serverless compute)SQL & Modeling: SQL, dimensional modeling, SCD2, normalization/denormalizationTransformations: dbt, Databricks SQL, Dataform, SQL/Python frameworksProgramming: Python, ScalaOrchestration: Airflow, Prefect, Dagster, Step Functions, Azure Data FactoryIaC: Terraform, CloudFormation, Pulumi, ARMNice to have:Search: OpenSearch, Elasticsearch, SolrGraph: Cypher, SPARQL, Gremlin, graph ETLData Quality: Great Expectations, dbt tests, custom validatorsReal-time: Flink, Spark Streaming, Lambda, Cloud FunctionsMonitoring: Grafana, Datadog, CloudWatch

Wyświetlenia: 7
Opublikowana25 dni temu
Wygasaza około 2 miesiące
Rodzaj umowyB2B
Źródło
Logo

Podobne oferty, które mogą Cię zainteresować

Na podstawie "Data Platform Engineer (AWS)"

Nie znaleziono ofert, spróbuj zmienić kryteria wyszukiwania.