
Data Engineer with GCP
emagine Polska
Status
Hexjobs Insights
Data Engineer with GCP role focuses on designing data architectures on Google Cloud. Responsibilities include building data pipelines, optimizing workflows, and integrating ML models. Requires GCP and Python experience.
Słowa kluczowe
Language: English (fluent), German (nice to have)Start date for assignment: ASAPDuration: 6 months + extensions Workload: Full-timeLocation: 100% remoteSummaryThe role focuses on enhancing data-driven personalization for strategic digital products. The primary objective is to design and implement scalable data architectures on Google Cloud to improve user engagement, retention, and monetization through relevant content delivery.Main ResponsibilitiesDesign and implement scalable data pipelines using Google Cloud technologies (e.g., BigQuery, Dataflow, Pub/Sub).Develop and optimize both batch and streaming data pipelines for personalization use cases.Transform and provision user and content-related data for machine learning applications.Implement data quality checks and establish logging and monitoring mechanisms.Optimize existing data processing workflows for improved performance.Integrate machine learning models into production workflows.Document data structures, transformation logic, and relevant interfaces.Provide technical consulting on event structures, tracking, and data architecture within the personalization framework.Key RequirementsExperience with Google Cloud Platform (GCP).Proficient in Python and FastAPI.Strong skills in dbt, SQL, and BigQuery.Familiarity with data pipeline frameworks like Airflow.Understanding of Kubernetes and Docker for containerization.Nice to HaveExperience with Vertex AI for machine learning initiatives.Knowledge of Terraform for infrastructure as code.Experience with CI/CD practices, particularly in GitLab.Familiarity with project tracking tools like JIRA and Confluence.Other DetailsTeam: Personalization Team in a digital product context.Environment: Data-driven and cloud-centric.Collaboration Tools: Microsoft Teams and Projektron Time Recording.
| Opublikowana | 17 dni temu |
| Wygasa | za około 2 miesiące |
| Źródło |
Podobne oferty, które mogą Cię zainteresować
Na podstawie "Data Engineer with GCP"
Nie znaleziono ofert, spróbuj zmienić kryteria wyszukiwania.