Senior Data Engineer at Appodeal, responsible for building data pipelines, optimizing data architecture, collaborating with teams. Requires 3-5+ years experience, Python expertise, knowledge of data frameworks.
Słowa kluczowe
data engineering
ETL
Apache Spark
Python
ClickHouse
Druid
AWS
Benefity
Ciągłe uczenie się i rozwój
Zabawa w pracy
Współpraca z zespołem światowej klasy
What you will do
Senior Data Engineer
Appodeal is a dynamic US-based product company with a truly global presence.
We have offices in Warsaw, Barcelona and Virginia along with remote team members located around the world.
Our company thrives on diversity, collaboration, and innovation, making us a leader in the mobile app monetization space.
We are seeking a skilled Data Engineer to join our MGP UA team in Barcelona. The ideal candidate will be responsible for building, maintaining, and optimizing our data infrastructure, ensuring seamless data flow and accessibility for ML and DA, analytical and business needs.
Key Responsibilities
Design and build scalable data pipelines: Architect, construct, and maintain robust ETL/ELT pipelines using the Databricks platform (Apache Spark, Delta Lake, Delta Live Tables) for batch and streaming data ingestion from various sources.
Manage data architecture: Define and maintain a scalable and secure data platform architecture that integrates Databricks (for data lakehouse management and complex transformations) with specialized OLAP engines (ClickHouse/Druid for fast querying).
Design, develop, test, and orchestrate data workflows to streamline pipelines.
Optimize performance and reliability: Monitor, troubleshoot, and fine-tune data workflows and database performance (e.g., Spark job optimization, ClickHouse schema tuning, Druid data partitioning) to ensure maximum efficiency and reliability.
Contribute to the development of internal tools for automating data processes and business workflows, enhancing efficiency and scalability.
Collaborate closely with product, MLOps and data science teams to ensure an optimal data experience for all ML practitioners and data consumers.
What we offer
At Appodeal, we’re more than just a company—we’re a team united by a common mission: to help every person discover and grow their talents!
We take pride in our cutting-edge product and our internationally dispersed team of talented professionals.
Here’s what we value, and what we hope you do too:
Continuous Learning and Growth: We are passionate about learning, growing personally, and building rewarding careers.
Making an Impact: We are committed to building a history-defining company that leaves a lasting impact on the mobile app industry.
Solving Exciting Challenges: We tackle complex problems every day, supported by a team of world-class professionals and mentors.
Enjoying the Journey: We believe in having fun while working toward our goals.
With an outstanding product and a mission that excites and inspires, Appodeal offers a unique opportunity to make an impact while being part of an amazing team.
Join us and help shape the future of mobile app success!
Requirements
Requirements
3-5+ years of professional work experience in data engineering.
Strong expertise in Python and common data frameworks (Pandas, PySpark).
Experience with modern data storage solutions: Data lakes (Delta tables), and data warehouses.
Experience with data orchestration tools (Dagster, Airflow).
Experience with streaming technologies (Kafka, Spark structured streaming).
Experience with cloud platforms (AWS S3, EC2 etc.)
OLAP Databases: Hands-on experience with ClickHouse and/or Apache Druid for real-time analytics and low-latency data serving.
Strong problem-solving skills and ability to excel in a fast-paced startup environment
Based in Barcelona or ready to relocate to Barcelona.
Nice to have
Experience with Databricks platform.
Experience in building ML data platforms.
Zaloguj się, aby zobaczyć pełne szczegóły
Utwórz darmowe konto, aby uzyskać dostęp do pełnego opisu oferty i zaaplikować.
Wyświetlenia: 6
Opublikowana
19 dni temu
Wygasa
za 11 dni
Źródło
Podobne oferty, które mogą Cię zainteresować
Na podstawie "Senior Data Engineer"
Nie znaleziono ofert, spróbuj zmienić kryteria wyszukiwania.