Requirements

Expected technologies

Python

Apache Spark

PySpark

SQL

Optional technologies

Kubernetes

Microsoft Azure

Next.js

FastAPI

Our requirements

• Expertise in Python and Apache Spark (PySpark) for large-scale data processing
• Strong skills in SQL for complex data querying and reporting
• In-depth experience with Databricks, focusing on Jobs and Unity Catalog
• Familiarity with data formats (e.g., JSON, Parquet, Avro) and data serialization
• Proficiency in designing and interacting with APIs and other interfaces
• Fluent in English with excellent communication skills
• Analytical and structured working style with a strong process orientation
• Ability to translate complex technical concepts for non-technical stakeholders
• Team player with a proactive, hands-on mindset
• German skills (B2 or higher)

Optional

• Experience with Kubernetes
• Experience with Microsoft Azure
• Experience with web frameworks (e.g., Next.js, FastAPI)

Your responsibilities

• Lead Pipeline Development & Operations
• Design, maintain, and optimize ETL pipelines for lead generation and exports using Databricks
• Manage simple and complex filtering rule
• Data Analysis & Quality Assurance
• Monitor lead quality through dashboards and key performance indicators
• Analyze feedback from sales teams and implement improvements
• Process Documentation & Optimization
• Document and visualize existing workflows
• Identify and eliminate bottlenecks and redundant steps
• Cross-Functional Collaboration
• Collaborate closely with sales, IT, and data engineering teams
• Facilitate regular communication to ensure seamless operations
• Scalability & Automation
• Develop and implement scalable lead export solutions
• Automate recurring tasks and standard processes