Job description

Data Engineer – B2B Contract (Hybrid – Kraków or Warsaw)

Location: Hybrid – 6 days per month on-site (preferably Kraków or Warsaw)

Contract type: B2B

Workload: Full-time

We are looking for an experienced Data Engineer to join a team focused on data processing and analytics in the cybersecurity domain. This role involves designing and building robust data architecture and scalable data pipelines that power reporting, data analytics, and future machine learning models.

Key Responsibilities

• Design, build, and test multi-layered data architecture and efficient, scalable data pipelines.

• Perform deep analysis of large, complex datasets to extract insights and generate statistical metrics for business reporting and data estate assessment.

• Develop systems and software for data acquisition, aggregation, and refinement.

• Integrate data across various sources, systems, and platforms.

• Optimize query performance and overall data processing efficiency.

• Work on data ingestion, sourcing, aggregation, API integration, and feature engineering.

• Collaborate with stakeholders to align deliverables with business needs and better understand the data context.

• Write clean, reusable, and maintainable code using the team's DevOps practices.

• Follow Agile methodologies, including test-driven development (TDD).

• Continuously grow technical and domain-specific skills in collaboration with the team.

Requirements

• At least 12 months of hands-on experience with Spark, PySpark, and/or Databricks (or a comparable modern data platform).

• Strong hands-on experience with Python and SQL in end-to-end data engineering workflows.

• Experience building and maintaining data pipelines and ETL workflows across disparate datasets.

• Working knowledge of Azure DevOps, scripting (Azure CLI), Git/version control, and CI/CD processes.

• Practical experience with Databricks.

• Ability to communicate complex technical topics clearly and effectively to diverse audiences.

• A proactive, eager-to-learn attitude, especially regarding cybersecurity.

• Hands-on experience working within Agile teams.

What We Offer

• B2B contract and support of the Contractor Care Team
• Private Medical Care
• Cafeteria system
• Life insurance

Zapraszamy do odwiedzenia naszej strony www.antal.pl