Requirements

Expected technologies

Scala

Apache Spark

Apache Hadoop

Yarn

Sqoop

Hive

IMPALA

MapReduce

Oozie

SQL

Git

Jenkins

Bamboo

Ansible

Linux

Shell

Bash

Oracle

Java

Optional technologies

Apache Flink

Apache Kafka

AWS

Microsoft Azure

Python

Grafana

Prometheus

ELK Stack

Elasticsearch

Logstash

Kibana

Jupyter

zeppelin

Docker

Kubernetes

Terraform

Anible

Apache Airflow

NiFi

Google Cloud Platform

Operating system

Linux

Our requirements

• At least 3 years of experience with Java 8+ and/or Scala
• Hands-on experience with Apache Spark
• Proficiency in SQL and Linux Shell scripting
• Solid knowledge of the Hadoop ecosystem, including: YARN, Sqoop, Hive, Impala, MapReduce, Oozie, etc.
• Version control and CI/CD tools such as Git, Ansible, Bamboo, or Jenkins
• Strong understanding of data processing and distributed computing principles
• Fluent English
• Residing in Poland required

Optional

• Experience with functional programming principles (Scala preferred)
• Exposure to real-time streaming technologies, such as Apache Flink or Apache Kafka
• Familiarity with data analysis and data modelling
• Understanding of the SAFe Agile framework and Agile delivery principles
• Experience with cloud environments (AWS, Azure, or GCP)
• Familiarity with Python for data manipulation or automation tasks
• Knowledge of monitoring and logging tools (Grafana, Prometheus, ELK stack)

Your responsibilities

• Design, develop, and maintain data pipelines and applications using Hadoop and related Big Data technologies
• Work closely with architects, analysts, and other developers to deliver high-quality, scalable solutions
• Participate in system design reviews, requirement refinements, and technical discussions
• Optimize existing processes for performance, scalability, and reliability
• Ensure code quality through testing, code reviews, and adherence to best practices
• Collaborate within the Scrum/SAFe team to deliver business value incrementally and continuously