Requirements

Expected technologies

Java

Python

ETL

Kafka

Oracle

Optional technologies

Scala

Employer requirements

• 6+ years of experience in an IT, preliminary on hands on development,
• strong knowledge of architectural principles, frameworks, design patterns and industry best practices for design and development,
• strong hands on experience with programming languages - Java, Scala or Python,
• 4+ years’ real project experience as a data wrangler/engineer across design, development, testing, and production implementation for Big Data projects, processing large volumes of structured/unstructured data,
• strong hands-on experience with Snowflake, Spark and Kafka,
• experience with Oracle database engine with PL/SQL and performance tuning of SQL Queries,
• experience in designing efficient and robust ETL/ELT workflows and schedulers,
• communication skills - both written and verbal, strong analytical and problem-solving skills,
• experience working with Git, Jira, and Agile methodologies,
• very good English.

Your responsibilities

• facilitate the establishment of a secure data platform on OnPrem Cloudera infrastructure,
• document and develop ETL logic and data flows to facilitate the easy usage of data assets, both batch and real-time streaming,
• leverage the following (but not limited to) components of Cloudera distribution to achieve project objectives: Sqoop, Hive, Impala, Spark,
• consistent practice in coding and unit testing,
• work with distributed teams.