Project Background

SAS UK’s BigData platform is the largest in scope, hosting 5+ PiB of data and 250,000+ SAS programs. It supports critical finance and compliance workloads. Due to high complexity and delays, a dedicated Engineering POD is required to accelerate delivery.

Scope

• File rationalization and conversion (Parquet, Altair WPD)

• Partitioning and loading large datasets (Hive, Teradata, PostgreSQL)

• Development and validation of migration pipelines

• Setup of parallel run and production environments with data sync

Key Responsibilities

• Define and lead the end-to-end testing strategy for BigData / SAS SPDE migration

• Design and execute tests for data conversion and pipeline validation

• Coordinate with engineering teams and manage defect lifecycle

• Collaborate with stakeholders (tenants, ITSOs, architecture, network, vendors)

• Support user onboarding and training

Location: Krakow preferred (other cities can be consider as well, however candidate has to be ready to travel to client's office in Krakow min once a month)

Required Skills

• Expertise in BigData and data platform testing

• Strong knowledge of:

  • OS: Linux, shell scripting

  • Storage: Hadoop/HDFS, S3/VAST, Teradata, PostgreSQL

  • Formats: Avro, ORC, Parquet (SPDE a plus)

  • Table Formats: Delta, Iceberg

  • Engines: Hive, Spark (Starburst/Databricks a plus)

  • Languages: SAS, Python

  • Automation: large-scale data pipelines

  • Other: DML, partitioning, Altair SLC

• Self-starter with strong communication skills, English C1

Nice to Have

• Experience with Altair tools and vendor coordination

• Familiarity with SAS Macros, DI, DI Studio, and stored processes .