Must have

• AWS

• Python

• pandas

• PySpark

• CI/CD

• IaC

• English (B2)

Nice to have

• Hadoop

• Spark

• Scala

Requirements description

• Orchestration services : Step function, Event-Bridge, Airflow (MWAA), Lamda
• Processing: Glue, EMR, EKS
• Storage Service: S3
• Querying and Analysis services: Athena
• Big data ETL development and frameworks using : PySpark with Python or/and Spark with Scala (nice to have)
• Experience with working with Python/Pandas transformation
• Experience with Hadoop Ecosystem: Hive, Impala, Sqoop, HDFS, Oozie (nice to have)
• Knowledge of CI/CD Pipeline (Jenkins) and Infrastructure as a code (Terraform)

Offer description

The client is embarking on an ambitious program of work to deliver a number of generative and predictive AI models to optimize the work for hundreds of people in Group Financial Crime Prevention. While we are an established and mature IT organization, working in our AI program is going to feel more like a startup! We are experimenting with methods and tooling and are seeking a number of experienced Devops engineers to help facilitate the build and deployment of our Generative AI applications.