Data Engineer (Short-Term Project)

The ideal profile is a Data Engineer with experience in Apache Spark and AWS technologies (Lambda, EC2, RDS, etc.), as this role encompasses more than just a data platform. This position is well-suited for a mid-level professional with some experience and a strong willingness to learn.

Main Responsibilities:

Designing and implementing data processing systems using Apache Spark.

Managing data workflows and ensuring data quality.

Collaborating with data architects and data scientists to optimize data usage.

Utilizing AWS services for data storage and analysis.

Monitoring and troubleshooting data pipeline issues.

Documenting technical processes and design specifications.

Key Requirements:

Proven experience with Apache Spark.

Proven experience with AWS technologies (Lambda, EC2, RDS).

Strong problem-solving skills.

Data modeling and database skills.

Experience with Python.

Excellent communication and teamwork abilities.

Nice to Have:

Experience with data visualization tools.

Knowledge of machine learning workflows.

Familiarity with ETL processes.

Other Details:

Short-Term Project (3 months).

Full remote position.

English level - advanced (C1 Level).