Senior Data Engineer

Mode: RemoteContract: B2BSummary: The Senior Data Engineer role is crucial for enhancing data products, focused on improving data management processes to support patient care and organizational goals.Responsibilities:Collaborate with cross-functional teams to design, develop, and maintain data pipelines and analytics solutions.Design and build a foundational platform for a modern data lake architecture, optimizing it for scalability, flexibility, and performance.Develop automated tests to ensure data accuracy and quality.Continuously secure improvement to enhance developer efficiency and act as a sparring partner on the use of Azure services for the organization.Leverage cloud development expertise to design and implement digital solutions focused on business insights and patient care.Key Requirements:Extensive experience with Azure, Azure Databricks, and a deep understanding of Azure architecture and services.Strong proficiency in Python programming.Experience using Spark, including Spark SQL, with an understanding of how to optimize Spark performance.Automated unit testing and code quality inspection experience.Experience with CI/CD (GitHub actions / Azure DevOps).Familiarity with AWS.Experience in the pharma domain or other regulated areas.Nice to Have:Proven ability to work in a collaborative team environment.Willingness to receive and act on feedback for personal and professional growth.Fluency in English, both written and spoken.Other Details:Team Structure - Collaborative team focused on innovation in patient care.