Senior Data Engineer

Cient is developing a system of record for the diamond supply chain. A critical part of this is the diamond matching project.We are seeking a Data Engineer to own and architect the end-to-end reporting lifecycle, that’s still in an early MVP stage. You will inherit a replicated production environment and be responsible for transforming raw Python application data into a high-performance analytics layer. You will bridge the gap between backend data structures and business-ready visualizations.Advanced SQL knowledge (window functions, CTEs, optimization queries)Advanced knowledge of Data Build Tool (dbt) (or similar)Working knowledge of code versioning and peer code reviewing process.Working knowledge of deduplication and normalization strategiesWorking knowledge of Cloud infrastructureWorking knowledge of Python coding principles and data librariesKnowledge of ORMs such as SQLAlchemyExtra points forKnowledge of ML tooling, such as MLFlow and Sagemaker.Experience with AWS.What you'll be doing:Building and maintaining a robust, end-to-end data and analytics platform.Developing and optimizing data pipelines to move data from online environments to the data warehouse and reporting layers.Writing high-quality, production-ready code in SQL and Python, utilizing libraries such as pandas and SQLAlchemy.Troubleshooting and resolving issues related to cloud data configuration, synchronization, and data latency.Managing and processing diverse data types, including both structured and unstructured data, such as JSONB.Designing, deploying, and maintaining automated business intelligence dashboards and internal monitoring tools.