Senior Data Engineer (MLOps)

Senior Data Engineer / MLOps Remote, PolandB2B till August 160–180 PLN/hResponsibilitiesDesign & maintain end-to-end data & ML pipelines (Databricks Workflows, Delta Lake, Unity Catalog)Build reproducible training & deployment workflows (experiment tracking, model registry, artifact management)Implement data quality frameworks, observability metrics, dashboards (Lakeview, Grafana)Automate ingestion & feature pipelines via PySpark, SQL Warehouses, DAB within CI/CDManage security, access control & compliance in data/ML environmentsOptimize compute performance & cost (autoscaling, spot instances, caching, partitioning)Develop automated evaluation & validation pipelines (new telemetry, reproducibility, traceability)Maintain continuous model & data monitoring (drift, feature stability, prediction quality)Ensure environment consistency via IaC & containerization (Terraform)RequirementsSenior Data Engineer + solid MLOps backgroundAzure Databricks (Workflows, Delta Lake, Unity Catalog)PySpark, SQL Warehouses, production-grade pipeline developmentCI/CD (GitHub Actions / Azure DevOps)Monitoring tools (Lakeview, Grafana), ML observabilityData quality, drift detection, ML monitoringSecurity, access management & compliance in data/ML ecosystemsTerraform / IaC