Senior Data Software Engineer (Python, GCP)

Technologies we use

About the project

Your responsibilities

• Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST HTTP API, flat files, Streams, Time series data, SAP
• Research and utilize Big Data technologies for effective data ingestion
• Process and transform data using tools such as Spark and various Cloud Services
• Understand and execute project-specific business logic through programming languages supported by the primary data platform
• Optimize data retrieval, develop dashboards, and perform data validation
• Collaborate with diverse teams including data scientists, analysts, and IT professionals
• Provide thought leadership on Big Data best practices and technology trends
• Maintain and ensure integrity and security of big data sources and platforms
• Perform troubleshooting, debugging, and upgrading of big data systems and applications

Our requirements

• Bachelor’s degree in Computer Science, Mathematics or related technical field
• 5+ years experience in software development with Big Data technologies
• Advanced knowledge of Python, Scala, or Java
• Proficient with Spark and Databricks and/or Snowflake
• Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services
• Demonstrated experience with big data models, databases, and tools
• Strong understanding of different data file formats like JSON, Parquet, Avro
• Hands-on experience with SQL and NoSQL databases, including Cassandra and MongoDB
• Proficiency in data warehousing solutions, ETL processes
• Proven ability to work within a fast-paced, team-oriented environment
• Detail-oriented with excellent analytical and problem-solving skills
• Knowledge of software development methodologies and best practices
• Exceptional oral and written communication skills in English (B2+)

Optional

• Experience with Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN
• Experience with message queues, especially Kafka
• Production experience in search technologies such as Solr, OpenSearch, or Lucene

What we offer

• Engineering community of industry professionals
• Friendly team and enjoyable working environment
• Flexible schedule and opportunity to work remotely within Poland
• Chance to work abroad for up to 60 days annually
• Business-driven relocation opportunities
• Outstanding career roadmap
• Leadership development, career advising, soft skills, and well-being programs
• Certification (GCP, Azure, AWS)
• Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru
• English language classes
• Stable income (Employment Contract or B2B)
• Participation in the Employee Stock Purchase Plan
• Benefits package (health insurance, multisport, shopping vouchers)
• Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
• Referral bonuses
• Corporate, social and well-being events

This is how we work on a project

Development opportunities we offer

Benefits