Senior Data Engineer

About the role

We are looking for a Senior Data Engineer to design, develop and optimise large‑scale data pipelines. You will work in a fully remote setting while collaborating with cross‑functional teams to deliver reliable data solutions on Microsoft Azure.

Key responsibilities

• Design, develop and optimise large‑scale data pipelines using Apache Spark and Python/PySpark.
• Create reliable, reusable datasets for business and analytical consumption.
• Develop and maintain cloud‑based data solutions on Microsoft Azure, including Azure Databricks.
• Implement data quality controls, validation, monitoring and documentation standards.
• Collaborate with Data Engineering, Data Science, Architecture and business teams to understand requirements.
• Contribute to engineering best practices such as code quality, testing, CI/CD and automation.
• Apply data governance, cataloguing and quality monitoring to ensure trusted data assets.

Required profile

• 5+ years of experience in Data Engineering.
• Hands‑on experience with Apache Spark using Python/PySpark in production.
• Proven experience building and maintaining production‑grade pipelines in large or complex ecosystems.
• Strong understanding of dimensional modelling and data‑warehouse design.
• Experience designing scalable cloud‑based data architectures.

Required skills

• Apache Spark
• Python / PySpark
• Microsoft Azure
• Azure Databricks
• Databricks, Delta Lake, Unity Catalog
• Data governance and cataloguing frameworks

What we offer

• Permanent contract with flexible remote work model.
• Flexible hours and intensive Fridays.
• 22 vacation days plus personal days and holidays.
• Flexible compensation including restaurant card, childcare voucher, health insurance and training benefits.
• Perks club with discounts on technology, leisure and training.
• Continuous training via Udemy Business, language courses and certifications.
• Career development support and well‑being programmes.