Senior Data Engineer - AWS & Databricks

About the role

HOLCIM Group is looking for a Senior Data Engineer in Madrid to design, build and optimise its next-generation data platform. The role covers architecting scalable data pipelines, managing large-scale distributed systems and keeping the AWS and Databricks data infrastructure robust and efficient. It suits a Spark expert who understands the AWS ecosystem and enjoys automation.

Key responsibilities

• Design and implement complex batch and streaming ETL/ELT pipelines in Python, SQL and Spark
• Build scalable, secure and cost-effective data solutions with AWS Data Analytics services
• Manage and automate data workflows with Airflow, and deploy containerised apps with Docker and ECS
• Monitor and tune Spark cluster performance for high availability and low latency
• Use CloudFormation or Terraform to manage infrastructure as code
• Optimise AWS spend through instance selection and storage strategy
• Implement IAM roles, bucket policies and KMS encryption for security and compliance
• Work in an Agile framework with Data Scientists and stakeholders

Required profile

• Minimum 4 years of hands-on experience in active Big Data environments and 2+ years in AWS data analytics
• Degree in Computer Science, Engineering, Mathematics or a related field, or equivalent practical experience
• Excellent written and spoken English, able to explain technical concepts to non-technical people

Required skills

• Spark, Python and SQL at expert level
• AWS EMR, Glue, S3, Redshift, Athena, MWAA, Lambda, Kinesis or MSK
• Airflow, Docker, ECS, Git, CI/CD and automated testing
• Delta Lake and lakehouse patterns (bronze/silver/gold layers)
• Preferred: Flink, Kafka, Java, QlikView/QlikSense, OpenShift, GitHub Actions, Jenkins, AWS/Databricks certifications