Databricks Platform Engineer

About the role

Zurich Technology Delivery Center in Barcelona is looking for a Databricks Platform Engineer to own and evolve the Databricks platform that powers the Zurich Global Finance Data Hub. You will work in a collaborative, innovative environment focused on delivering scalable, secure, and cost‑efficient data solutions.

Key responsibilities

• Design, build and maintain data ingestion frameworks for batch, streaming, API and CDC patterns.
• Develop and manage Delta Live Tables pipelines with data quality controls and schema enforcement.
• Administer Delta Lake environments, including performance tuning, VACUUM and OPTIMIZE operations.
• Implement Unity Catalog governance, access controls and data lineage.
• Build and support Databricks Workflows for complex pipeline orchestration.
• Establish CI/CD pipelines using Git, Databricks Asset Bundles and promote code across environments.
• Collaborate with cloud teams to deliver Infrastructure as Code using AWS CloudFormation or CDK.
• Monitor platform health, performance and costs with CloudWatch, Grafana and Databricks system tables.

Required profile

• 5‑8 years of experience in data engineering, data platform engineering or cloud data architecture.
• At least 3 years of hands‑on experience managing Databricks platforms in enterprise settings.
• Strong background in AWS services (S3, IAM, networking, security).
• Experience with large‑scale data platforms in regulated industries, preferably financial services.

Required skills

• Databricks (Unity Catalog, Delta Lake, Delta Live Tables, Workflows, Asset Bundles)
• PySpark, Python, Databricks SQL
• Git, CI/CD pipelines, automated testing
• AWS CloudFormation or CDK, S3, IAM, VPC, PrivateLink
• Monitoring tools: CloudWatch, Grafana
• Airflow, Kafka/MSK (preferred)

What we offer

• Competitive salary, yearly bonus and stock options.
• Flexible working model with hybrid options and up to 25 days abroad per year.
• Home‑office setup allowance (300 €) and monthly home‑office stipend.
• Extensive training programmes, language courses and professional development.
• Health, life and accident insurance, retirement plan and referral bonus.