Databricks Data Architect

About the role

Devoteam is looking for a Databricks Data Architect to design, implement and optimise Databricks-based data architectures for its clients' data architecture, platform modernisation and digital transformation projects. You will work with the Databricks Data Intelligence Platform, building Lakehouse solutions across cloud and multi-cloud environments that support advanced analytics, data engineering and artificial intelligence.

Key responsibilities

• Design and implement Lakehouse and Delta Lake architectures across cloud and multi-cloud environments.
• Develop and optimise ETL/ELT pipelines using Apache Spark, Structured Streaming and Lakeflow Declarative Pipelines.
• Implement data governance, security and lineage frameworks using Unity Catalog, and define AI governance mechanisms using Unity Gateway.
• Set up environments for Machine Learning, Generative AI and advanced analytics using MLflow and Databricks Genie.
• Optimise Databricks platform performance and costs with FinOps best practices.
• Take part in data platform modernisation and migration projects towards Lakehouse architectures.
• Advise clients on Databricks best practices and work with technical and business teams.

Required profile

• Strong experience in data architecture and designing Databricks-based solutions.
• Degree in Computer Science, Information Systems or equivalent professional experience.
• Fluent English and Spanish, written and spoken.
• Nice to have: experience with Lakeflow, MLflow, Genie or Unity Gateway; knowledge of Generative AI and Machine Learning; experience migrating legacy platforms to Databricks; knowledge of FinOps; Databricks Data Engineer Professional certification or Platform Architect accreditation.

Required skills

• Apache Spark, Delta Lake, Unity Catalog and Photon
• Azure, AWS or GCP
• ETL/ELT pipeline design and Lakehouse architecture
• Data governance, performance optimisation and cloud infrastructure, networking, storage and IAM security

What we offer

• Competitive salary based on experience and an annual performance bonus.
• Flexible compensation package including transport, childcare, training, health insurance and meal benefits.
• Employee benefits such as discounts, physiotherapy and free English classes.
• Career development through training, certifications and annual performance reviews.
• 100% remote working model.