Data Engineer

About the role

AVEVA is seeking an experienced Data Engineer to join its Data Science & AI team in Madrid. You will design, build, and maintain scalable data pipelines and architectures that support advanced analytics, machine learning, and AI agent development across the company.

Key responsibilities

• Design, develop, and maintain robust, scalable data pipelines.
• Build and manage data architectures, models, and lakehouse solutions.
• Ensure data quality, governance, and security standards are met.
• Collaborate with data scientists, AI engineers, and business stakeholders.
• Optimize data processing for performance and cost‑efficiency.
• Integrate multiple data sources using Microsoft tools (Power Automate, Logic Apps, Azure Data Factory).
• Implement best practices for version control, CI/CD, and data engineering.
• Support AI agents and automation workflows.

Required profile

• 5+ years of professional experience in data engineering.
• Strong background in Python and SQL.
• Hands‑on experience with Spark, Databricks, and Azure services.
• Proven ability to design ETL/ELT pipelines and data models.
• Experience with Git, CI/CD pipelines, and data governance frameworks.

Required skills

• Python
• SQL
• Apache Spark
• Databricks (including Unity Catalog)
• Microsoft Azure (Azure Data Factory, Power Automate, Logic Apps)
• Data modeling and warehousing
• Lakehouse architecture
• MLOps concepts
• Streaming technologies
• Git
• CI/CD
• Power Platform (Power Apps, Power BI)