Senior Data & AI Engineer (m/f/d)

About the role

BASF Digital Solutions S.L., part of BASF SE, is hiring a Senior Data & AI Engineer in Madrid for its digitalization unit. The role works in an international team with English as the working language, in an agile Scrum team, and offers a hybrid work model.

Key responsibilities

• Build data and AI pipelines for document processing in a micro-batch architecture
• Collaborate with subject matter experts to understand requirements
• Design and implement data extraction and retrieval solutions, using modern AI methods where appropriate
• Introduce new technologies to deliver reliable and cost-efficient services
• Contribute to AI-powered search and knowledge platforms, including multimodal retrieval and knowledge extraction

Required profile

• Degree in computer science, software engineering, mathematics or similar
• Experience building and operating production-grade big data pipelines on Databricks
• Experience applying AI/ML and NLP techniques for information extraction, retrieval or knowledge discovery
• Hands-on expertise with Apache Spark (PySpark/Scala), including performance tuning, data skew handling and efficient cluster usage
• Solid Python programming skills
• Fluent English
• Nice to have: Azure Data Factory, Kubernetes, cloud storage (Storage Accounts, ADLS2), multimodal document processing and LLM benchmarking

Required skills

• Modern LLM-based RAG architectures, embeddings and vector search
• ElasticSearch / OpenSearch
• Azure cloud, Azure DevOps and CI/CD pipelines

What we offer

• Flexible work schedule and home-office options
• Learning and development opportunities
• 23 holiday days plus 5 additional days and 2 cultural days
• Relocation assistance to Madrid