AI Platform Engineer

About the role

BASF Digital Hub Madrid is looking for an AI Platform Engineer to own the technical vision and architecture of its Internal Developer Platform's AI capabilities. You will shape the AI roadmap, set technical standards, and ensure the platform serves both humans and autonomous agents at enterprise scale.

Key responsibilities

• Define and evolve the AI architecture for the AI Gateway, agentic services, retrieval pipelines, and platform‑AI integration points.
• Produce architecture decision records (ADRs) and RFCs, and guide technology selection and build‑vs‑buy decisions.
• Design reusable building blocks, SDK/API surfaces, and versioned interfaces for multi‑tenant use.
• Establish evaluation frameworks, golden tests, and controls for grounding and hallucination.
• Shape MLOps/LLMOps practices, including prompt/version management and CI/CD for AI artefacts.
• Implement observability, cost‑tracking, RBAC, and compliance with EU AI Act and OWASP LLM Top 10.
• Mentor engineering team members and represent AI architecture to stakeholders and external partners.

Required profile

• 7+ years of software/platform engineering experience, including 2‑3 years in technical leadership or architecture.
• Recent hands‑on experience with generative AI, LLMs, RAG architectures, and agentic patterns.
• Strong system design skills for distributed, multi‑tenant platforms.
• Proven ability to create evaluation frameworks for LLM/RAG systems.

Required skills

• Python (FastAPI, Pydantic, async)
• Azure cloud services, Kubernetes/AKS, Docker, Terraform (HCL)
• PostgreSQL, Azure AI Search (vector store)
• LLM providers: OpenAI, Anthropic, Mistral, Azure AI Foundry, Databricks
• Authentication/authorization, RBAC, tenant isolation, OWASP LLM Top 10, EU AI Act compliance
• Experience with Grafana, MLflow, RabbitMQ, Azure Event Grid (nice to have)

What we offer

• Secure work environment with health, safety and wellbeing priority
• Flexible work schedule and home‑office options
• Learning and development opportunities
• 25 holiday days plus 5 additional days
• Collaborative, innovative international team
• Relocation assistance to Madrid