Big Data Developer (Relocation to Spain)

About the role

Talan, an international consulting group focused on innovation and business transformation through technology, is looking for a Big Data Developer to join an Agile environment and work on the design, development and evolution of data lake solutions for Market Risk use cases. You will build large-scale data processing pipelines and help ingest, transform, validate and publish critical data. The position is full-time, permanent and 100% remote.

Key responsibilities

• Design, develop and maintain data lake pipelines using Apache Spark, Scala and SQL.
• Build and maintain scalable data processing solutions for large volumes of data.
• Orchestrate batch workflows and dependencies with tools such as Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication processes for Market Risk use cases.
• Analyse and optimise the performance, reliability and scalability of Spark-based workloads.
• Analyse technical and functional requirements, identify gaps and propose solutions.
• Contribute to delivery planning and work with Agile squads, functional teams and production support teams.
• Support production incidents, perform root-cause analysis and help improve operational processes.

Required profile

• 2+ years of professional experience in Big Data, Data Lakes or cloud-based data platforms.
• Strong hands-on experience with Apache Spark, Scala and SQL for large-scale data processing.
• Good understanding of data lake architecture, data quality controls, data lineage and production-grade pipelines.
• Strong analytical and problem-solving skills, and excellent communication and teamwork skills.
• C1-level English or equivalent professional fluency; Spanish is a plus.

Required skills

• Apache Spark, Scala, SQL
• Nice to have: Control-M, Airflow, Databricks, Azure, AWS, YARN, CI/CD tools (GitHub, Jenkins, SonarQube), banking production environments and ServiceNow
• Nice to have: knowledge of Market Risk processes (P&L, valuations, risk metrics, regulatory reporting)

What we offer

• Permanent full-time remote employment.
• Professional growth and continuous learning.
• A multicultural, international team.
• Private medical insurance, life insurance, lunch and transport cards, online language classes and a Smart Office Pack.