Big Data Developer

About the role

Talan Spain is looking for a Mid-Level Big Data Developer to join the Client Contribution Platform team. You will develop, maintain and optimise large-scale data processing solutions, ensuring high performance, scalability and data quality. You will work closely with technical and business stakeholders in an Agile environment.

Key responsibilities

• Design, develop and maintain ETL and data transformation processes.
• Build, optimise and support Spark-based data pipelines.
• Develop scalable data processing solutions in a Big Data environment.
• Integrate data from multiple sources while ensuring data quality and consistency.
• Analyse, troubleshoot and resolve data-related issues.
• Optimise data performance and processing efficiency.
• Collaborate with cross-functional teams to gather and refine business requirements.
• Participate in Agile ceremonies and continuous improvement initiatives.
• Follow DevOps and CI/CD best practices throughout the development lifecycle.

Required profile

• 3+ years of experience in software development and data engineering.
• Experience with Spark-based platforms such as Azure Databricks, Amazon EMR, Cloudera, Apache Hive or similar.
• Experience with Qlik Sense reporting and dashboard development.
• Familiarity with Agile and DevOps practices.
• Experience with Git, GitHub, SonarQube and Nexus.
• B2+ English level or above.

Required skills

• Strong SQL (ANSI SQL, Hive SQL, Spark SQL or equivalent).
• Hands-on experience with Apache Spark and Scala, Python or Java.
• Strong analytical and problem-solving skills.

What we offer

• Nice to have: interest in AI-assisted development tools and knowledge of AI-driven data engineering approaches.
• Permanent, full-time contract with career development opportunities.
• Exposure to large-scale financial IT systems and cross-country operations.
• Training opportunities in finance, technology and data management.