Data Engineer

About the role

As a Data Engineer at Lighthouse you will be a key player in the end‑to‑end lifecycle of a large‑scale ingestion and transformation engine, designing, developing, scaling and maintaining data pipelines that process up to 100 TB of data per day. The role blends greenfield development of new pipelines with improving the stability and quality of existing ones.

Key responsibilities

• Design, build, and deploy scalable data pipelines that ingest data from APIs, Webhooks and Cloud Storage.
• Implement complex domain modelling and transformation logic to create high‑fidelity data products.
• Transition legacy processes into modern, scalable and stable data architectures.
• Own support and troubleshooting of live integrations, diagnosing issues and communicating with stakeholders during incidents.
• Improve reliability and quality of pipelines through advanced observability, automated testing and automation.

Required profile

Required skills

• Experience with APIs
• Experience with Webhooks
• Experience with Cloud Storage platforms