Technical Lead – Data Engineering

About the role

The company is seeking a senior Technical Lead to drive complex data engineering initiatives across GCP and AWS environments. You will own the full lifecycle of multi‑source ingestion, transformation, and delivery while guiding a team of data engineers.

Key responsibilities

• Translate business requirements into epics, user stories, and technical specifications.
• Design and develop cost‑effective data models, pipelines, and AI‑accelerated features.
• Perform impact analysis, optimise BigQuery/Redshift queries, and tune Spark/Dataflow jobs.
• Integrate AI‑driven monitoring, automated error‑triage agents, and pipeline orchestration tools.
• Manage secure, multi‑environment cloud infrastructure using Terraform and CloudFormation.
• Lead FinOps activities to optimise cloud spend and reduce cost waste.
• Drive adoption of engineering standards, automated testing, and CI/CD pipelines.
• Oversee incident response, RCA investigations, and on‑call support.

Required profile

• Bachelor’s degree in Computer Science or equivalent with 6+ years of data engineering experience.
• At least 2 years of experience leading engineering teams in an Agile/Scrum environment.
• Strong communication skills and ability to work with cross‑functional stakeholders.

Required skills

• Python, SQL, Shell scripting
• Medallion architecture, dimensional modeling, real‑time streaming
• GCP services (BigQuery, Dataflow, GKE, Cloud Run, IAM)
• AWS services (S3, Lambda, IAM)
• BigQuery, Redshift, Spark, Terraform, CloudFormation
• CI/CD, DevOps, FinOps fundamentals
• AI‑assisted operational tools and monitoring agents