Technical Lead - Data Engineering

About the role

InTalent Asia is recruiting on behalf of its client in Sri Lanka for a Technical Lead - Data Engineering. The role leads the design, development and optimisation of large-scale data processing solutions for enterprise operations, providing technical leadership across data platforms, mentoring engineering teams and driving best practices in data architecture and software engineering.

Key responsibilities

• Lead the architecture, design and implementation of scalable data processing applications and enterprise data engineering solutions.
• Mentor Data Engineers and development teams and drive best practices in coding standards, code reviews and solution design.
• Develop and maintain ETL pipelines and data integration frameworks for business intelligence and analytics.
• Optimise data processing workflows, database performance and storage architectures.
• Drive CI/CD practices, troubleshoot production issues and work with DevOps and infrastructure teams on deployments.
• Contribute to Agile delivery, including sprint planning, estimation, backlog refinement and technical reviews.
• Work with Product Owners, architects, stakeholders and project teams to define technical solutions.

Required profile

• Bachelor's degree in Computer Science or equivalent; 5-6+ years of experience building enterprise data processing and integration solutions.
• Previous experience leading technical teams and mentoring engineers.
• Experience with distributed data processing frameworks and strong database development and optimisation.
• Agile Scrum experience and good understanding of DevOps, source control and CI/CD.
• Strong leadership, communication and stakeholder management skills.

Required skills

• Hands-on Apache Spark and large-scale ETL development.
• Database development and optimisation, preferably MySQL.
• Knowledge of design patterns, UML and enterprise architecture principles.
• Big Data technologies such as Hadoop, Elasticsearch, CouchDB or MongoDB are an advantage.
• Cloud platforms, particularly AWS, are an added advantage.