Technical Lead - Data Engineering

About the role

A large corporation involved in the marketing and distribution of food products is looking for a Technical Lead in Data Engineering. The role covers the design and development of large-scale data processing solutions, working with agile cross-functional teams and guiding database design and optimization.

Key responsibilities

• Design and develop large data processing solutions.
• Work with agile cross-functional teams and guide database design, query optimization and database optimization while following DevOps principles.
• Design and develop capacity and scalability plans for fast-growing data infrastructure.
• Follow continuous integration and continuous delivery, ensuring high code quality through software engineering best practices.
• Take part in projects across the full software lifecycle, from development and QA to deployment and post-production support.

Required profile

• Bachelor's degree in computer science or equivalent, and 5 to 6+ years of experience developing production enterprise applications, data integration solutions and managing teams.
• Excellent communication and leadership skills.
• Experience with large volumes of data and distributed processing frameworks (Apache Spark preferred).
• Experience designing and developing ETLs for large volumes of data.
• Experience with large relational databases (MySQL preferred).
• In-depth knowledge of database design and optimization (OLAP/OLTP, query plan analysis) and software engineering methods (UML, design patterns).

Required skills

• Preferred: hands-on experience with NoSQL databases and big data (Hadoop, Elasticsearch, CouchDB, MongoDB).
• Preferred: Scrum Agile delivery, DevOps, and cloud IaaS/PaaS (e.g., AWS).