Senior Data Consultant

About the role

Bridge BSS Talent, a global provider of IT outsourcing and business support services, is hiring a Senior Data Consultant with 7+ years of experience in data engineering, machine learning and cloud computing. The consultant designs, builds and scales data platforms for global clients, combining hands-on data engineering and ML application with team leadership in an agile delivery model. The role is hybrid and based in Sri Lanka.

Key responsibilities

• Design, develop and optimise scalable ETL pipelines for structured and unstructured data
• Build and maintain big data processing workflows with PySpark, Scala and AWS EMR
• Develop data integration pipelines with Azure Data Factory, AWS Glue and similar tools
• Deploy machine learning models with Scikit-learn, TensorFlow and PyTorch
• Maintain data warehouse and analytics solutions with AWS Redshift, PostgreSQL, MySQL, MongoDB and S3
• Develop backend services and RESTful APIs with Python frameworks and Node.js
• Apply DevOps best practices with Docker, Jenkins, RabbitMQ, SonarQube, Celery and CI/CD pipelines
• Lead code reviews, mentor team members and support Proof of Concept (POC) initiatives
• Work with clients and stakeholders to deliver production-ready data solutions

Required profile

• 7+ years of professional experience in data engineering, with exposure to machine learning and cloud platforms
• Expert Python; working knowledge of JavaScript, Shell, Scala and TypeScript
• Strong experience with PySpark, Scala and distributed data processing on AWS EMR or similar platforms
• Experience with AWS (EMR, Lambda, S3, Redshift, EC2) and Azure Data Factory; GCP exposure is an advantage
• Knowledge of relational and NoSQL databases (PostgreSQL, MySQL, MongoDB, Redis)
• Experience deploying production applications with Gunicorn, Apache or NGINX
• Leadership, mentoring and stakeholder management skills; healthcare, pharmaceutical or fintech data platform experience is an advantage

Required skills

• Machine learning frameworks: Pandas, Scikit-learn, TensorFlow, PyTorch
• DevOps tools: Docker, Jenkins, SonarQube, Celery, RabbitMQ, CI/CD
• Cloud: AWS EMR, Lambda, S3, Redshift, EC2; Azure Data Factory