Data Engineer I – Cloud & Scalable Data Platforms
Circles · Colombo
Job description
About the role
We are looking for an experienced Data Engineer to design, develop, and support scalable data platforms and pipelines. The role works closely with product, analytics, and platform teams to deliver reliable, cloud‑native data solutions across multiple markets.
Key responsibilities
- Develop and optimise batch and streaming data pipelines using Python, Spark/PySpark and SQL.
- Build and maintain cloud‑native data platforms such as data lakes, warehouses and real‑time processing systems.
- Take end‑to‑end ownership of data initiatives, from solution design and testing to deployment, performance tuning and production support.
- Collaborate with product managers, analytics, and engineering teams to translate business requirements into high‑quality data solutions.
- Monitor platform health, troubleshoot production issues and continuously improve reliability.
Required profile
- At least 1 year of experience in data engineering or big‑data environments.
- Strong experience designing scalable ETL/ELT pipelines with Python, Spark/PySpark and SQL.
- Hands‑on experience with modern data‑lakehouse technologies (e.g., Apache Iceberg, Hive, Trino, BigQuery, Redshift, ClickHouse, Snowflake).
- Familiarity with cloud object storage such as Amazon S3 or compatible platforms.
- Excellent analytical, problem‑solving and communication skills.
Required skills
- Python
- Spark / PySpark
- SQL
- Apache Iceberg, Hive, Trino, BigQuery, Redshift, ClickHouse, Snowflake
- Amazon S3 (or compatible object storage)
- Kubernetes
- Docker
- GitLab CI/CD
- Apache Kafka (good to have)
- MySQL, Oracle (RDBMS)
- MongoDB (optional)
- SQLAlchemy, PyMongo
- LangGraph, MLOps (LLM‑based applications)
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Sri Lanka.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 month ago
Expires 1 week from now
54 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Circles
Colombo
Related job offers
-
Senior QA Automation Engineer (Playwright)
Gallagher Colombo -
Senior QA Engineer - Playwright Automation
GSS HR Solutions Private Limted Colombo -
Senior QA Engineer (AI Testing)
Gallagher Colombo -
IT Procurement Executive (Night Shift)
TECEZE District de Jaffna -
Senior QA Lead - Banking Integration & Migration Testing
Schemax Export Techno Craft Pvt. Ltd Province de l'Ouest