Data Engineer I – Cloud Data Platforms

About the role

We are looking for an experienced Data Engineer to design, develop, and support scalable data platforms and pipelines. The ideal candidate will have extensive experience with modern cloud‑based data platforms, distributed data processing, Kubernetes, and data warehousing technologies.

Key responsibilities

• Develop and optimize scalable batch and streaming data pipelines using modern data engineering technologies.
• Build and maintain cloud‑native data platforms, including data lakes, data warehouses, and real‑time data processing systems.
• Take end‑to‑end ownership of data engineering initiatives, covering solution design, development, testing, deployment, performance tuning, monitoring, and production support.
• Collaborate with product, analytics, and engineering teams to understand business requirements and deliver reliable, high‑quality data solutions.
• Develop and optimize data models, ETL/ELT pipelines, and data integration frameworks to support business intelligence and operational reporting.
• Deploy and manage data applications on Kubernetes, implementing CI/CD pipelines using GitLab CI/CD.
• Monitor platform health, troubleshoot production issues, perform root‑cause analysis, and continuously improve system reliability and performance.
• Contribute to engineering best practices, technical documentation, and knowledge sharing.

Required profile

• 1+ years of experience in Data Engineering or Big Data.
• Strong experience designing and building scalable ETL/ELT pipelines using Python, Spark/PySpark, and SQL.
• Hands‑on experience with modern data lakehouse technologies such as Apache Iceberg, Hive, Trino, BigQuery, Redshift, ClickHouse, or Snowflake.
• Experience working with cloud object storage solutions such as Amazon S3 or S3‑compatible platforms.
• Strong analytical and problem‑solving skills with the ability to work independently in a fast‑paced environment.
• Excellent communication and stakeholder management skills, with the ability to collaborate across cross‑functional teams.

Required skills

• Python
• Spark / PySpark
• SQL
• Apache Iceberg
• Hive
• Trino
• BigQuery
• Redshift
• ClickHouse
• Snowflake
• Amazon S3
• Kubernetes
• Docker
• GitLab CI/CD
• Apache Kafka
• MySQL
• Oracle
• MongoDB
• SQLAlchemy
• PyMongo
• LangGraph
• MLOps