Data Engineer
Etraveli Group
- Αθήνα
- Μόνιμη
- Πλήρης Απασχόληση
- Integrate, implement and maintain our new on-prem data platform: being responsible for implementing and managing systems on it that collect, process, store and analyze data
- Support deploying and managing the infrastructure that supports the data platform. Troubleshoot and manage our kubernetes based platform as well as our installed Data Engineering services
- Continuously monitor the data platform for performance issues, bottlenecks, or errors and optimizing it accordingly
- Implementing and monitoring security measures to protect data against unauthorized access, breaches, and ensure compliance with data protection regulations
- Support Data Engineers in developing and managing pipelines for Extracting, Transforming, and Loading (ETL) data from various sources
- Offer technical support to data users across the organization and collaborating with other teams.
- University degree in a STEM discipline is a merit
- 5+ years of experience in data engineering or similar profiles within a kubernetes environment
- Proven experience with administering and maintaining big data processing and distributed systems like Spark, Zookeeper and Kafka
- Experience with Kubernetes and other Cloud Native products in on-prem clouds or AWS
- Proficiency in monitoring tools and platforms that track the health and performance of our data platform, like Prometheus, Grafana and Kibana
- Experience with data pipeline and workflow management tools such as Airflow or Nifi
- Experience with object storage systems such as S3, Swift and Ceph
- Understanding of DevOps principles and technologies, such as CI/CD in Jenkins, Harness or ArgoCD, containerization (docker) and infrastructure as code (Ansible, Terraform or Pulumi)
- Exposure to analytics platforms like Dremio/Trino and the Iceberg table format
- Exposure to programming Scala and Spark is a merit
- Exposure to administrating ETL tools
- Fluency in English
- Working in a hybrid model - having the opportunity to work both remotely and at the office!
- Health Benefits - Through partners, we offer a private health insurance plan. We also offer the possibility to use 2 extra medical leave days in case of need.
- Monthly ticket restaurant card - to spend in one of the thousands affiliated restaurants, cafes, stores or supermarkets across Greece.
- Office in the City – We sit on bright, large floors (over 4000㎡!) in central Athens. Just a short walk from the Ambelokipi Metro station.
- Growth – We believe in personal development and continuous education. We allocate a generous budget each year to spend at conferences, seminars, online courses or other means to learn new things. In addition to this, we continuously organize internal training and workshops, so that we can learn from each other.
- Hackathon and Dev week – We believe in fostering creativity and testing new things. Therefore, we have recurring Hackathon and Dev weeks, where the teams decide what they want to work on.
- Team activities - We also like to schedule company/department/team activities and events outside the office space!
- Fun & Work - We have a relaxed working environment where you can enjoy breakfast, free beverages & fruits, playing ping pong or video games.