
Senior Data Engineer
- Θεσσαλονίκη
- Μόνιμη
- Πλήρης Απασχόληση
- Design and i mplement well tested scalable data engineering solutions establishing process to ensure best practices and architectural principles while being responsible for all stages of the development lifecycle, from design and coding to integration, optimization, deployment, and support.
- Lead collaboration with stakeholders to assess data needs, capturing key insights in comprehensive documentation.
- Design scalable data infrastructure ensuring security and compliance standards.
- Organize, unify and optimize data from multiple structured and unstructured sources and environments to build robust, multi-functional data assets that support analytics.
- Establish development processes that ensure high code quality and uniformity of the data pipelines.
- Conduct thorough code reviews to promote best practices are being followed.
- Design and implement sophisticated data models that support multiple use cases across different products and domains.
- Tackle challenging data engineering problems that might include communications with our vendors.
- Provide estimates and unblock team members to meet project deadlines.
- Improve existing development processes by identifying inefficiencies and implementing streamlined workflows to enhance productivity.
- Mentor and guide data engineers supporting continuous improvement within the team and building a collaborative environment.
- At least 5 years of data/software engineering experience including extensive work in data analysis, design and implementation of ETL/ELT pipelines.
- Strong programming experience in multiple languages (Python, Java, Scala, etc.)
- Advanced SQL knowledge applied to real-case scenarios, including query optimization.
- Extensive experience with data modeling, including designing and implementing complex data models.
- In-depth understanding of multiple database types relational, columnar, graph, object, NoSQL, time-series, etc ).
- Extensive experience with Databricks platform.
- Deep knowledge of Spark architecture including tracked record of performance optimization use cases.
- Good understanding of DevOps principles (CICD, version control, automated testing, git workflows, deployment strategies, observability).
- Extensive experience with git version control system including branching strategies
- Exceptional communications skills with the ability gain trust of the stakeholders translating complex technical concepts to non-technical people in English.
- Nice to have:
- Experience with one or more Azure Synapse Analytics, Azure Data Factory or Snowflake is a plus.
- Familiarity building and consuming web APIs is a plus.
MyCarriera