As a Senior Data Engineer within our development team, you will play an important role in design, implementation, and ongoing performance optimization of anything data oriented in the R&D department, including ETL/ELT processes, working closely with architects and development teams.
Your duties and responsibilities include:
Lead the design and implementation of scalable data architecture solutions.
Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems).
Identify ways to improve data reliability, efficiency, and quality.
Collaborate with data scientists, data analysts, and other stakeholders to achieve optimal data performance.
Optimize complex SQL queries and perform performance tuning.
Participate in Scrum and Agile development processes.
Implement and manage relational and non-relational databases.
Requirements: 5+ years of experience leading, designing, and implementing data architecture at an enterprise level.
5+ years of experience working with relational databases (for example, PostgreSQL, MSSQL or MySQL).
2+ years of experience working with Elasticsearch.
2+ years of experience working with non-relational databases (for example, MongoDB or Cassandra).
Be exceptionally strong in SQL development - complex queries and performance tuning.
Implement and manage ETL/ELT processes for data integration and transformation.
Proficiency in Azure and Azure Data Factory for data integration and transformation.
Experience with Databricks or similar data processing platforms.
Experience with Scrum and Agile methodology.
Fluent in spoken and written English.
Advantages
Experience with big data technologies such as Hadoop, Spark, or Kafka.
Familiarity with data warehousing solutions.
Knowledge of data governance and data security practices.
Certification in Azure or other relevant technologies.
University or college degree in Computer Science or a related discipline.
This position is open to all candidates.