You will have the opportunity to design, build, and manage the next generation of our data Platform, build a data engineering team from the ground up, and manage all data -related aspects of the application.
What You'll Do:
Take a major role in designing, architecting, and selecting technology for the next generation of the data platform.
You will recruit, establish, and manage a data engineering team responsible for all Datarails data (Customer and business data ), including data Integrity, data integrations, Pipelines, data transformation, data aggregation, Reports, Insights, Events, Monitoring, etc.
You will define working methodology, KPIs for measuring success, and quality control measures.
Design data profiling and monitoring to identify anomalies and maintain data integrity.
Requirements: 7+ years of experience as a data Engineer
3+ years experience as a data Engineering Manager
Experience in building data infrastructure.
Experience and familiarity with the following tools:
Big-Data query engines (Spark, Databricks, Presto)
data lakes and data Lakehouse architecture
Familiarity with Azure data stack - advantage.
Experience creating and optimizing Big Data processes, pipelines, and architectures on cloud-native environments (Spark/Databricks).
Proficiency with SQL, Python, and one of JAVA /Scala/CPP.
Understanding of how to build robust and reliable solutions
Familiarity with cloud Databases (Snowflake-Advantage)
Have a strong analytical mind with proven problem-solving abilities
This position is open to all candidates.