As a Data Infra engineer, you will provide creative solutions for data-related problems at scale by mixing in-house and open source technology such as Kafka, Spark, Snowflake and more. You should be a Team player, a quick learner, and have a Can Do approach.
Responsibilities
Join a team of highly motivated developers to work together to fill At-Bays growing software and scaling needs
Writing well-tested, organized, and robust code to support a rapidly growing organization
Work in a modern software environment with continuously deployed and integrated code in our cloud-based infrastructure
Communicating and working openly with other developers to solve problems and produce high-quality code
Create, maintain and own the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth at At-Bay
Consistently evolve data model & data schema based on business and engineering needs
Implement systems tracking data quality and consistency
Develop tools supporting self-service data pipeline management (ETL)
Work with stakeholders including ML Engineering, Product, Data analytics, Cyber Engineers, Risk teams and R&D teams to assist with data-related technical issues and support their data infrastructure needs.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Requirements: 3+ years of hands-on experience with Python as a Backend Software Engineer.
BSc. in Computer Science
Strong software development capabilities
Experience in building large-scale data systems.
Experience developing solutions in AWS
Experience with relational SQL.
Experience with Docker & k8s advantage.
2+ years of Experience with big data frameworks such as Spark, Kafka, and Snowflake, etc. - advantage.
Experience with Airflow advantage
Experience with MSK, EMR, Glue, Kinesis- advantage.
Infrastructure development experience - advantage.
Experience with relational NoSQL databases advantage.
Autodidact and a problem solver.
Excellent communication skills in Hebrew and English.
This position is open to all candidates.