דרושים » תוכנה » Data Engineer

We are looking for a brilliant, quick-learner Data Engineer for our data engineering team - an independent logical thinker who understands the importance of data structuring for macro-business decisions.
The position combines high technical skills with business orientation, working closely with the analysts and the R&D team, and affecting the company's cross-departments decisions directly. Our Data Engineer should have the ability to speak in technical and practical terms, and more importantly, lead from one to the other, while dealing with challenges and creating them - to make our team even better than it is.
Roles and Responsibilities:
Creating and structuring end-to-end data pipelines & ETLs: from the source all the way to the analysts hands, enabling them the ideal conditions to make smart and data driven business decisions.
Cracking top industry data challenges while initiating and building creative technical solutions - in house Device Graph, Server-to-Server to multiple systems, Privacy challenges, Online-to-Offline and more.
Deep understanding of the business needs, technical requirements and the companys roadmap - and translating it into custom made data solutions and scalable products.
Craft code following best practices to ensure efficiency, while integrating CI/CD principles.
Writing multi-step scalable processes from more than 50 data sources - Marketing. Operations, CS, Product, CRM and more... tying them up to a valuable & useful source of insights for the analysts.
Understanding data challenges and weaknesses, and managing high standards monitoring and reliability processes.

Were looking for an exceptional data engineer to join our journey to create a data-based platform that will transform the shipping industry.
As a senior data engineer, you will take an instrumental part in laying the foundations and building the data infrastructure in the company, plan and implement the relevant data infrastructure and tools, be in charge of pipelining the companys data and be responsible for the integrity of the data as we scale up.
Responsibilities:
Contribute to the ongoing management of the data team platform including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues
Designing and optimizing data storage solutions, including data warehouses and data lakes.
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Developing and maintaining data pipelines for efficient extraction, transformation, and loading (ETL) processes.
Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.

We are looking for a Senior Data Engineer.
In your role as a Data Engineer, you'll be actively engaged in the most fascinating and demanding projects for our clients. Handling high-scale operations, heavy traffic, stringent SLAs, and massive data volumes is just the starting point. Our leadership in the realms of Big Data, Streaming Data, and Complex Event Processing (CEP) stems from our adept use of cutting-edge, optimal technologies.
Responsibilities:
Apply software-engineering methods and best practices (Medallion Architecture) in Data Lake management.
Develop Data pipelines to provide ingest and transformation of data.
Manage and enhance orchestrated pipelines across company
Data Modeling: Developing data models to ensure efficient storage, retrieval, and processing of data, often involving schema design for NoSQL databases, data lakes, and data warehouses.
Scalability: Ensuring that the big data architecture can scale horizontally to handle large volumes of data and high traffic loads.
Data Security: Implementing security measures to protect sensitive data, including encryption, access controls, and data masking.
Data Governance: Establishing data governance policies to ensure data quality, compliance with regulations, and data lineage.

Lead the design, implementation, and ongoing management of our company's data pipeline architecture.
Lead team architectural discussions
Manage a team of 2-3 data engineers
Work as an integral part of the data team and work closely with data Scientists, data Analysts and data Engineers.
Work directly with others (Developers, Product, and Internal stakeholders) to develop a solid understanding of the business application and requirements for which the application is being designed.

We're looking for a Senior Big Data Developer to join our Data Engineering team in Tel Aviv.

You will be a part of our Data Management platform, that is responsible for processing, storing, and serving data for all our core systems.

As a Senior Big Data Developer, we will encourage you to take a proactive & autonomous approach in research & development while working collaboratively with the team. Our ideal candidate is a fast but thorough problem solver, and a fun person to work with!

What Youll Do:

End-to-end feature development and ownership, from design to production, with a strong emphasis on innovation and efficiency.
Take part in building & designing the next generation of company Identity solutions.
Implement high scale Big-Data solutions and contribute to our platform infrastructure and architecture.
Research core technologies and integrations with external APIs and services.
Working with various stakeholders: Product, Engineering, Data providers etc.
Lead and mentor other developers through complex projects that will affect our core business.

We are looking for a Data Engineer Team Lead to join our Data Engineering team in Tel Aviv.

You will be leading one of our data platform teams, that is responsible for processing, storing, and serving data for all our core systems.

What Youll Do:

Lead and mentor a data lake team within our data organization.
Drive high-level projects with company-wide visibility.
Manage the team roadmap, team building, and SW project execution.
Collaborate with stakeholders, including developers, product managers, and business operations.
Take full ownership of end-to-end feature development, from design to production. Contribute to building and designing innovative big data solutions.
Research core technologies and integrate with external APIs and services.

We are seeking an adept Senior Data Engineer with a passion for tackling complex challenges across a diverse range of technologies.
Your role will involve a deep commitment to software design, code quality, and performance optimization.
As part of our Engineering team, your mission will be to empower critical infrastructure by enabling the detection, investigation, and response to complex attacks and data breaches on their networks.
You will play a pivotal role in developing pipelines to efficiently extract, transform, and load massive volumes of data.
Your expertise will contribute to the creation of a scalable, high-performance data lake that serves as a foundation for other services within the platform. Additionally, you will be responsible for translating intricate requirements into meticulous and actionable designs.
Responsibilities:
Be a significant part of the development of data pipelines to efficiently extract, transform, and load vast volumes of data.
Architect and build a scalable, high-performance data lake that supports various services within the platform.
Translate intricate requirements into meticulous design plans, maintaining a focus on software design, code quality, and performance.
Collaborate with cross-functional teams to implement data-warehousing and data-modeling techniques.
Apply your expertise in Core Linux, SQL, and scripting languages to create robust solutions.
Leverage your proficiency in cloud platforms such as AWS, GCP, or Azure to drive strong data engineering practices.
Utilize your experience with streaming frameworks, such as Kafka, to handle real-time data processing.
Employ your familiarity with industry-standard visualization and analytics tools, like Tableau and R, to provide insightful data representations.
Demonstrate strong debugging skills, identifying issues such as race conditions and memory leaks.
Solve complex problems with an analytical mindset and contribute to a positive team dynamic.
Bring your excellent interpersonal skills to foster collaboration and maintain a positive attitude within the team.

As the Vice President of Data , you will hold a critical leadership position responsible for driving strategic decisions through advanced quantitative analysis and data Science. Your expertise will be instrumental in cross-departmental collaboration with product marketing, customer service, and operations teams to ensure alignment and synergy across all areas of the business.

Responsibilities:

Lead and mentor multiple teams of Analysts, Data Scientists and Data Engineers.
Initiate & manage cutting-edge projects from ideation to delivery, including developing automated solutions.
Evaluate and improve the companys KPIs through data.
Collaborate closely with Stakeholders from Product, Marketing, Operations, Customer support and Finance and initiate data driven decisions and solutions.
Lead the analysis of complex datasets to extract valuable insights, trends, patterns, and anomalies that drive strategic decisions.
Lead the building and upgrade of existing data infrastructure to cope with performance, scalability, and growth.

We are seeking a Senior DevOps Engineer to join our team.
As a DevOps Engineer and lead the effort in designing, building, deploying and maintaining our companys infrastructure, deployment pipelines, and continuous integration/delivery workflows.
You will work closely with development teams to ensure efficient and reliable software delivery, as well as identify and implement improvements to our systems and processes.
Responsibilities:
Design, implement, and maintain highly available and scalable infrastructure on cloud platforms such as AWS, Azure, or GCP.
Build and maintain deployment pipelines
Design and implement data pipelines to support various data processing needs across the organization.
Work closely with development teams to ensure code is deployed efficiently and reliably while maintaining high standards of security and performance.
Identify and implement improvements to our systems and processes, including automation and monitoring solutions.
Troubleshoot and resolve issues related to infrastructure and deployments.
Collaborate with cross-functional teams to ensure seamless integration of new features and technologies.

You will design, develop, and optimize ML model pipelines, and scale our models from research to production.

RESPONSIBILITIES
Building and improving our engineering infrastructure to enable and scale our applied algorithmic research and development. On a day to day, some of your responsibilities will include:

Design, Develop, Test and Maintain ETLs and services for integrating with our customers various data systems.
Design, Develop, Test and Maintain ETLs and services for building our own data processes to accommodate applied research needs as well as production needs.
Finding performance bottlenecks in our data pipelines and our machine learning pipelines and resolving them
Develop end-to-end algorithmic solutions for complex ML problems from research and training models, through design, development, evaluation and optimization.
Develop train and inference engine pipelines in a large scale distributed system.
Transform NLP and data related ML/DL algorithmic approaches into efficient and optimized production-ready solutions.
Design, Implement and Optimize ML/DL and research pipelines to improve algorithms performance.
Transform high-level product requirements into technical requirements
Brainstorm and prototype algorithmic improvements.
Work in an ambiguous environment and collect requirements from different personas in the company (Product, FE, Research, etc.)
Advise and collaborate with researchers on DL software engineering aspects (such as tools and practices).