דרושים » תוכנה » Senior Big Data Developer

We are looking for a Data Engineer Team Lead to join our Data Engineering team in Tel Aviv.

You will be leading one of our data platform teams, that is responsible for processing, storing, and serving data for all our core systems.

What Youll Do:

Lead and mentor a data lake team within our data organization.
Drive high-level projects with company-wide visibility.
Manage the team roadmap, team building, and SW project execution.
Collaborate with stakeholders, including developers, product managers, and business operations.
Take full ownership of end-to-end feature development, from design to production. Contribute to building and designing innovative big data solutions.
Research core technologies and integrate with external APIs and services.

Were looking for an exceptional data engineer to join our journey to create a data-based platform that will transform the shipping industry.
As a senior data engineer, you will take an instrumental part in laying the foundations and building the data infrastructure in the company, plan and implement the relevant data infrastructure and tools, be in charge of pipelining the companys data and be responsible for the integrity of the data as we scale up.
Responsibilities:
Contribute to the ongoing management of the data team platform including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues
Designing and optimizing data storage solutions, including data warehouses and data lakes.
Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Developing and maintaining data pipelines for efficient extraction, transformation, and loading (ETL) processes.
Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.

We are seeking an experienced Senior Backend Engineer with a passion for tackling complex challenges across a diverse range of technologies.
Your role will involve a deep commitment to software design, code quality, and performance optimization.
As part of our Engineering team , your mission will be to empower critical infrastructure by enabling the detection, investigation, and response to complex attacks and data breaches on their networks.
As a Senior Backend Engineer, you will take a lead role in developing the backend infrastructure to efficiently handle, process, and store massive volumes of data.
Your expertise will play a crucial part in building a scalable, high-performance backend system that serves as the foundation for other services within the platform. Additionally, you will be responsible for translating intricate requirements into meticulous and actionable backend designs.
Responsibilities:
Be a significant part of the development of backend infrastructure to efficiently handle, process, and store vast volumes of data.
Architect and build a scalable, high-performance backend system that supports various services within the platform.
Translate intricate requirements into meticulous backend design plans, maintaining a focus on software design, code quality, and performance.
Collaborate with cross-functional teams to implement backend and data-handling techniques.
Apply your expertise in Core Linux, SQL, and scripting languages to create robust backend solutions. Leverage your proficiency in cloud platforms such as AWS, GCP, or Azure to drive strong backend engineering practices.
Demonstrate strong debugging skills, identifying issues such as race conditions and memory leaks within the backend system. Solve complex backend problems with an analytical mindset and contribute to a positive team dynamic.
Bring your excellent interpersonal skills to foster collaboration and maintain a positive attitude within the team.

We are looking for a strong software engineer to join our Data and LLM domains, in charge of building and driving forward our LLMOps Platform, Feature and Vector Stores.
We deeply value fast learners and independent thinkers with a proactive mindset, who are able to work independently and as a part of a team.
As a Senior Software Engineer you will:
Collaborate closely with talented individuals to drive innovation within our core business.
Play a significant role in enhancing and expanding our Feature and Vector stores, as well as shaping our newly launched LLM management offering.
Work with the latest technologies and tools in the data space.
Gain professional development and advancement opportunities within our fast-growing organization.
Improve the efficiency, scalability, and stability of various components within our ecosystem.
Advocate for robust testing and code design principles.
Solve complex problems and own major features end-to-end.

We are looking for a Senior Data Engineer.
In your role as a Data Engineer, you'll be actively engaged in the most fascinating and demanding projects for our clients. Handling high-scale operations, heavy traffic, stringent SLAs, and massive data volumes is just the starting point. Our leadership in the realms of Big Data, Streaming Data, and Complex Event Processing (CEP) stems from our adept use of cutting-edge, optimal technologies.
Responsibilities:
Apply software-engineering methods and best practices (Medallion Architecture) in Data Lake management.
Develop Data pipelines to provide ingest and transformation of data.
Manage and enhance orchestrated pipelines across company
Data Modeling: Developing data models to ensure efficient storage, retrieval, and processing of data, often involving schema design for NoSQL databases, data lakes, and data warehouses.
Scalability: Ensuring that the big data architecture can scale horizontally to handle large volumes of data and high traffic loads.
Data Security: Implementing security measures to protect sensitive data, including encryption, access controls, and data masking.
Data Governance: Establishing data governance policies to ensure data quality, compliance with regulations, and data lineage.

we are looking for a Performance Solution Architect to work with our globally distributed engineering team on internet-scale data lake analytics platform. This is our flagship product and offers incredible value-add on the already stellar performance of the open-source Trino software. This role provides you with the opportunity to directly contribute to the enhancement of performance. The role entails conducting performance analysis and comparing existing in-market solutions, formulating a comprehensive strategy for performance testing, analyzing the results, and offering appropriate recommendations for enhancing.

As a Data Performance Engineer
Be an expert in architecture and performance approaches
Partner closely with sales engineers, solutions, support, and engineering teams to deliver guidance on performance issues at any phase in the product life cycle.
Maintain a profound understanding of current market solutions and devise instrumentation and approaches for comparing them with the solution, paving the way for future enhancements to .
Collaborate with Product Management and Solution architects to continuously improve performance and eco-system roadmaps.

We are looking for a brilliant, quick-learner Data Engineer for our data engineering team - an independent logical thinker who understands the importance of data structuring for macro-business decisions.
The position combines high technical skills with business orientation, working closely with the analysts and the R&D team, and affecting the company's cross-departments decisions directly. Our Data Engineer should have the ability to speak in technical and practical terms, and more importantly, lead from one to the other, while dealing with challenges and creating them - to make our team even better than it is.
Roles and Responsibilities:
Creating and structuring end-to-end data pipelines & ETLs: from the source all the way to the analysts hands, enabling them the ideal conditions to make smart and data driven business decisions.
Cracking top industry data challenges while initiating and building creative technical solutions - in house Device Graph, Server-to-Server to multiple systems, Privacy challenges, Online-to-Offline and more.
Deep understanding of the business needs, technical requirements and the companys roadmap - and translating it into custom made data solutions and scalable products.
Craft code following best practices to ensure efficiency, while integrating CI/CD principles.
Writing multi-step scalable processes from more than 50 data sources - Marketing. Operations, CS, Product, CRM and more... tying them up to a valuable & useful source of insights for the analysts.
Understanding data challenges and weaknesses, and managing high standards monitoring and reliability processes.

The static analysis team is responsible for the heart of the ASPM product: our capability to automatically reverse engineer arbitrary backend applications and provide deep-code insights about what they do.

As a manager of a static analysis team, youll be leading an innovative team of brilliant engineers in designing a powerful automated reverse-engineering engine, while solving complex problems in a way that wasnt solved before.

Together with business leaders, youll be leading the iterative process of continuously improving our core engine capabilities by translating our critical business needs into the most important engineering solutions. If you enjoy leading great engineers to solve extremely difficult problems while drawing solutions from multiple domains, then this position is for you.

This is a hybrid role open for candidates located in Israel.

What You'll Do:

Lead an innovative team of brilliant developers and researchers

Lead research and development of a powerful automated reverse-engineering engine

Mentor and develop high skilled team members to success both as individuals and as a team

Influence the design and direction of cutting-edge algorithms, from research phase to production

Play a key role in developing and designing the Falcon ASPM platform

Establish, nurture, and implement an efficient and effective research and development process in collaboration with Product Managers and other Team Leads

The Fabric team is building the new generation of big data + AI platform all the way from ingesting to visual insights like dashboards and reports, combined with the power of our Power BI in Azure and Office 365.

This job is an opportunity to work on a new and exciting service that is betting on, be part of a vibrant team, and get proficient in the world of apps and services.

Our Fabric and Power BI are among the fastest growing segments of the software industry today which hold fascinating technological challenges of creating fast and rich ways to analyze huge masses of data. We are a leading player in the BI market both in terms of market share as well as in thought leadership and BI is a key investment for us.

We are looking for an outstanding software engineer to join our rapidly growing team. If you love finding creative ways to leverage new technologies to make meaningful business impact, leading other engineers on that path, versatile and willing to work at all levels of the code stack, like talking to customers for feedback, have an uncompromised passion for sleek and delightful experiences and designs, and have a strong background and passion for cloud engineering this is the best place for you to be.

As a Senior Backend engineer with Spark experience you'll be responsible for implementing core features, building infrastructure, and finding innovative solutions while getting into the language internals. We're looking for top talents who are ready to level up their skills in an exciting and fast-paced environment. You will be responsible for leading features and products end to end, from design to production; build and develop modules, data pipelines, and services.