לוח משרות דרושים איש ביג דאטה Big Data בתל אביב יפו

As a Senior Backend engineer with Spark experience you'll be responsible for implementing core features, building infrastructure, and finding innovative solutions while getting into the language internals. We're looking for top talents who are ready to level up their skills in an exciting and fast-paced environment. You will be responsible for leading features and products end to end, from design to production; build and develop modules, data pipelines, and services.

We are looking for a Principal Backend Engineer to join our Cortex XDR team and help us to prevent, detect and respond to all runs on an integrated endpoint, network and cloud data reduce the noise and focus on real threats.

More information about the Cortex XDR product can be found here.

Your Impact

You will be a part of a group with the mentality and independence of a startup, supported by the power of a successful corporation - You will design and build an infrastructure that supports billions of events per second, storing, processing and making them accessible and visible to the user while collaborating with the industrys leading cyber products
You will be responsible for the complete software development life cycle including requirement analysis, design, development, deployment, and support - You will write clean, testable, readable, fast and maintainable code that is efficient and scalable

You will be part of a strong security research and data science team who solve highly complex security challenges using disruptive technologies, ML algorithms and a lot of data.

As part of that, you will take part in the design and development of new groundbreaking AI security solutions which make a direct impact on many customers.

Your Impact

Take part in development of new security capabilities/features to help protect customers using state-of-the-art machine learning algorithms
Lead and perform groundbreaking cyber security research while working side by side with top-notch data scientists, engineering and PM teams
Break apart cyber security problems in a scientific way, provide support, reviews and consultant to both technical and non-technical partners

We are looking for excellent Customer Oriented and analytical people who are eager to work in a dynamic environment, have very good personal engagement skills, will never take no for an answer, are good at gathering and processing data and have the ability to improve and help grow our business globally.
If you are up to the challenge, this is the job for you.
Responsibilities:
Responsibility for activities related to the onboarding of international entities to our platform.
Independent management and execution of core customer related processes involving multiple tools, automation and control.
Integrating and cross-referencing data from multiple systems and sources. Conducting online research.
Working independently with other groups in the company as well as external entities, including global customers and suppliers.
Contribute to ongoing process improvement, leveraging international data sources and technological solutions.

Design, build, and launch data infrastructures that support multiple use cases across different products or domains.
Collaborate with engineers, product managers, data scientists, and other stakeholders to understand data needs.
Solve challenging data integration problems, utilizing optimal ETL patterns, frameworks, query techniques, and sourcing from structured and unstructured data sources.
Lead end-to-end data projects from infrastructure design to production monitoring and visualization.

Our Research team is growing, and we are looking for a Senior Data Engineer to join the team.
Not Your Typical Senior Data Engineer Role
You're a crucial pivot in our R&D unit, ensuring our data flows seamlessly, is stored efficiently, and can be accessed and interpreted for justice at scale. You will be responsible for designing our data architecture, implementing and maintaining data pipelines from various sources, and building our databases.
There is no one way of doing things. We are open to new ideas and we encourage creativity, new initiatives and entrepreneurial minds.
Responsibilities:
You will devise scalable solutions to enhance the capabilities of our legal data team to analyze factual information and extract legal implications from it.
Design data analytics modeling solutions with the data science and ML engineers
Collaborate with peer engineering teams (backend & frontend developers and architects) as well as data scientists, product managers, and data analysts to understand business priorities and translate these requirements into data models.
Work with DevOps and engineers to design and implement our infrastructure.

We are looking for a Senior Data Engineer.
As a Senior Data Engineer, you will play a pivotal role in our Data Engineering team, driving a multitude of responsibilities essential to fueling our groundbreaking R&D endeavors. Youll have the autonomy to explore and implement cutting-edge technologies and data solutions, collaborating with diverse team of data scientists, developers, analysts, and stakeholders. Every day will present new learning opportunities and challenges as we strive together to reshape the future of work.
Responsibilities:
Design, develop, and maintain scalable data pipelines and infrastructure to support the collection, processing, and analysis of large volumes of data.
Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to understand data requirements and develop solutions that meet business needs.
Implement best practices for data governance, security, and quality assurance to ensure the integrity and reliability of our data assets.
Optimize and tune existing data pipelines and processes for improved performance and efficiency.
Stay up to date with current best practices in the big data field.
Mentor and coach other members of the data engineering team, providing guidance and support to help them grow their skills and expertise.

We are looking for a Senior Data Engineer.
Responsibilities:
Work closely with business and research teams to deliver high quality results to customers and partners.
Design and Implement complex end-to-end data pipelines including data extraction, feature engineering, data quality, and data serving.
Work with Large Language Models to deliver high scale, high quality features for customers.
Take ownership of a true research project from POC to production.
Contribute to a wide variety of projects using a range of technologies and tools.
If you are someone who thrives in a fast-paced environment where being self-directed, creative, and determined are a requirement, we would love for you to join us.

We're looking for a DataOps Engineer to join the DataOPs team of the Grow division.
The team is in charge of the operational stability, performance and cost of data infrastructures that serve either users (within or outside the company) and applications (to transfer data between applications). The main technologies we're working with are Druid, Spark Structured Streaming, Iceberg, Trino, Airflow and Aurora RDS.
As a team we put a lot of focus on reducing the cost and improving the performance of our data services hosted on the cloud.
We work on both AWS and GCP clouds, and our most important data infrastructures run on k8s, either on AWS EKS or on GCP GKE.
The role requires to make these data infrastructures as stable, cheap and performant as possible.
The short term success is be able to maintain all the above services as an on-call.
The long-term success is to participate in the development of the Druid and Streaming services and improve their stability, cost and performance.
The impact on the team will be to increase the impact of the team on the data infrastructures within Grow.
We're a team that moves fast, handles interesting technologies, and always strive to improve the stability, cost and performance of our infrastructures that manage traffic at a very high scale. The roles suits a devops, sre or dataops that want to be part of an excellent DataOps team that manages data transfers at high traffic of Millions/sec with minimum production issues while always focusing on cost and performance. And in addition, the team members are cool, professional people who love what they do.
What you'll be doing:
Improve stability of Druid, Streaming, Iceberg, Trino, Mysql infrastructures
Participate in the on-call rotation of these infra
Focus on monitoring, cost reduction and performance improvements
Develop scripts in python
Work in collaboration with customers of our infra.

We are seeking a Senior Data Engineer to promote and maintain our unique data processing platform. You will be joining a team responsible for the management of the data layer at petabyte scale by creating and managing enterprise grade systems, and flows that process ~50TB of data every day and growing. The team will constantly evaluate new technologies in the field of data processing, data governance and data management to transform the company to truly data driven.
Responsibilities:
Design and implement advanced ETLs, high throughput, fault tolerant infrastructure with an emphasis on correct testing, CI/CD processes and data quality.
New technology due diligence, proof of concepts and implementation.
Deep understanding of our data platform including business value and lineage.

We deliver valuable results and insights for a fast-growing clientele of major app developers using elite programmatic user acquisition and retargeting technologies.
Our state-of-the-art machine learning technology analyzes 50TB of raw data per day to produce millions of ad recommendations in real-time. This data is used to power our machine learning predictions, business critical metrics, and analytics to power our decision making.
As a Big Data Engineering Team Lead, you will be leading a team responsible for the petabyte scale streaming data layer and real time decision making process from the data lake. Your team will be creating and managing enterprise grade systems, and flows that process ~50TB of data every day. The team will constantly evaluate new technologies in the field of stream processing and high scale high concurrency state store.
Responsibilities:
Lead the backend, streaming and serving projects from the requirements phase through the client delivery and implementation of new production needs (as needed).
Provide leadership and mentorship to the engineering team, fostering a collaborative and high-performing work environment. Set clear goals, provide regular feedback, and conduct performance evaluations to ensure team growth and development.
Be an active member involved in technology selection processes and implementation of new parts of the architecture using these technologies.
Have a deep understanding of our data, how it is acquired, managed, versioned, made discoverable, its relations, and how it can be consumed.

We are looking for a seasoned, proactive engineer with an innovative vision and technical expertise in large complex systems to join our dynamic Data Platform R&D team in Tel Aviv.
To join us, you must enjoy a challenge, be ready to make a significant impact, and dive deep into a Big Data platform, delivering top-tier code using cutting-edge frameworks and technologies.
What will you do?
You'll lead end-to-end feature development for financial data solutions, from design to production. You'll also innovate by prototyping new products within our expanding ecosystem, contribute to large-scale distributed information systems, and collaborate with cross-functional teams to drive strategic core capability development.
Are you up for the challenge?

As the Vice President of Data , you will hold a critical leadership position responsible for driving strategic decisions through advanced quantitative analysis and data Science. Your expertise will be instrumental in cross-departmental collaboration with product marketing, customer service, and operations teams to ensure alignment and synergy across all areas of the business.



Responsibilities:



Lead and mentor multiple teams of Analysts, Data Scientists and Data Engineers.
Initiate & manage cutting-edge projects from ideation to delivery, including developing automated solutions.
Evaluate and improve the companys KPIs through data.
Collaborate closely with Stakeholders from Product, Marketing, Operations, Customer support and Finance and initiate data driven decisions and solutions.
Lead the analysis of complex datasets to extract valuable insights, trends, patterns, and anomalies that drive strategic decisions.
Lead the building and upgrade of existing data infrastructure to cope with performance, scalability, and growth.

As a Senior Data Engineer, working within Foundation Entity Group, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that powers our location analytics platform.

RESPONSIBILITIES:

Data Pipeline Architecture and Development: Design, build, and optimize robust and scalable data pipelines to process, transform, and integrate large volumes of data from various sources into our analytics platform.
Data Quality Assurance: Implement data validation, cleansing, and enrichment techniques to ensure high-quality and consistent data across the platform.
Performance Optimization: Identify performance bottlenecks and optimize data processing and storage mechanisms to enhance overall system performance and reduce latency.
Cloud Infrastructure: Work extensively with cloud-based technologies (GCP), to design and manage scalable data infrastructure.
Collaboration: Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Software Engineers to understand requirements and deliver solutions that meet business needs.
Data Governance: Implement and enforce data governance practices, ensuring compliance with relevant regulations and best practices related to data privacy and security.
Monitoring and Maintenance: Monitor the health and performance of data pipelines, troubleshoot issues, and ensure high availability of data infrastructure.
Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and growth within the team.

we are looking for a Senior Big Data Engineer.
. In this role, you will assume the pivotal position of lead developer, entrusted with spearheading the creation of innovative software products.
On a typical day youll:
Write clean, concise code that is stable, extensible, and unit-tested appropriately
Diagnose complex issues, evaluate, recommend and execute the best solution
Implement new requirements within our Agile delivery methodology while following our established architectural principles
Test software to ensure proper and efficient execution and adherence to business and technical requirements
Write code that meets the production requirements and design specifications and anticipate potential errors/issue
Provides input into the architecture and design of the product; collaborating with the team in solving problems the right way
Develop expertise of AWS, Azure, and GCP products and technologies