לוח משרות דרושים איש ביג דאטה Big Data

We are seeking a Senior Data Engineer to promote and maintain our unique data processing platform. You will be joining a team responsible for the management of the data layer at petabyte scale by creating and managing enterprise grade systems, and flows that process ~50TB of data every day and growing. The team will constantly evaluate new technologies in the field of data processing, data governance and data management to transform the company to truly data driven.
Responsibilities:
Design and implement advanced ETLs, high throughput, fault tolerant infrastructure with an emphasis on correct testing, CI/CD processes and data quality.
New technology due diligence, proof of concepts and implementation.
Deep understanding of our data platform including business value and lineage.

We are looking for a Big Data Developer (Snowflake).
What will you do?
Migration of existing data warehouses from Azure SQL Database to Snowflake. The current data warehouse, in addition to standard analytical functions, is also a data source for the web application.
Data warehouse implemented in the lambda architecture, combining Real Time data from IoT devices and data from other sources such as SQL server databases. This project is the beginning of the implementation of Single Source Of Truth for the entire organization
This is an early phase of the project, starting implementation after the design phase.
● analyze and organize raw data
● evaluate business needs and objectives
● data modeling
● architecture designing
● developing ELT logic
● ensuring data quality
● code optimization
● preparing documentation

We deliver valuable results and insights for a fast-growing clientele of major app developers using elite programmatic user acquisition and retargeting technologies.
Our state-of-the-art machine learning technology analyzes 50TB of raw data per day to produce millions of ad recommendations in real-time. This data is used to power our machine learning predictions, business critical metrics, and analytics to power our decision making.
As a Big Data Engineering Team Lead, you will be leading a team responsible for the petabyte scale streaming data layer and real time decision making process from the data lake. Your team will be creating and managing enterprise grade systems, and flows that process ~50TB of data every day. The team will constantly evaluate new technologies in the field of stream processing and high scale high concurrency state store.
Responsibilities:
Lead the backend, streaming and serving projects from the requirements phase through the client delivery and implementation of new production needs (as needed).
Provide leadership and mentorship to the engineering team, fostering a collaborative and high-performing work environment. Set clear goals, provide regular feedback, and conduct performance evaluations to ensure team growth and development.
Be an active member involved in technology selection processes and implementation of new parts of the architecture using these technologies.
Have a deep understanding of our data, how it is acquired, managed, versioned, made discoverable, its relations, and how it can be consumed.

We are looking for a seasoned, proactive engineer with an innovative vision and technical expertise in large complex systems to join our dynamic Data Platform R&D team in Tel Aviv.
To join us, you must enjoy a challenge, be ready to make a significant impact, and dive deep into a Big Data platform, delivering top-tier code using cutting-edge frameworks and technologies.
What will you do?
You'll lead end-to-end feature development for financial data solutions, from design to production. You'll also innovate by prototyping new products within our expanding ecosystem, contribute to large-scale distributed information systems, and collaborate with cross-functional teams to drive strategic core capability development.
Are you up for the challenge?

As the Vice President of Data , you will hold a critical leadership position responsible for driving strategic decisions through advanced quantitative analysis and data Science. Your expertise will be instrumental in cross-departmental collaboration with product marketing, customer service, and operations teams to ensure alignment and synergy across all areas of the business.



Responsibilities:



Lead and mentor multiple teams of Analysts, Data Scientists and Data Engineers.
Initiate & manage cutting-edge projects from ideation to delivery, including developing automated solutions.
Evaluate and improve the companys KPIs through data.
Collaborate closely with Stakeholders from Product, Marketing, Operations, Customer support and Finance and initiate data driven decisions and solutions.
Lead the analysis of complex datasets to extract valuable insights, trends, patterns, and anomalies that drive strategic decisions.
Lead the building and upgrade of existing data infrastructure to cope with performance, scalability, and growth.

The Senior Data Analyst position is a vital role within our Data Ingestion R&D department, primarily focused on ongoing research and model building for the company's data ingestion part of the product.

This dynamic role involves conducting in-depth research, focused on mobility and point of interest (POI) data. As a key contributor to our data analytics team, the Senior Data Analyst uses big-data technologies & statistical methods to transform location data into actionable insights, fine-tune models and optimize data pipelines.

RESPONSIBILITIES:

Conduct comprehensive data analysis, utilizing statistical techniques, to uncover valuable insights, patterns, and trends related to core algorithms in our product
Design, develop and maintain data pipelines using Apache Airflow, ensuring a timely and reliable generation of critical reports
Translate technical findings into actionable recommendations that support strategic planning and business optimization
Evaluate new potential data sources, assess added value and recommend if to integrate with the product
Leverage advanced technologies such as Python, SQL and PySpark for efficient data manipulation, analysis and modeling
Work closely with R&D and Data Science teams to ensure the optimal solution is built in terms of logic and infrastructure
Work closely with product teams to collaborate on innovative solutions for product gaps

As a Senior Data Engineer, working within Foundation Entity Group, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that powers our location analytics platform.

RESPONSIBILITIES:

Data Pipeline Architecture and Development: Design, build, and optimize robust and scalable data pipelines to process, transform, and integrate large volumes of data from various sources into our analytics platform.
Data Quality Assurance: Implement data validation, cleansing, and enrichment techniques to ensure high-quality and consistent data across the platform.
Performance Optimization: Identify performance bottlenecks and optimize data processing and storage mechanisms to enhance overall system performance and reduce latency.
Cloud Infrastructure: Work extensively with cloud-based technologies (GCP), to design and manage scalable data infrastructure.
Collaboration: Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Software Engineers to understand requirements and deliver solutions that meet business needs.
Data Governance: Implement and enforce data governance practices, ensuring compliance with relevant regulations and best practices related to data privacy and security.
Monitoring and Maintenance: Monitor the health and performance of data pipelines, troubleshoot issues, and ensure high availability of data infrastructure.
Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and growth within the team.

XM Cyber is a global leader in hybrid cloud security. XM Cyber brings a new approach that uses the attacker’s perspective to find and remediate critical attack paths across on-premises and multi-cloud networks. The XM Cyber platform enables companies to rapidly prioritize and respond to cyber risks affecting their business-sensitive systems. As a Senior Backend engineer with Spark experience at XM Cyber, you'll be responsible for implementing core features, building infrastructure, and finding innovative solutions while getting into the language internals. We're looking for top talents who are ready to level up their skills in an exciting and fast-paced environment. You will be responsible for leading features and products end to end, from design to production; build and develop modules, data pipelines, and services.

we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results. We value your take charge, take initiative, get stuff done attitude and will help you unlock your growth potential. One great choice can change everything. Thrive with us.
We are looking for a highly skilled Full Stack engineer to join the integrations team. The team is responsible for two main products that enrich users CRM data (millions of records) with our data or import their CRM data to to allow custom data filtering from our core products (SalesOs and others).
Responsibilities:
Develop and maintain the backend systems - Implementing new features and capabilities while maintaining the existing ones
Develop new UI components for the Enrich and Org import products - Implementing new features and capabilities while maintaining the existing ones
Designing, planning, and executing the roadmap for the team while focusing on scale, quality, and performance.
Work closely with other engineering teams and product managers to understand the business requirements.
Communicating and completing tasks with stakeholders that are outside the direct team.
Work closely with product managers and UI/UX team to understand the business requirements.
Find the right balance between perfection and getting the job done.

we are looking for a Senior Big Data Engineer.
. In this role, you will assume the pivotal position of lead developer, entrusted with spearheading the creation of innovative software products.
On a typical day youll:
Write clean, concise code that is stable, extensible, and unit-tested appropriately
Diagnose complex issues, evaluate, recommend and execute the best solution
Implement new requirements within our Agile delivery methodology while following our established architectural principles
Test software to ensure proper and efficient execution and adherence to business and technical requirements
Write code that meets the production requirements and design specifications and anticipate potential errors/issue
Provides input into the architecture and design of the product; collaborating with the team in solving problems the right way
Develop expertise of AWS, Azure, and GCP products and technologies

Were looking for an experienced Data Application Engineer to join the team. This role requires you to be a critical part of the back-end team, developing our cloud-based proprietary networking and security management solutions. In addition, you will be building highly scalable processes to gather and analyze statistics from multiple networks.
Responsibilities:
End-to-end development of company massive data infrastructures.
Researching new technologies and adapting them for use in the companys product
Working closely with the product, DevOps, and security teams.

The Analytics Cloud Platform team is responsible for building a scalable and reliable data analytics solution in the cloud. This solution aims to transform diverse security detection data points into a coherent and concise attack picture and response procedure.

Key Responsibilities
Lead a team of 4-6 proficient software engineers.
Establish, nurture, and sustain a team of software engineers.
Provide team leadership through coaching and mentorship.
Offer technical leadership by guiding solution design and implementation.
Lead the design and implementation of reliable, scalable, and performant analytical data pipelines making use of modern toolsets and managed services.
Work closely with our team of data scientists and analysts, who are responsible for developing algorithms, analytical rules, and machine learning data models. Guide your team in the implementation and deployment of these solutions to our cloud platform.
Work collaboratively with fellow managers and teams to successfully deliver value to our customers.

As Software Engineering Manager of the Data Platform team you will be taking a central role orchestrating, overseeing and leading the many different aspects of our challenging journey towards a new and modernized big data Lakehouse platform (PBs of data), built using Databricks on Google cloud (GCP). Among the challenges - ingestion at stream in massive scale, providing a platform for processing structured and unstructured data, security and compliance at Enterprise scale, data governance, optimizing performance, storage and cost and many more.

You will lead, mentor, guide, recruit and manage a team of experienced Data Engineers and be responsible for the enablement of our Big Data platform serving developers, data engineers, data analysts, product managers, data science and ML Engineering

You will work closely with our Data PM on leading our Data Strategy and as such, you will learn how data serves our goals, come up with ways to improve our TBs of daily data processes while maintaining high data quality; guide other R&D teams and provide best practices; conduct POCs with latest data tools; and by that, help our clients make smarter decisions that continuously improve their ad-impression quality.

Find your way to influence and impact a team that utilizes a wide array of languages and technologies, among them - Python, Scala, SQL, GCP, Databricks, Spark, Kafka, Docker, Kubernetes, Terraform, Prometheus, Gitlab and more.

Own our innovative SaaS analytics platform. You will have the opportunity to architect, maintain and scale a challenging large scale data driven system.

As a Senior DevOps Engineer, you will:

Building our SaaS platform for availability, scalability, and security
Designing, developing and maintaining our multi-region cloud infrastructure in AWS using technologies like
K8s, Helm, ArgoCD, Datadog, Terraform
Being in charge for stability and performance of Big Data clusters including Clickhouse, Kafka, Spark, Flink
Leading and participate in architectural POCs and significant projects in the DevEx, DataOps and security
realms