לוח משרות דרושים איש ביג דאטה Big Data

We are looking for strong and motivated SRE to help us continue driving the Azure Data Explorer / Synapse Real Time Analytics revolution and make it THE technology for log search and text analytics across The company as well as providing value to our external customers.
Responsibilities:
As a SRE in Kusto your primary responsibilities will be:
Live Site Management  Almost all the company come to rely on Azure Data Explorer (Kusto) for keeping their business running. This fuels a lot of passion in our team to keep the systems working at high availability and performance.
As a Service Engineer, you will be part of a global team driving huge scale live sites 24X7 (with follow the Sun model) and is passionate to deliver the best service within as well as to external customers. 
Customer Focus our core value is Customer First. We in Kusto take pride in that and bring unwavering customer focus and support to help our customers utilize, embedded and build deep solutions on top of Kusto tailored to their needs. 
Automation As Kusto scale is huge and is expected to keep growing rapidly, we are committed to delivering automation and tooling to improve our live site management and adhere to scale without scale methodology.   
Design - Evaluate and contribute to product, service design and architecture, help shape Site Reliability Engineering strategies, review specifications, design and improve upon core processes.  
Observability - Identify system problems and recommend monitoring solutions & automation to improve processing efficiency and stability.  
Continuous integration/deployment - Implement/maintain and operate the build and release pipelines allowing our developers to safely code/test and deploy our products in very large scale.
Provide engineering design across different workloads including incident & problem management, change management, security and compliance.  
Community Building - Help us build and contribute to an exciting Azure Data explorer community.

We are looking for strong and motivated Senior SRE to help us continue driving the Azure Data Explorer / Synapse Real Time Analytics revolution and make it THE technology for log search and text analytics across as well as providing value to our external customers.
Responsibilities:
As a Senior SRE in Kusto your primary responsibilities will be:
Live Site Management  Almost all the company come to rely on Azure Data Explorer (Kusto) for keeping their business running. This fuels a lot of passion in our team to keep the systems working at high availability and performance.  
As a Senior Service Engineer, you will be part of a global team driving huge scale live sites 24X7 (with follow the Sun model) and is passionate to deliver the best service within as well as to external customers 
Customer Focus our core value is Customer First. We in Kusto take pride in that and bring unwavering customer focus and support to help our customers utilize, embedded and build deep solutions on top of Kusto tailored to their needs. 
Automation As Kusto scale is huge and is expected to keep growing rapidly, we are committed to delivering automation and tooling to improve our live site management and adhere to scale without scale methodology.   
Design - Evaluate and contribute to product, service design and architecture, help shape Site Reliability Engineering strategies, review specifications, design and improve upon core processes.  
Observability - Identify system problems and recommend monitoring solutions & automation to improve processing efficiency and stability.  
Continuous integration/deployment - Implement/maintain and operate the build and release pipelines allowing our developers to safely code/test and deploy our products in very large scale.
Provide engineering design across different workloads including incident & problem management, change management, security and compliance.  
Community Building - Help us build and contribute to an exciting Azure Data explorer community.

What will you do?
Analysis of large numbers of logs from printers sent several times a day in the form of zip files into Azure Blob Storage.
Currently, the logs require a lot of cleaning and transformation.
Logs from various files are aggregated and combined to calculate and present KPIs that are important for the business.
analyze and organize raw data
evaluate business needs and objectives
developing the existing data lake
notebook implementation for ELT processes and business logic
code optimization
refactoring
writing unit tests
preparing documentation

As a Senior Data Engineer at CodeValue, you'll play a crucial role in our data team, contributing to the development and maintenance of scalable data pipelines and systems. You'll be at the forefront of designing, implementing, and optimizing data solutions that drive our business objectives and empower data-driven decision-making processes. Collaboration with data analysts, data scientists, and other stakeholders will be essential to ensure data integrity, reliability, and accessibility. Responsibilities:
* Design, develop, and optimize data pipelines and architectures using a variety of technologies and tools including Python, SQL, Spark, Kafka, and Airflow.
* Develop efficient data models to facilitate storage, retrieval, and processing, with a focus on schema design for NoSQL databases, data lakes, and data warehouses.
* Ensure scalability of big data architecture to handle large data volumes and high traffic loads.
* Implement data quality checks, validation processes, and data governance measures to ensure accuracy and consistency of data.
* Monitor, troubleshoot, and debug data issues and performance bottlenecks.
* Implement security measures such as encryption, access controls, and data masking to protect sensitive data.
* Research and evaluate new data technologies and best practices to enhance data engineering processes and solutions.

Top Profiles:
Top Profiles

We are seeking a Senior Data Engineer to promote and maintain our unique data processing platform. You will be joining a team responsible for the management of the data layer at petabyte scale by creating and managing enterprise grade systems, and flows that process ~50TB of data every day and growing. The team will constantly evaluate new technologies in the field of data processing, data governance and data management to transform the company to truly data driven.
Responsibilities:
Design and implement advanced ETLs, high throughput, fault tolerant infrastructure with an emphasis on correct testing, CI/CD processes and data quality.
New technology due diligence, proof of concepts and implementation.
Deep understanding of our data platform including business value and lineage.

We are looking for a Big Data Developer (Snowflake).
What will you do?
Migration of existing data warehouses from Azure SQL Database to Snowflake. The current data warehouse, in addition to standard analytical functions, is also a data source for the web application.
Data warehouse implemented in the lambda architecture, combining Real Time data from IoT devices and data from other sources such as SQL server databases. This project is the beginning of the implementation of Single Source Of Truth for the entire organization
This is an early phase of the project, starting implementation after the design phase.
● analyze and organize raw data
● evaluate business needs and objectives
● data modeling
● architecture designing
● developing ELT logic
● ensuring data quality
● code optimization
● preparing documentation

We deliver valuable results and insights for a fast-growing clientele of major app developers using elite programmatic user acquisition and retargeting technologies.
Our state-of-the-art machine learning technology analyzes 50TB of raw data per day to produce millions of ad recommendations in real-time. This data is used to power our machine learning predictions, business critical metrics, and analytics to power our decision making.
As a Big Data Engineering Team Lead, you will be leading a team responsible for the petabyte scale streaming data layer and real time decision making process from the data lake. Your team will be creating and managing enterprise grade systems, and flows that process ~50TB of data every day. The team will constantly evaluate new technologies in the field of stream processing and high scale high concurrency state store.
Responsibilities:
Lead the backend, streaming and serving projects from the requirements phase through the client delivery and implementation of new production needs (as needed).
Provide leadership and mentorship to the engineering team, fostering a collaborative and high-performing work environment. Set clear goals, provide regular feedback, and conduct performance evaluations to ensure team growth and development.
Be an active member involved in technology selection processes and implementation of new parts of the architecture using these technologies.
Have a deep understanding of our data, how it is acquired, managed, versioned, made discoverable, its relations, and how it can be consumed.

We are looking for a seasoned, proactive engineer with an innovative vision and technical expertise in large complex systems to join our dynamic Data Platform R&D team in Tel Aviv.
To join us, you must enjoy a challenge, be ready to make a significant impact, and dive deep into a Big Data platform, delivering top-tier code using cutting-edge frameworks and technologies.
What will you do?
You'll lead end-to-end feature development for financial data solutions, from design to production. You'll also innovate by prototyping new products within our expanding ecosystem, contribute to large-scale distributed information systems, and collaborate with cross-functional teams to drive strategic core capability development.
Are you up for the challenge?

As the Vice President of Data , you will hold a critical leadership position responsible for driving strategic decisions through advanced quantitative analysis and data Science. Your expertise will be instrumental in cross-departmental collaboration with product marketing, customer service, and operations teams to ensure alignment and synergy across all areas of the business.



Responsibilities:



Lead and mentor multiple teams of Analysts, Data Scientists and Data Engineers.
Initiate & manage cutting-edge projects from ideation to delivery, including developing automated solutions.
Evaluate and improve the companys KPIs through data.
Collaborate closely with Stakeholders from Product, Marketing, Operations, Customer support and Finance and initiate data driven decisions and solutions.
Lead the analysis of complex datasets to extract valuable insights, trends, patterns, and anomalies that drive strategic decisions.
Lead the building and upgrade of existing data infrastructure to cope with performance, scalability, and growth.

The Senior Data Analyst position is a vital role within our Data Ingestion R&D department, primarily focused on ongoing research and model building for the company's data ingestion part of the product.

This dynamic role involves conducting in-depth research, focused on mobility and point of interest (POI) data. As a key contributor to our data analytics team, the Senior Data Analyst uses big-data technologies & statistical methods to transform location data into actionable insights, fine-tune models and optimize data pipelines.

RESPONSIBILITIES:

Conduct comprehensive data analysis, utilizing statistical techniques, to uncover valuable insights, patterns, and trends related to core algorithms in our product
Design, develop and maintain data pipelines using Apache Airflow, ensuring a timely and reliable generation of critical reports
Translate technical findings into actionable recommendations that support strategic planning and business optimization
Evaluate new potential data sources, assess added value and recommend if to integrate with the product
Leverage advanced technologies such as Python, SQL and PySpark for efficient data manipulation, analysis and modeling
Work closely with R&D and Data Science teams to ensure the optimal solution is built in terms of logic and infrastructure
Work closely with product teams to collaborate on innovative solutions for product gaps

As a Senior Data Engineer, working within Foundation Entity Group, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that powers our location analytics platform.

RESPONSIBILITIES:

Data Pipeline Architecture and Development: Design, build, and optimize robust and scalable data pipelines to process, transform, and integrate large volumes of data from various sources into our analytics platform.
Data Quality Assurance: Implement data validation, cleansing, and enrichment techniques to ensure high-quality and consistent data across the platform.
Performance Optimization: Identify performance bottlenecks and optimize data processing and storage mechanisms to enhance overall system performance and reduce latency.
Cloud Infrastructure: Work extensively with cloud-based technologies (GCP), to design and manage scalable data infrastructure.
Collaboration: Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Software Engineers to understand requirements and deliver solutions that meet business needs.
Data Governance: Implement and enforce data governance practices, ensuring compliance with relevant regulations and best practices related to data privacy and security.
Monitoring and Maintenance: Monitor the health and performance of data pipelines, troubleshoot issues, and ensure high availability of data infrastructure.
Mentorship: Provide technical guidance and mentorship to junior data engineers, fostering a culture of learning and growth within the team.

XM Cyber is a global leader in hybrid cloud security. XM Cyber brings a new approach that uses the attacker’s perspective to find and remediate critical attack paths across on-premises and multi-cloud networks. The XM Cyber platform enables companies to rapidly prioritize and respond to cyber risks affecting their business-sensitive systems. As a Senior Backend engineer with Spark experience at XM Cyber, you'll be responsible for implementing core features, building infrastructure, and finding innovative solutions while getting into the language internals. We're looking for top talents who are ready to level up their skills in an exciting and fast-paced environment. You will be responsible for leading features and products end to end, from design to production; build and develop modules, data pipelines, and services.

we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results. We value your take charge, take initiative, get stuff done attitude and will help you unlock your growth potential. One great choice can change everything. Thrive with us.
We are looking for a highly skilled Full Stack engineer to join the integrations team. The team is responsible for two main products that enrich users CRM data (millions of records) with our data or import their CRM data to to allow custom data filtering from our core products (SalesOs and others).
Responsibilities:
Develop and maintain the backend systems - Implementing new features and capabilities while maintaining the existing ones
Develop new UI components for the Enrich and Org import products - Implementing new features and capabilities while maintaining the existing ones
Designing, planning, and executing the roadmap for the team while focusing on scale, quality, and performance.
Work closely with other engineering teams and product managers to understand the business requirements.
Communicating and completing tasks with stakeholders that are outside the direct team.
Work closely with product managers and UI/UX team to understand the business requirements.
Find the right balance between perfection and getting the job done.

we are looking for a Senior Big Data Engineer.
. In this role, you will assume the pivotal position of lead developer, entrusted with spearheading the creation of innovative software products.
On a typical day youll:
Write clean, concise code that is stable, extensible, and unit-tested appropriately
Diagnose complex issues, evaluate, recommend and execute the best solution
Implement new requirements within our Agile delivery methodology while following our established architectural principles
Test software to ensure proper and efficient execution and adherence to business and technical requirements
Write code that meets the production requirements and design specifications and anticipate potential errors/issue
Provides input into the architecture and design of the product; collaborating with the team in solving problems the right way
Develop expertise of AWS, Azure, and GCP products and technologies